Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Extra tests reported in TC.
samholder
#1 Posted : Saturday, November 24, 2018 12:30:24 AM(UTC)
Rank: Advanced Member

Groups: Registered
Joined: 5/11/2012(UTC)
Posts: 94

Thanks: 28 times
Was thanked: 12 time(s) in 12 post(s)
When we run the tests in TC (we use console tool and grid nodes to run the tests) we get extra tests reported, which seem to be the test fixture. We use specflow with MSTest to run the tests. an example will be

InsurerAddOnsFeature. _​Fixture_​ (Cashmere.UI.Specifications.Testing:Cashmere.UI.Specifications.Testing.Features.TeamWindsor) which has run in 544 ms

and then later

InsurerAddOnsFeature. Add an insurer add-on (Cashmere.UI.Specifications.Testing:Cashmere.UI.Specifications.Testing.Features.TeamWindsor) which has run in 6m 18 seconds (this is the real test)

I'm not sure why these extra _fixture_ tests get reported but it would be nice if we could suppress them somehow

Cheers

Sam
Remco
#2 Posted : Saturday, November 24, 2018 11:31:32 PM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 6,974

Thanks: 929 times
Was thanked: 1256 time(s) in 1169 post(s)
Hi Sam,

Thanks for posting.

This is behaviour as designed, because without it we have no way to report data from the fixtures themselves.

It's quite common for fixture tests to report information outside their child tests. For example, trace data and code coverage data from methods like TestFixtureSetUp or ClassInitialize. This data can be very important and it does need to be reported. Since the reporting structures available to us don't let us report this data, we build a virtual test to hold it. When considering the other option (not reporting on fixture data), having an erroneous test count seems like the lesser of two evils.
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.023 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download