Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Coverage info vanished
marhoily
#1 Posted : Tuesday, November 3, 2015 7:59:16 PM(UTC)
Rank: Member

Groups: Registered
Joined: 9/2/2012(UTC)
Posts: 13

Thanks: 3 times
Was thanked: 1 time(s) in 1 post(s)
I see no\partial coverage info.

To repro the issue:

1) Turn on verbose logging
2) Restart NCrunch with the special "... (Reset)" button in UI
2a) Clear the output window
3) Notice that all tests just ran, all coverage info is in and visible (all bulbs without an exception are green)
4) Take a snapshot of the output window to capture the timestamp when everything was ok
timestamp
5) Wait a little bit more. NCrunch seems to run the tests again. Now all (or the most of) the green bulbs become white
bug
6) Copy the full log
I had the same issue before the last release too. Both on VS2013 and VS2015.

I would be glad for the workaround too, if not for the fix.
Remco
#2 Posted : Tuesday, November 3, 2015 11:13:59 PM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,161

Thanks: 964 times
Was thanked: 1296 time(s) in 1202 post(s)
Hi Ilya,

Thanks for reporting this problem. Please accept my apologies for the website being down – it seemed to hit some kind of DB related problem overnight and has since recovered.

It looks to me like there is an inconsistency here being caused by a race condition in the test. The test starts a number of different threads which execute in the background while the primary thread waits with a sleep.

When performing multi-threaded testing, it’s extremely important that the execution of all background threads is performed within the boundary of the foreground test thread. Where this isn’t the case, NCrunch will misreport coverage information because the background threads then become bounded by tests executed later in the run, and the coverage data isn’t allocated correctly. See here for more information - http://www.ncrunch.net/documentation/considerations-and-constraints_multi-threaded-tests.

The log file contained no unusual information about engine activity.

Does increasing the size of the Sleep make any difference?



Cheers,

Remco
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.031 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download