Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Tests returning error 5 after upgrade, can we suppress this?
samholder
#1 Posted : Monday, July 24, 2017 3:46:37 PM(UTC)
Rank: Advanced Member

Groups: Registered
Joined: 5/11/2012(UTC)
Posts: 94

Thanks: 28 times
Was thanked: 12 time(s) in 12 post(s)
Hi,

We recently upgraded for an old v2 version to v 3.9 for our console tool. Now we are getting failures every time we run the tests as some tests are not run. Is there some way we can determine which tests are not running and causing this issue and tell NCrunch to ignore the fact that those tests don't run? or can we tell the console tool to revert to the previous behaviour and return 0 as long as all the tests pass?

Cheers

Sam
Remco
#2 Posted : Monday, July 24, 2017 11:24:06 PM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,123

Thanks: 957 times
Was thanked: 1286 time(s) in 1193 post(s)
Hi Sam,

Normally, tests that aren't run should be shown in the HTML report generated by the console tool. It's possible that tests weren't run by the tool if the tool is using an engine mode or automatic execution filter that excludes the tests from the run, or if the tests are making use of RequiresCapabilityAttribute and the machine running them doesn't have the appropriate capabilities declared in its configuration.

The tool returns a separate return code for when tests were missing from the run, because in many situations this could be considered an error case that people would want to consider (for example, if the tests were dependent on there being a connected grid node that happened to be offline). There is no feature in the software itself that can tell it to 'ignore' such a state and return 0, but you could easily wrap up the tool in a batch file that would check the return code and return 0 to your CI system if it didn't pass a simple condition.
1 user thanked Remco for this useful post.
samholder on 7/25/2017(UTC)
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.022 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download