Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

'Show unexecuted tests' behavior
wilhelmmedetz
#1 Posted : Thursday, September 7, 2017 8:06:22 AM(UTC)
Rank: Advanced Member

Groups: Registered
Joined: 7/4/2012(UTC)
Posts: 35

Was thanked: 2 time(s) in 2 post(s)
I have some long-running stability/performance tests, that are excluded in my default engine mode via a TestCategory.

I usually disable 'show passing tests' and enable the other three options (failing, unexecuted, ignored).

When i manually execute the stability tests successfully for the first time, they disappears from the Tests window.

After making some changes, that also impact the stability tests, all other tests are executed, but the stability tests remain in state succeded.

In my opinion, the state for these tests should change to unexecuted, and they should be displayed in the test window as unexecuted.

Maybe this can be changed

Regards

Wilhelm
Remco
#2 Posted : Thursday, September 7, 2017 8:12:37 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 6,970

Thanks: 929 times
Was thanked: 1256 time(s) in 1169 post(s)
Hi Wilhelm,

There is a special state that the NCrunch engine uses for this. You'll notice that the status of these tests is set to Passing but Out Of Date, which is symbolised by a green question mark. Code coverage for the tests is then faded somewhat to show that this data is outdated.

To put the tests back into an unexecuted state wouldn't fit with the other attributes that tests have when they are in this state. Because the tests still have execution history, their data is still relevant. The tests still did pass when they were last run, they have code coverage, performance data, trace results, and a result that is still relevant even if it is outdated.

If I understand the way you are using the tool, do you want the tests to revert to an unexecuted state so that they show up in your Tests Window filter? It seems that to solve this, the better thing to do would be to simply make the Tests Window filter more configurable so that you can show tests that are passing but out of date, while hiding the tests that are passing but are current. What do you think?
wilhelmmedetz
#3 Posted : Thursday, September 7, 2017 8:36:09 AM(UTC)
Rank: Advanced Member

Groups: Registered
Joined: 7/4/2012(UTC)
Posts: 35

Was thanked: 2 time(s) in 2 post(s)
Hi Remco,

'make the Tests Window filter more configurable so that you can show tests that are passing but out of date, while hiding the tests that are passing but are current.' seems to be exactly what I want.
Remco
#4 Posted : Thursday, September 7, 2017 8:38:11 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 6,970

Thanks: 929 times
Was thanked: 1256 time(s) in 1169 post(s)
wilhelmmedetz;11161 wrote:
Hi Remco,

'make the Tests Window filter more configurable so that you can show tests that are passing but out of date, while hiding the tests that are passing but are current.' seems to be exactly what I want.


Great :) Would you like to write up a feature request for this in uservoice that captures the requirement as it fits your needs?
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.030 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download