Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Risk/Progress bar - what do you want to tell me?
DanHil
#1 Posted : Thursday, July 4, 2013 8:18:07 AM(UTC)
Rank: Advanced Member

Groups: Registered
Joined: 11/12/2012(UTC)
Posts: 85

Thanks: 11 times
Was thanked: 3 time(s) in 3 post(s)
I finally just have to say it:
I don't understand what the Risk/Progress bar is meant to tell me, especially the "risk" part. And I read the documentation several times already.

Am I being dumb or are others feeling the same?
Remco
#2 Posted : Friday, July 5, 2013 12:08:47 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 6,986

Thanks: 931 times
Was thanked: 1257 time(s) in 1170 post(s)
In summary, the 'Risk' percentage is calculated roughly as the number of impacted tests in the processing queue divided by the number of unimpacted tests in the processing queue (with certain weightings attached to each).

The rationale is that when a change to the codebase is made, the risk percentage gives you some idea of how risky the change was and therefore what kind of likelihood there is that there may be a subsequent test failure. You'll notice that there is a shaded area of the graph that also describes the risk. This shows how the risk is expected to change as the tests are progressively executed. You'll notice that if you make a change that impacts a number of fast running tests, then the risk will drop quickly (shown by the shaded area falling sharply).

There are many changes planned for this feature in later releases. In retrospect, it should have been done very differently. The risk metric is less valuable than it was originally believed to be, and there are future opportunities to make this view more configurable to show information that may be more valuable depending on your needs. Some time ago I actually wanted to take it out, but the feature has proved to be popular with a number of people that really wanted it kept in. Because this view simulates an entire test execution run continuously, it is also quite expensive in terms of processing power on larger solutions. You may find the engine is less responsive if you keep it open with many tests in the processing queue.
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.027 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download