Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Insight on what qualifies as an "Impacted" test
MarcChu
#1 Posted : Friday, September 23, 2016 4:48:43 PM(UTC)
Rank: Member

Groups: Registered
Joined: 9/26/2014(UTC)
Posts: 22

Thanks: 3 times
Was thanked: 1 time(s) in 1 post(s)
I've got a solution with DOZENS of projects and hundreds of tests. This solution is so large that I don't expect to get any kind of specific answer as to what's causing my problem, so I'm just looking for some insight: how does NCrunch determine when a test is 'impacted'.

I have found that the "Run impacted tests automatically" engine mode works fine many times. Other times, I've found that a change has somehow triggered dozens of tests should not have been impacted by the change. I can imagine that there are any number of configuration settings in any number of these projects that may be unnecessarily or incorrectly set that is triggering some sort of change detection, and I'd just like some input as to specific behaviors that I can look for and specific settings I can tweak that will cause only the barest subset of tests to be run under this engine mode.
Remco
#2 Posted : Saturday, September 24, 2016 12:06:03 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,123

Thanks: 957 times
Was thanked: 1287 time(s) in 1194 post(s)
Hi, thanks for posting!

NCrunch's impact detection is currently very basic. If a test covers a line of code in a changed file, the test is considered impacted.

There are many edge cases where a test can be impacted by a change but not detected by the engine. Likewise the design is such that many tests that are not really impacted may also be considered impacted.

There are major upgrades coming to the impact detection in V3, it's considered to be a large feature area for the new version.
1 user thanked Remco for this useful post.
TURNSKIN on 9/27/2016(UTC)
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.025 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download