Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Manual Execution Not Running All Tests
keith
#1 Posted : Monday, January 11, 2016 2:42:52 AM(UTC)
Rank: Newbie

Groups: Registered
Joined: 12/24/2013(UTC)
Posts: 9
Location: Australia

Was thanked: 1 time(s) in 1 post(s)
Sometimes we use the "let me run my tests manually" mode.

I've noticed since upgrading to version 2.19.0.4 it happens a lot that I right click on a parent node in the test view (e.g. the test project) and select from the context menu "Run selected tests in a new task runner process" - it will not run all the tests under the selected node. E.g. I'll click on a node with 20 child tests and it will only run five of them. Just wondering if you guys have seen that before / can reproduce the issue.

I don't recall this happening on older versions. I think I was running 2.16 on VS2013 before and it was OK, then I upgraded to 2.10 on VS2015.

Cheers,

Keith
1 user thanked keith for this useful post.
JohanSpannare on 1/19/2016(UTC)
Remco
#2 Posted : Monday, January 11, 2016 2:45:18 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,000

Thanks: 932 times
Was thanked: 1259 time(s) in 1172 post(s)
Hi Keith,

Thanks for sharing this issue.

I have seen some erratic behaviour around this before, though I've yet to actually pin it down. I think it may be some kind of a sync issue between the engine and the UI. Can you confirm you're working in v2.19?

I'd be eager to learn more about this problem if you can find a way to reproduce it.
keith
#3 Posted : Tuesday, January 12, 2016 12:24:23 AM(UTC)
Rank: Newbie

Groups: Registered
Joined: 12/24/2013(UTC)
Posts: 9
Location: Australia

Was thanked: 1 time(s) in 1 post(s)
Hi Remco,

Yep I can confirm I'm using 2.19.0.4.

If I find out any more information I'll let you know. The only thing I've observed about it so far is that it tends to happen when I try to run a number of tests (e.g. > 20) that haven't been run recently.

E.g. I open the solution for the first time, right click on my test project in the NCrunch Tests window and manually run all the tests in a particular test project then maybe about half of them are run. If I right click and run them again then they all execute.
Remco
#4 Posted : Tuesday, January 12, 2016 3:07:21 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,000

Thanks: 932 times
Was thanked: 1259 time(s) in 1172 post(s)
keith;8217 wrote:

E.g. I open the solution for the first time, right click on my test project in the NCrunch Tests window and manually run all the tests in a particular test project then maybe about half of them are run. If I right click and run them again then they all execute.


Does this happen for you every time on a new session? Is this using the 'Run selected tests' button or the 'Run all tests' button?
keith
#5 Posted : Tuesday, January 12, 2016 4:53:23 AM(UTC)
Rank: Newbie

Groups: Registered
Joined: 12/24/2013(UTC)
Posts: 9
Location: Australia

Was thanked: 1 time(s) in 1 post(s)
I just tried the following and it worked fine, all my tests ran:

Launch Visual Studio 2015.
Open the solution, wait for nCrunch to initialise.
Select on a project in the tree view (MyCompany.Product.UnitTests).
Click the "run selected tests" button.

I have noticed it happening a bit this morning (not on first launch) - will let you know if I find out any more info.
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.032 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download