Manual Execution Not Running All Tests

Sometimes we use the "let me run my tests manually" mode.

I've noticed since upgrading to version 2.19.0.4 it happens a lot that I right click on a parent node in the test view (e.g. the test project) and select from the context menu "Run selected tests in a new task runner process" - it will not run all the tests under the selected node. E.g. I'll click on a node with 20 child tests and it will only run five of them. Just wondering if you guys have seen that before / can reproduce the issue.

I don't recall this happening on older versions. I think I was running 2.16 on VS2013 before and it was OK, then I upgraded to 2.10 on VS2015.

Cheers,

Keith

Hi Keith,

Thanks for sharing this issue.

I have seen some erratic behaviour around this before, though I've yet to actually pin it down. I think it may be some kind of a sync issue between the engine and the UI. Can you confirm you're working in v2.19?

I'd be eager to learn more about this problem if you can find a way to reproduce it.

Hi Remco,

Yep I can confirm I'm using 2.19.0.4.

If I find out any more information I'll let you know. The only thing I've observed about it so far is that it tends to happen when I try to run a number of tests (e.g. > 20) that haven't been run recently.

E.g. I open the solution for the first time, right click on my test project in the NCrunch Tests window and manually run all the tests in a particular test project then maybe about half of them are run. If I right click and run them again then they all execute.

keith wrote:
E.g. I open the solution for the first time, right click on my test project in the NCrunch Tests window and manually run all the tests in a particular test project then maybe about half of them are run. If I right click and run them again then they all execute.

Does this happen for you every time on a new session? Is this using the 'Run selected tests' button or the 'Run all tests' button?

I just tried the following and it worked fine, all my tests ran:

Launch Visual Studio 2015.
Open the solution, wait for nCrunch to initialise.
Select on a project in the tree view (MyCompany.Product.UnitTests).
Click the "run selected tests" button.

I have noticed it happening a bit this morning (not on first launch) - will let you know if I find out any more info.