Forum member

Remco NCrunch Developer

7611 posts

Posts by Remco

  1. False positive test results with .NET Core

    If you haven't tried this already, I suggest giving Churn Mode a go. This should give you a way to surface intermittent failures consistently, allowing you to fix them. At the moment we have no known issues in NCrunch itself that could cause the problem you're describing. That doesn't mean th…

    06 Feb 2019 21:28 UTC

  2. False positive test results with .NET Core

    Hi Christoph, Thanks for sharing this issue. This looks to me very much like sequence dependent behaviour. What is the nature of the failure? Does examining the code coverage of the failed test give any clues about why it might be failing? Here's some relevant documentation around [url=ht…

    06 Feb 2019 07:53 UTC

  3. Console HTML report: See output of "test not run"?

    The problem is that the 'Not Run' state is handled as a composite of the test result itself, so it isn't possible in NCrunch's model for a test to have a 'Not Run' status at the same time as holding a previous pass or fail result. To avoid reporting pass/fail results from previous runs we're actual…

    05 Feb 2019 23:36 UTC

  4. Console HTML report: See output of "test not run"?

    Although this data is definitely available inside the NCrunch cache file, we've gone through some trouble to avoid including it in any of the reports generated by the console tool. This is because when such data is included in the reports, it creates some very confusing situations where people are …

    04 Feb 2019 20:06 UTC

  5. BUG: DynamicData does not work properly for StringExtensions

    Hi, Thanks for sharing this issue. I've reproduced it exactly as you've described. The problem is related to the nulls inside the object array, but you probably figured this out already :) I'll see about arranging a fix.

    04 Feb 2019 19:59 UTC

  6. Engine mode name edit not persisted if using Alt+O shortcut.

    Thanks! This is a good catch. We'll get it fixed.

    01 Feb 2019 21:31 UTC

  7. Sporadic IndexOutOfRangeException in TestCaseSource-based tests

    [quote=nshallred;13019] It's curious that the problem reliably repeats under ncrunch but has not been seen in any other test runner. So far I have used Visual Studio's integrated test runner and Resharper. The tests are run on the build machine using dotnet test and also pass without issue. I've…

    01 Feb 2019 21:30 UTC

  8. Sporadic IndexOutOfRangeException in TestCaseSource-based tests

    Something else to try is switching to a different version of VS. MS have been making regular updates to GC behaviour and it's possible you've found a new problem or stumbled over something they've recently fixed. Unfortunately I don't know of any certain way to know whether the concurrent GC is …

    31 Jan 2019 21:11 UTC

  9. Sporadic IndexOutOfRangeException in TestCaseSource-based tests

    Hi Nick, Thanks for sharing this issue in such detail. NCrunch uses an unmanaged map to store code coverage details during execution and surface them from the test run. The only way you can disable this map at run time is by turning off the 'Instrument output assembly' setting and disabling c…

    30 Jan 2019 19:02 UTC

  10. Ncrunch Console + Grid Server: Sometimes Load Failure

    Hi Sergei, Thanks for sharing this issue. It looks like the MSBuild system responsible for loading the NCrunch project is suffering from a catastrophic failure and the process is being suddenly terminated without warning. This could be due to an out of memory exception. Try changing the [u…

    30 Jan 2019 09:15 UTC

  11. ASP.NET Core 2.1 integration tests

    [quote=pelletierjy;13009]Looks like this is still going on... in 2019 as I'm still facing it with nCrunch 3.23.0.10 in VS 2017. Any ETA available? Thanks![/quote] Can you confirm which version of .NET Core you are using? I believe the MS-side of the fix was supposed to be released with .N…

    25 Jan 2019 02:56 UTC

  12. NCrunch 3.23 does not

    [quote=Der-Albert.com;13005]Was not able to reproduce the problem.[/quote] Thanks for confirming. Do let us know if you find a way to get it happening in a sample.

    17 Jan 2019 22:26 UTC

  13. NCrunch 3.23 does not

    Hi Albert, Thanks for sharing this problem. Off the top of my head, I can't think of anything we changed in 3.23 that would affect Directory.build.props resolution, and I'm certain we have tests covering this use case. Is it at all possible for you to try downgrading to 3.22 to confirm for me w…

    14 Jan 2019 10:42 UTC

  14. How to pin testB when testA is currently showing coverage?

    Hi, thanks for sharing this. The intention here is that the test entry points should still be active when filter the coverage, so you can still work with the other tests inline. I've just checked this and apparently this isn't the case - the code just hides all the entry points when you filter the…

    11 Jan 2019 22:39 UTC

  15. Incremental build with NCrunch console?

    Hi, thanks for posting. Right now, there is no way to avoid cleaning up the workspaces at the end of the run with the console tool. Since it's basically just a headless client, it has more or less the same bootstrap sequence and follows the same execution pattern (load, build workspaces, build…

    07 Jan 2019 22:04 UTC

  16. "Unable to write to file while transferring snapshot to node: some-nuget-package-dll"

    Thanks for confirming Olaf! I hope you're having a great start to the new year.

    02 Jan 2019 07:37 UTC

  17. NCrunch not happy with unsafe code

    Hi, thanks for posting! Can you tell me a bit more about the templates used for these projects? My guess is that something in the project XML is causing NCrunch to exclude the declaration for unsafe code. If you can share the XML (or at least the top part of it), I might be able to help narrow …

    30 Dec 2018 23:26 UTC

  18. System.Windows.Application Not Populated Under NCrunch

    Hi, thanks for posting. Have you tried this code using any other test runner? My understanding is that usually the application object itself would be populated by the application bootstrap routine (i.e. Program.Start). You might need to add special setup code to your automated test to allow you…

    22 Dec 2018 23:45 UTC

  19. Support for VS 2019?

    [quote=MatthewSteeples;12966]I'm only posting this here to save anyone else attempting the same. I attempted to manually install NCrunch into VS2019 (following the instructions). It installs without errors but doesn't really function. It also complains about the extension synchronously loading, so t…

    21 Dec 2018 23:01 UTC

  20. Why is not NCrunch aborting build/analysis on pending grid nodes when no work remains?

    Technically, no. There is no good reason for this. There are also other things that the grid is doing that can be further optimised. For example, right now we run an analysis task for a built project on every machine in the grid. Really, we only need to do this once, as we only take the result…

    21 Dec 2018 22:56 UTC