Forum member

Remco NCrunch Developer

7586 posts

Posts by Remco

  1. xUnit category not used

    Hi, thanks for posting. To my knowledge, this should create the same effect. If you turn on the 'Categories' column in the Tests Window, do you see the category correctly assigned to your tests?

    28 Sep 2017 22:45 UTC

  2. Tests utilising Microsoft.AspNet.TestHost fail in NCrunch

    Do you notice much of a pattern around how/when it appears? My particular interest is whether this happens mostly when NCrunch is first initialised. The problem itself seems to be a load issue. When NCrunch interrogates MSBuild as it loads the project, MSBuild isn't returning a path for the proje…

    28 Sep 2017 09:34 UTC

  3. Tests utilising Microsoft.AspNet.TestHost fail in NCrunch

    Are you seeing this from a project that has a project.assets.json file? (i.e. .NET Core or CPS project). The error itself is being kicked up because NCrunch is expecting a project assets file, but doesn't seem to have knowledge of one. I'm aware of a race condition that can cause some problems whe…

    27 Sep 2017 23:01 UTC

  4. Installing NCrunch on nicknamed multiple installations of Visual Studio 2017

    Hi, See here for details - [url=https://ncrunch.uservoice.com/forums/245203-feature-requests/suggestions/19682887-support-multiple-visual-studio-2017-installations]https://ncrunch.uservoice.com/forums/245203-feature-requests/suggestions/19682887-support-multiple-visual-studio-2017-installations[/…

    27 Sep 2017 22:46 UTC

  5. OutOfMemoryException while building a project

    Hi, Thanks for sharing this problem. Do you see this consistently? Or does it happen after a while? Does changing the [url=http://www.ncrunch.net/documentation/reference_project-configuration_build-process-cpu-architecture]build process CPU architecture[/url] to x64 make any difference?

    27 Sep 2017 12:07 UTC

  6. NCrunch does not honor the max timeout and runs tests forever

    I've done some testing today with a solution containing large batches of tests (5000) at a time. Although the performance was far from ideal, it was still quite workable. I don't think this problem is being caused by a bottleneck related to the number of tests. Can you please share with me the …

    27 Sep 2017 04:53 UTC

  7. What does the Fast Lane Threshold setting do? The UI description seems off

    Thanks for sharing this. The description in the UI is wrong, it was copy pasted from the other setting and wasn't updated. The 'Task' in this context is a task held in the processing queue, so it's usually a batch of tests or a build task.

    26 Sep 2017 22:54 UTC

  8. NCrunch Console hanging under TeamCity (possible cause)

    Hi, thanks for sharing this issue. An important consideration here is to establish the source of the hanging, which is best done using the logs from the console tool run. There are two ways this can hang: 1. A test is running overtime and cannot be aborted 2. The engine is failing to correct…

    26 Sep 2017 22:34 UTC

  9. Problems using FsCheck arbitraries

    Hi, Thanks for sharing this problem. This doesn't appear to be an issue caused by NCrunch. I observe the exact same behaviour when I execute this code using the xunit visualstudio runner. There is considerable complexity here inside FsCheck, and the types involved are completely unknown to…

    26 Sep 2017 03:18 UTC

  10. NCrunch does not honor the max timeout and runs tests forever

    Sorry, I'll try to be more specific. At the moment I suspect this is a performance issue that is specific to large test execution tasks, as visible in the processing queue. In this case, we have 4000 tests sitting inside one test execution task. I've never seen that before, though it certainly …

    26 Sep 2017 02:50 UTC

  11. FromRelativePath throws if path is contained in quotes

    Thanks for sharing this problem. It doesn't match with my knowledge of MSBuild conventions for an item to be valid when in quotes, so this looks to be special case. Does suppressing this with a condition allow you to work around the problem? i.e: <OtherFlags Condition="'$(NCrunch)' != '1'"…

    26 Sep 2017 02:44 UTC

  12. NCrunch does not honor the max timeout and runs tests forever

    Looking at the log, it's possible this may be caused by a performance issue in NCrunch's test adapter or in the underlying framework itself. Is this using NUnit3? It's fairly unusual to see 4000 tests in a single batch. NCrunch runs these tests by identifying them to the test framework and te…

    23 Sep 2017 23:14 UTC

  13. NCrunch does not honor the max timeout and runs tests forever

    [quote=abelb;11242]Thanks for your answer. I may have misphrased, as I didn't mean for you to spend hours on this, essentially I think I merely hoped on a "yes, it happens here too, strange, but not sure what it causes", or a "doesn't happen here, must be something local" or even a "oh, I have seen …

    23 Sep 2017 13:08 UTC

  14. NCrunch does not honor the max timeout and runs tests forever

    [quote=abelb;11240] Could I bother you to look into this by running this on your system with NCrunch? It's not that just one test is hanging, it is several thousands at once. I can send you a ZIP of the whole project, so you get the same situation. Alternatively, I can send you just the binaries th…

    23 Sep 2017 08:30 UTC

  15. Unable to load NCrunch in VS2017 after crash during test configuration

    Thanks for sharing this problem. This is being caused by an invalid core descriptor in your global configuration file at C:\Users\USER\AppData\Roaming\NCrunch. If you can share the contents of this config file with me, I'll see if I can reproduce the problem on my side. Removing or renaming t…

    22 Sep 2017 02:54 UTC

  16. Could not load file or assembly 'System.Runtime, Version=4.1.1.0...'

    Horrah! I'm glad you found the solution! Thanks for letting me know :)

    21 Sep 2017 23:44 UTC

  17. Could not load file or assembly 'System.Runtime, Version=4.1.1.0...'

    NCrunch is continuing to function in this case because the error is happening only during the analysis task, when tests are discovered. The analysis task is always run on each grid node after a build. Because only one task is actually needed to get the true list of tests, the redundancy allows t…

    21 Sep 2017 11:47 UTC

  18. When NCRunch adds instrumentation, it sometimes changes the signature of class members

    Because it involves heavy code manipulation and detailed tracking, instrumentation does come with technical limitations. It is unfortunately not possible to measure the performance of software without at some level affecting the performance itself. Because NCrunch is line-by-line, the instrumentat…

    21 Sep 2017 11:43 UTC

  19. When NCRunch adds instrumentation, it sometimes changes the signature of class members

    Thanks for sharing this problem. I think this is happening on writeback of the instrumented assembly. Probably there is some metadata here that is quite specific to F# and goes a bit wrong somewhere in the processing. Issues like this one can be quite hard to fix, so unfortunately I can't provi…

    21 Sep 2017 01:16 UTC

  20. NCrunch test duration not reporting correctly to TeamCity

    Thanks for sharing this problem. The TeamCity integration is way out of date and is due for an overhaul. I've made a note of this issue to get it addressed with the rest of the integration.

    20 Sep 2017 23:17 UTC