Forum member

Remco NCrunch Developer

7586 posts

Posts by Remco

  1. Churn mode - Not working with multiple threads?

    Hi, thanks for sharing this. This shouldn't normally happen. Can you produce this consistently with any test in your suite? Does it happen when churning only one test?

    06 Mar 2018 22:45 UTC

  2. Some recommendation for how large test project should be?

    Hi, thanks for posting. The problem with these kind of guidelines is that there are so many variables involved. For example, a large project with 100,000 lines may work reasonably well if it's using the NCrunch MSTest adapter set to static analysis (which is pretty fast) and there is a minimal…

    06 Mar 2018 22:37 UTC

  3. Execution time filter with console tool?

    [quote=GreenMoose;11864]So, given I have the settings below, is it the "NCrunchCacheStoragePath " folder I need to "keep" between sessions in order for NCrunch to remember the previous test states? I guess this also will work with "when impacted" filter then? [quote] Yes, as long as you have the…

    02 Mar 2018 22:31 UTC

  4. Installing NCrunch 3.13 for VS2017 throws error on startup

    Yes! Sorry, this is a known issue at the moment. Right now our MSIs can only target one installed version of VS, which it seems to select more or less at random. If you have multiple VS instances installed (i.e. a preview version), you'll need to install it manually. We did a bit of QA on the ne…

    02 Mar 2018 22:28 UTC

  5. Execution time filter with console tool?

    Absolutely. The console tool is just a headless client, so it has access to all the same settings. The console tool works via automatic execution only, so as long as you set the 'Tests to run automatically' filter accordingly in the console tool's configuration, it will only run the tests that pas…

    02 Mar 2018 12:45 UTC

  6. Setting dialog icon for custom environment variables

    Good catch, thank you!

    02 Mar 2018 11:55 UTC

  7. Is it possible to ignore/filter tests by execution time?

    Hi Michael, Thanks for posting! Yes, this is certainly possible. You'll need to create a [url=http://www.ncrunch.net/documentation/concepts_engine-modes]custom engine mode[/url], which needs to have the [url=http://www.ncrunch.net/documentation/reference_solution-configuration_tests-to-execut…

    02 Mar 2018 11:54 UTC

  8. Filtered tests are stuck in 'Pending' status

    Hi Nico, The 'Pending' status represents tests that haven't yet been executed. It's an assumption by NCrunch that a pending test will eventually be executed, though under your configuration this would not be possible (unless a grid node were connected without the configured constraint). So perh…

    01 Mar 2018 23:39 UTC

  9. Use Roslyn build

    Hi Matt, Outstanding work in figuring this one out. Complex code in an attribute constructor will definitely cause this problem. Attribute constructors get called every time the attributes get enumerated using reflection, which can often result in accidental execution simply through meta-analys…

    27 Feb 2018 22:34 UTC

  10. Unit Test execution and data folders

    The only files that NCrunch itself will normally copy to _ncrunchreferences are the DLLs that are being statically referenced by your code. If you have other files under this directory, then these files won't be copied directly by NCrunch. It's possible you have a malfunctioning build step or cust…

    27 Feb 2018 01:58 UTC

  11. Unit Test execution and data folders

    Hi, thanks for posting. When it runs your tests, NCrunch will create a 'workspace' containing all your project files. This is essentially a sandbox in another area of your HDD. The project will be compiled in this workspace and any tests contained in it will also be run there. When the tests a…

    26 Feb 2018 22:54 UTC

  12. Meaning of Progress Bar display

    [quote=cbretana;11847]This solution has 4-5000 tests, which normally only take a few minutes to complete. Is there some way to see which test might be the culprit?[/quote] Yes, you'll need to use the [url=http://www.ncrunch.net/documentation/concepts_processing-queue]Processing Queue Window[/url]…

    25 Feb 2018 22:17 UTC

  13. Meaning of Progress Bar display

    The continuation of the bar is dependent on the test tasks in the processing queue being completed by the engine. If you have a big, long running test that is marked using the 'RequiredCapabilities' attribute or your engine is otherwise configured not to run it, this can result in a task being 's…

    24 Feb 2018 21:58 UTC

  14. Meaning of Progress Bar display

    Hi, thanks for posting. The documented description of this bar is here: [url=http://www.ncrunch.net/documentation/concepts_risk-and-progress-bar]http://www.ncrunch.net/documentation/concepts_risk-and-progress-bar[/url]. The screenshot you've posted describes that around 70% of the work in NCru…

    23 Feb 2018 23:07 UTC

  15. Use Roslyn build

    Hi Matt, Thanks for the CSV! This helps a great deal. So the bottleneck in this case is in NCrunch's code. The first thing I would recommend checking is that you're running the latest version of NCrunch (v3.12). This version contained a fix targeting this area of code, which in earlier vers…

    23 Feb 2018 23:03 UTC

  16. FAQ: Accreditation

    Hi, thanks for posting. Right now, the NCrunch software has no accreditation provided by any third party. Reasons for this as follows: 1. The software is used only in a development environment. It is not mission critical and its failure to perform will not result in catastrophic loss. 2. Th…

    23 Feb 2018 22:48 UTC

  17. Use Roslyn build

    Hi, thanks for posting. To know more about how where the bottleneck is here, we'll need to take a look at some of the performance analysis results from one of your NCrunch builds. The easiest way to do this is to turn on the [url=http://www.ncrunch.net/documentation/reference_global-configurat…

    22 Feb 2018 23:00 UTC

  18. NCrunch unable to find sn.exe (VS2017 only)

    [quote=omusavi;11829]Thanks, I will try it with the build and let you know how it goes. In the meantime, any ideas why even setting the registry values didn't work as a workaround? On a clean Windows 10 machine with only VS2017 installed, are you guys getting different values than I am for the wi…

    21 Feb 2018 23:25 UTC

  19. NCrunch unable to find sn.exe (VS2017 only)

    The build below contains a fallback that will try to find sn.exe using normal install locations on the file system if the registry attempts don't provide it. I recommend giving this a try. We were unable to produce an image with registry paths configured in the way that you've described, even when…

    21 Feb 2018 22:39 UTC

  20. NCrunch unable to find sn.exe (VS2017 only)

    My previous experience here has been that sn.exe is usually deployed in the Windows SDK, and although the .exe paths have varied somewhat inside the install directory. I would have thought that installing a previous version of the Windows SDK would place the file in a well known location, though as…

    21 Feb 2018 04:29 UTC