Forum member

samholder

100 posts

Posts by samholder

  1. NCrunch with reqnroll fails after update to net10

    yep, that seems to work now. much appreciated. Any timeline on the release date for the official next version (not that I have an issue with the interim build, these have never let me down yet), just interested

  2. NCrunch with reqnroll fails after update to net10

    I was able to recreate this with a sample project which you should be able to download from here: https://limewire.com/d/iIbOT#7WEidYxJSp hopefully this will help with identifying the issue.

  3. NCrunch with reqnroll fails after update to net10

    Hi, I'm getting a strange error after updating some projects to .net10 when I use reqnroll with NCrunch. The tests run fine in VS test runner and when I use dotnet test, but in NCrunch I get: Assembly initialize/cleanup failed: System.AggregateException: One or more errors occurred. (One or…

  4. Support newer report format for AzureDevops compatibility

    I think that has been touched on before but I wanted to raise whether its possible to get the NCrunch reporting to output a pseudo nunit v3 reporting format (or other Azure devops compatible format like trx) rather than (or in addition to) the current TestResultsInNUnitFormat.xml file so that when w…

  5. .Net Core 6 requirement for ncrunch for rider

    is it possible to force NCrunch in rider to use the net8 runtime using the roll forward compatibility? or is there a reason it needs to rely on the net6 runtime specifically?

  6. Regular disconnects from the grid nodes clients

    Hi, We are seeing regular forced disconnects in our grid node clients in the logs. We would like to understand what the disconnects mean so we can start to try and do something about it. The message we get logged is: [PID:7888 08:57:37.0204 ?-20] No data received from MACHINE_1 within conne…

  7. MSTest in dynamic mode causes NCrunch to error

    Hi. I have some tests that are in MSTest and use data rows. this causes NCrunch to tell me to switch to dynamic analysis mode. But when I do that the projects fail to build under ncrunch and I get this exception: An error occurred while analysing this project after it was built: System.Invalid…

  8. Controlling the batch size

    awesome, that's a relief :). Cheers for the quick and helpful responses. Getting bthe run time down from 30+mins to 5 is a massive boost for us.

  9. Controlling the batch size

    ok, I got the browser instance to be shared across the test batches (and got the test run time down to <5 mins for all 1000+ tests), but this raises a question for me. Given these are integration tests genrally we are not running them in continuous test mode. Usually its in 'run all tests manuall…

  10. Controlling the batch size

    https://ncrunch.uservoice.com/forums/245203-feature-requests/suggestions/47423294-support-better-control-of-the-test-batch-size created the user voice request

  11. Controlling the batch size

    ok, so I got the atomic attribute working and it allows the tests to be run in batches and thats great, however I misunderstood how it worked, and it effectively means you can't run a single test on its own any more as it has to run all those tests. I think this could be ok, but isn't really an appr…

  12. Controlling the batch size

    Cheers Remco. I'll look at the atomic attribute as an option in the short term, as this wouldn't have too much impact on the tests and would allow some large features to run a good chunk of the tests together (some features have >100 tests). I'll do a bit more digging into sharing the playwrig…

  13. Controlling the batch size

    I asked this question a while back: https://forum.ncrunch.net/yaf_postst3062_Specflow--BeforeTestRun--and--AfterTestRun--methods-are-being-called-multiple-times.aspx and whilst I understand the answer and the reason for the current behaviour, I'm having a similar issue again but when using pla…

  14. Endless churn to respect engine mode

    Hi, Is it possible to have endless churn respect the current engine mode? often I have a few tests which fail intermittently and I want to churn these until they fail (or until I have proved my fix works), but currently to do this I have to ignore every other test. If we could churn based o…

  15. Code with dynamic loading doesn't work as expected on grid nodes

    Hi. We have a project which is tested via end to end tests using playwright. The site has a system for overriding views in site specific libraries. When running locally everything works ok, but when I try and run the tests on grid nodes I find that the pages don't render currently because the DL…

  16. Grid nodes are requiring latest version of the SDK

    Thanks So that implies that if the console tool machine is not updated then the grid nodes should not need updating? Interestingly I updated the grid nodes first and that didn't help the issue. then I updated the console tool machine and installed 6.0.18, which then fixed the issue, so not sur…

  17. Grid nodes are requiring latest version of the SDK

    Hi, I'm pretty sure this is not a NCrunch issue, but I'm not exactly sure what causes this and its frustrating. When I build on a build agent (AzureDevops self hosted agent) which farms out to NCrunch console tool the build seems to work. The console tool then farms out to grid nodes, and thes…

  18. RawResults.xml contains incorrect information

    I've got a very strange issue. I'm running via console tool and getting some strange results. My workflow is to run tests with the console tool, then parse the RawResults.xml to find failing tests, and then rerun those tests using the console tool. I've noticed that what gets output in the Ra…

  19. Specflow [BeforeTestRun] and [AfterTestRun] methods are being called multiple times

    yep all good points. We already do some cleanup of older chromedriver processes for the exact reasons you outline but maybe the better approach would be to use something like the build number in the name of the chromedriver process and then have the build clean up the processes it knows that its run…

  20. Specflow [BeforeTestRun] and [AfterTestRun] methods are being called multiple times

    Thanks. To be clear we are using xunit, not nunit. I think you are probably right, and I'll look into the underlying implementation a bit more to see if there are options there. Problem with the static flag is that then AfterTestRun can never be executed, as we can't tell when things actually fi…