Forum member

Oliver Stark

26 posts

Posts by Oliver Stark

  1. nCrunch poor Test Performance and lost in "Analyse Assembly"

    hi and sorry for the late response. i was able to tweak the project settings so that the issue went away. thanks for pinpointing to the AnyCPU setting.

    21 Mar 2023 11:24 UTC

  2. nCrunch poor Test Performance and lost in "Analyse Assembly"

    available memory is about 14-16GB, so should be plenty. not sure why, but i was able to "catch" a more detailed stack trace on a failing test- maybe it helps: System.Exception: MapViewOfFile error (size = 19514): 8 at nCrunch.TestRuntime.RuntimeSharedMemory.handlePossibleError(IntPtr handle,…

    08 Mar 2023 10:19 UTC

  3. nCrunch poor Test Performance and lost in "Analyse Assembly"

    [quote=Remco;16521]Could you try the build below and show me the error message it gives you? I haven't yet managed to understand this problem, so I've added some extra diagnostic details in the build to try and figure it out. For some reason, the API responsible for allocating shared memory is fai…

    08 Mar 2023 07:47 UTC

  4. nCrunch poor Test Performance and lost in "Analyse Assembly"

    small extension: the failing tests can be run individually. also, when repeated as a whole, it seems to be working. unfortunately, as the tests are assembled via test case source and are numerous, the execution takes quite a while and unnecessary repetition is "costly".

    07 Mar 2023 14:19 UTC

  5. nCrunch poor Test Performance and lost in "Analyse Assembly"

    not sure if this is related to the submitted version that i am using, but one test assembly fails for all tests with the following exception in the trace output: System.Exception: MapViewOfFile error: at nCrunch.TestRuntime.RuntimeSharedMemory.handlePossibleError(IntPtr handle, String apiDet…

    07 Mar 2023 14:11 UTC

  6. nCrunch poor Test Performance and lost in "Analyse Assembly"

    FIRST impression of the provided binaries: working PERFECTLY! while i still have to play around a little more, at first glance, the "old" performance is back! 1) processing queue does not show any "starving" in the "processing assembly" action 2) after building and discovering, pending tests …

    06 Mar 2023 07:47 UTC

  7. nCrunch poor Test Performance and lost in "Analyse Assembly"

    [quote]When you run the test, can you do so with the debugger attached? Try breaking in a few times and check the stack trace on the runner thread. Is it consistently hung in one place? Can you get me the stack trace?[/quote] the request is trickier than it sounds (or the behavior is unexpected or …

    03 Mar 2023 13:30 UTC

  8. nCrunch poor Test Performance and lost in "Analyse Assembly"

    i was able to perform your request- with an unexpected bad result. i created a test within our soultion that only performs the environment variable lookup that was mentioned earlier. NCrunch is taking 5! minutes to execute that test (which i double checked multiple times): Enqueue tests for h…

    02 Mar 2023 13:20 UTC

  9. nCrunch poor Test Performance and lost in "Analyse Assembly"

    some intermediate feedback: [quote]Interesting. Do you see any coverage markers in NCrunch when you use the IDE?[/quote] no, only if i enable "Instrument Output Assembly" i see the markers. [quote]I think something that would be worthwhile is trying to isolate the performance issue in the tes…

    02 Mar 2023 12:40 UTC

  10. nCrunch poor Test Performance and lost in "Analyse Assembly"

    thanks for the quick followup. [quote]This is relevant information. Your normal test execution time is much lower under another runner. Can you try setting your 'Instrument output assembly' setting to 'False' at solution level in your NCrunch configuration? This will tell us if the difference in …

    28 Feb 2023 13:51 UTC

  11. nCrunch poor Test Performance and lost in "Analyse Assembly"

    sorry for the late response, but there were urgent matters to attend to. since we just have "limited" control over our working ecosystem, it is possibly not very promising to discuss about the system performance gap. and while i'm bying a certain amount of performance degradation compared to what…

    28 Feb 2023 08:05 UTC

  12. nCrunch poor Test Performance and lost in "Analyse Assembly"

    hi and thanks for the analysis effort. please give me some time to digest and follow up. the coming days i'll be off duty, but will get back to it next week.

    14 Feb 2023 14:27 UTC

  13. nCrunch poor Test Performance and lost in "Analyse Assembly"

    hi, i sent 2 log zips through the contact form now. not everything fitted in there since the attachment size seems to be 5MB only. please let me know if there is anything else needed.

    13 Feb 2023 13:50 UTC

  14. nCrunch poor Test Performance and lost in "Analyse Assembly"

    [quote]I think the max size is 10MB. Is there anything you can trim from it? Perhaps you can upload it in pieces?[/quote] yes, i can send it in pieces; i'll get back to it.

    13 Feb 2023 13:03 UTC

  15. nCrunch poor Test Performance and lost in "Analyse Assembly"

    hi, today, i tried to upload the requested logs of the last console run. not sure if it succeeded, but after submission, i was presented with a "sorry" response (page goes not exist). is the attachment size limited (zip is about 14MB)? i'll get back to your questions later- just let me know for now…

    13 Feb 2023 07:21 UTC

  16. nCrunch poor Test Performance and lost in "Analyse Assembly"

    hi, just an update: the tool is still running, which makes it roughly 24h now. i have no idea what its progress actually is or how long it will remain active. apparently the result files are created exclusively upon conclusion, so i have to wait until it has finished. or is there a chance to preter…

    10 Feb 2023 07:02 UTC

  17. nCrunch poor Test Performance and lost in "Analyse Assembly"

    ok, thanks, i keep the run going and update once it has been concluded...

    09 Feb 2023 07:33 UTC

  18. nCrunch poor Test Performance and lost in "Analyse Assembly"

    hi, i started a fresh run on a virgin release branch with no existing caching. to be on the safe side, i disabled parallel test execution as per configuration, using 4/4 cores/threads (the system exposes to have 4 physical an 8 logical cores). studio is also running (with NCrunch engine disabled), b…

    09 Feb 2023 07:15 UTC

  19. nCrunch poor Test Performance and lost in "Analyse Assembly"

    thanks for sharing more insights. let me comment some of your questions/suggestions: [i]It looks like the run on the console tool took about 3 hours. Most of this was spent processing a cluster of tailing tests with a long execution time. I note that the project build times looked to be bad bu…

    08 Feb 2023 09:19 UTC

  20. nCrunch poor Test Performance and lost in "Analyse Assembly"

    i sent the engine log via the proposed form. not sure if there are other logs existing, so let me know if there is anything else that i can deliver. regarding the "wall time"- not sure what this term is referring to exactly and i am not really able to assess the console tool performance right now…

    07 Feb 2023 12:05 UTC