Forum member

jamesmanning

17 posts

Posts by jamesmanning

  1. data-driven xunit tests (Theory) expansion?

    oh, wow, I didn't even consider it being tied to the xunit version! I remember I had to downgrade from 2.0 to 1.9.2 for some other reason (unrelated to NCrunch), but now that I know it's fixed with xunit 2, I'm definitely going to fix the other issue so I can get the granular results! :) Thanks!…

    11 May 2015 22:42 UTC

  2. data-driven xunit tests (Theory) expansion?

    So it looks like the output in the main pane is due to me 'pinning' one of the failed (sub)tests at some point, so I guess that explains the output including every subtest run (although it'd still be nice to only see the subtest failures). I've uploaded a simple repro case to https://github.com/j…

    11 May 2015 22:11 UTC

  3. data-driven xunit tests (Theory) expansion?

    Just the one Theory test - I broken 2 of them here, but nothing in the output (except scrolling through the text output) indicates that 2 of the subtests failed AFAICT [img=http://i.imgur.com/XfNONcF.png]showing 1 failure for data-driven[/img]

    11 May 2015 21:58 UTC

  4. data-driven xunit tests (Theory) expansion?

    Good point - I'll put together a quick sample now. :) The original source I was hitting this on is in this repo if you want to clone it and see it yourself, but I'll make a quick solution showing just the issue as well. https://github.com/jamesmanning/FuzzyString/blob/64101fdbac2132e89aff708bb…

    11 May 2015 21:44 UTC

  5. data-driven xunit tests (Theory) expansion?

    Currently I have a data-driven unit test that with about 30 InlineData attributes. When I make a change that breaks some number of the tests, the NCrunch Tests window will show the test as failing, but it gives no indication as to the data-driven part of it. IOW, was it 1 failure out of 30? 30 out…

    11 May 2015 21:24 UTC

  6. Skip unnecessary costly build steps (code analysis / code contracts static checker) when possible

    I just got 'bit' by this - I can understand skipping the static contract checking, but I don't understand not supporting the runtime checking (especially when my project has CONTRACTS_FULL defined :). As it stands, NCrunch couldn't run my tests, just throwing up the same type of failure dialog from…

    24 May 2012 16:50 UTC

  7. acquihire?

    @rlarno - FWIW, Remco mentioned that possibility in a previous blog post (admittedly, 8 months ago) http://blog.ncrunch.net/post/The-Future-of-NCrunch.aspx One option I have been looking at is to eventually open-source the tool - as this may help many people to solve issues with having it work…

    22 May 2012 16:03 UTC

  8. nuget-installed ninject.extensions.factory fails under ncrunch

    actually, I would think (hope?) that the frameworks will all have a big change upcoming with pervasive async. MSTest has already started supporting it, but I'd imagine there will need to be more test framework support for things that orchestrate or start multiple async operations (Task or otherwise…

    22 May 2012 04:53 UTC

  9. nuget-installed ninject.extensions.factory fails under ncrunch

    awesome, thanks! It's probably a bad idea for lots of reasons, but just to throw it out there, I wondered if the first time during a given run (inside a given VS instance) you could run a 'fake' test in the framework being used (didn't do any asserts, just ran and sent you back some info) to tell…

    22 May 2012 03:27 UTC

  10. nuget-installed ninject.extensions.factory fails under ncrunch

    I was able to repro this with VS2010 as well - same behavior, and the BaseDirectory was C:\Users\james\AppData\Local\NCrunch\9348\1\TestResults\0b2a40ad-0fe7-4ed2-a106-35e581a0f819\Out R# isn't installed/running in my VS2010 NCrunch version (I just installed it) is 1.39.0.15b I even re-ran …

    21 May 2012 21:16 UTC

  11. nuget-installed ninject.extensions.factory fails under ncrunch

    This is VS11 Beta with the April update applied. The version from the cmdline says: [quote]Microsoft (R) Test Execution Command Line Tool Version 11.0.50214.1 Copyright (c) Microsoft Corporation. All rights reserved.[/quote] I'm able to repro the behavior starting 'from scratch' (a freshly s…

    21 May 2012 21:04 UTC

  12. nuget-installed ninject.extensions.factory fails under ncrunch

    [quote=Remco;1917][...] or by turning on the 'Copy Referenced Assemblies To Workspace' setting.[/quote] Unfortunately, I tried setting this (on both the unit test project and the class library project it's testing) but it still showed the same problem. After a bunch of debugging, the root caus…

    21 May 2012 14:10 UTC

  13. MSTest - NCrunch doesn't fail on multiple TestInitialize

    Not sure this is really worth fixing, but in my VS11 Beta, the built-in test runner and the R# tester runner both fail if there are multiple methods marked with TestInitialize: UTA018: [i]TestClassNameHere.TestMethodNameHere[/i]: Cannot define more than one method with the TestInitialize attribut…

    20 May 2012 22:17 UTC

  14. nuget-installed ninject.extensions.factory fails under ncrunch

    [i] Post #1,000 in this forum! :) [/i] I'm hitting the same issue as this SO thread from 5 days ago: http://stackoverflow.com/questions/10601098/ninject-tofactory-works-in-resharper-unit-tests-but-not-ncrunch Specifically, when run by NCrunch, my test has this exception: [quote] Ninje…

    20 May 2012 17:10 UTC

  15. gamification options?

    I'm having trouble finding the article I wanted to reference for this, so bear with me. :) ncrunch / continuous testing helps lower the mental barrier to running tests, but for people not used to TDD (or even testing), it's not a very 'engaging' experience. There's already been some areas of d…

    16 May 2012 03:09 UTC

  16. acquihire?

    not really any of my business, but to throw it out there: - for redgate, it'd potentially help Demon, so that's obvious - for other tools vendors (for instance, jetbrains), it could be a big help as an add-on The target that may be less obvious but IMHO is more viable is Microsoft. A decent …

    16 May 2012 02:38 UTC

  17. 'continuous build' output available for (Ctrl)F5?

    One of the features listed for redgate's .NET Demon is the 'continuous compilation' (admittedly, what Eclipse has had for ages for the Java stack), specifically that when you want to run your code, it's already been compiled. It seems like NCrunch doesn't currently support that, instead doing bui…

    08 May 2012 15:13 UTC