Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Tests to execute on this machine when DoesNotHaveCategory still runs these test on the machine
Amir Kolsky
#1 Posted : Thursday, February 26, 2026 4:16:37 PM(UTC)
Rank: Member

Groups: Registered
Joined: 4/5/2021(UTC)
Posts: 12

((You really should allow pasting images directly into the posts like every modern forum system allows)

Note: Caches were deleted

Configuration ->
Filters ->
Tests to execute on this machine ->
TestFilterBuilder ->
When does not have category = Playwright.

(this is persistent - i can see it every time I open the configuration)

Here is the test header:

[TestCategory("Playwright")]
[TestMethod]
public async Task ShowsUrlAndPortWhenWebBasedSelected_Playwright()
{


SURPRISE! The test still runs.
Remco
#2 Posted : Thursday, February 26, 2026 10:54:08 PM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,528

Thanks: 1021 times
Was thanked: 1370 time(s) in 1271 post(s)
Amir Kolsky;18674 wrote:
((You really should allow pasting images directly into the posts like every modern forum system allows)


Sorry, I know it's annoying. The software of this forum is ancient and the image uploads were taken offline for security reasons. We get smashed by spammers here and I need to moderate actively to keep them under control.

Quote:
SURPRISE! The test still runs.


There's a couple of things that can cause this. Either the test category isn't being recognised by the engine, or the configuration setting isn't active.

The first thing I would check is to add the Test Category column to the Tests Window. You can right click on the column headers and turn it on. Check to see whether the test has the correct category assigned.

If you can submit a bug report after you've had this happen (through the NCrunch->Submit bug report menu), I can examine the report to see whether the configuration setting is being properly recognised.

However, I suspect that you may be using the wrong tool for this job. The configuration setting in question is actually designed for control of execution of tests on remote grid nodes. To prevent NCrunch from running specific tests, I recommend using the 'Ignore tests' buttons on the Tests Window.
Amir Kolsky
#3 Posted : Monday, March 2, 2026 12:44:36 AM(UTC)
Rank: Member

Groups: Registered
Joined: 4/5/2021(UTC)
Posts: 12

Oh, so the When does not have category = Playwright is only for remote execution? That is surprising. I have different kinds of tests that I want to disable, and I use test categories to categorize them. "Playwright" is just one example. Another example is "UITests". I also use "ReadDB", "RealOS", "Integration", and "Stress". Some tests have combinations of categories. I hoped the categories would allow me to switch engine modes and get only the subsets I want to run.

I'll submit the bug.
Amir Kolsky
#4 Posted : Monday, March 2, 2026 12:54:08 AM(UTC)
Rank: Member

Groups: Registered
Joined: 4/5/2021(UTC)
Posts: 12

<< Sorry, I know it's annoying. The software of this forum is ancient and the image uploads were taken offline for security reasons. We get smashed by spammers here and I need to moderate actively to keep them under control. >>

I feel you. I could suggest to allow image posting if the person has passed a certain threshold Rank, or has been around for long enough. Personally, I've been around almost from the start... Also, you could check if there's an active license...

Just saying it would be easier to get the point across with a screenshot.

Thanks man!
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.025 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download