Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error
Extreme build speed regression in 2.17.0.16
Options
Previous Topic Next Topic
zibalas
#1 Posted : Wednesday, November 11, 2015 9:56:19 AM(UTC)
Rank: Newbie

Groups: Registered
Joined: 11/11/2015(UTC)
Posts: 3
Location: Germany
Did anybody else noticed an extreme build speed regression (not test execution) in the latest NCrunch version? I just did some rough testing and I've got following result:


Time needed to build and execute 3 test cases after modifying single line of code in test file (add new line)

NCrunch 2.16.0.13
~3 sec

NCrunch 2.17.0.16
~15 sec. ~13 sec in build phase


My Environment:
Visual Studio 2015
Solution Contains 37 projects, 15 of them are Test Projects (MS Test)
NCrunch Engine Mode: Run impacted tests
Back to top
 |  Edit by user
Remco
#2 Posted : Wednesday, November 11, 2015 12:19:36 PM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,123

Thanks: 957 times
Was thanked: 1287 time(s) in 1194 post(s)
Hi, thanks for sharing this issue.

You are the first person to report this problem, but that doesn't mean it isn't common.

Do you have any other solutions you can test the performance on? It would be very useful if we can identify whether there is something solution-specific that is surfacing the problem, or whether this is more general.

A 3sec to 15sec is a serious regression and is not intentional.
Back to top
zibalas
#3 Posted : Wednesday, November 11, 2015 12:51:44 PM(UTC)
Rank: Newbie

Groups: Registered
Joined: 11/11/2015(UTC)
Posts: 3
Location: Germany
Remco;7983 wrote:
Hi, thanks for sharing this issue.

You are the first person to report this problem, but that doesn't mean it isn't common.

Do you have any other solutions you can test the performance on? It would be very useful if we can identify whether there is something solution-specific that is surfacing the problem, or whether this is more general.

A 3sec to 15sec is a serious regression and is not intentional.


No, unfortunately I do not have a "test solution" that replicates the problem. I'll try cook something up, can't promise anything though.
Back to top
Remco
#4 Posted : Thursday, November 12, 2015 6:25:45 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,123

Thanks: 957 times
Was thanked: 1287 time(s) in 1194 post(s)
Back to top
zibalas
#5 Posted : Thursday, November 12, 2015 8:34:09 AM(UTC)
Rank: Newbie

Groups: Registered
Joined: 11/11/2015(UTC)
Posts: 3
Location: Germany
Remco;7989 wrote:
I'm wondering if you might be interested in trying this build:

http://downloads.ncrunch.net/NCrunch_Console_2.18.0.2.msi
http://downloads.ncrunch.net/NCrunch_Console_2.18.0.2.zip
http://downloads.ncrunch.net/NCrunch_GridNodeServer_2.18.0.2.msi
http://downloads.ncrunch.net/NCrunch_GridNodeServer_2.18.0.2.zip
http://downloads.ncrunch.net/NCrunch_LicenseServer_2.18.0.2.zip
http://downloads.ncrunch.net/NCrunch_VS2008_2.18.0.2.msi
http://downloads.ncrunch.net/NCrunch_VS2010_2.18.0.2.msi
http://downloads.ncrunch.net/NCrunch_VS2010_2.18.0.2.zip
http://downloads.ncrunch.net/NCrunch_VS2012_2.18.0.2.msi
http://downloads.ncrunch.net/NCrunch_VS2012_2.18.0.2.zip
http://downloads.ncrunch.net/NCrunch_VS2013_2.18.0.2.msi
http://downloads.ncrunch.net/NCrunch_VS2013_2.18.0.2.zip
http://downloads.ncrunch.net/NCrunch_VS2015_2.18.0.2.msi
http://downloads.ncrunch.net/NCrunch_VS2015_2.18.0.2.zip

The 2.17 release contained a change that disabled shared compiler usage during build. Early (pre-release) versions of VS2015 had some stability problems with this feature, and it didn't seem to be needed for NCrunch, so the sensible thing seemed to be to turn it off. Some tests recently done on my side suggest that this seems to have had an impact on build speed. I've re-enabled shared compiler usage for the above build, so I'd be interested in hearing how it goes for you.


Yep, this helps, 2.18.0.2 works great!
Back to top
Remco
#6 Posted : Thursday, November 12, 2015 9:44:08 AM(UTC)
Rank: NCrunch Developer

Groups: Administrators
Joined: 4/16/2011(UTC)
Posts: 7,123

Thanks: 957 times
Was thanked: 1287 time(s) in 1194 post(s)
zibalas;7991 wrote:

Yep, this helps, 2.18.0.2 works great!


Great, thanks! I'll see what I can do about getting this build to the download page.
Back to top
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

YAF | YAF © 2003-2011, Yet Another Forum.NET
This page was generated in 0.060 seconds.
Trial NCrunch
Take NCrunch for a spin
Do your fingers a favour and supercharge your testing workflow
Free Download