Skip to content

Speed up slowest acceptance tests and add --no-build consistently #15471

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nohwnd wants to merge 3 commits into from

Add --no-restore to all InvokeDotnetTest calls

bd6ef25
Select commit
Loading
Failed to load commit list.
Closed

Speed up slowest acceptance tests and add --no-build consistently #15471

Add --no-restore to all InvokeDotnetTest calls
bd6ef25
Select commit
Loading
Failed to load commit list.
Azure Pipelines / microsoft.vstest failed Mar 10, 2026 in 54m 6s

Build #20260310.6 had test failures

3 errors / 1 warnings

Details

Tests

  • Failed: 7 (0.09%)
  • Passed: 7,447 (98.06%)
  • Other: 140 (1.84%)
  • Total: 7,594

Annotations

Check failure on line 0 in EXEC

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.vstest

EXEC#L0 

EXEC(0,0): error : (NETCORE_ENGINEERING_TELEMETRY=Build)

Check failure on line 0 in EXEC

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.vstest

EXEC#L0 

EXEC(0,0): error : (NETCORE_ENGINEERING_TELEMETRY=Build)

Check failure on line 0 in Microsoft.Testing.Platform

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.vstest

Microsoft.Testing.Platform#L0 

Microsoft.Testing.Platform(0,0): error : (NETCORE_ENGINEERING_TELEMETRY=Build) Tests failed: D:\a\_work\1\s\artifacts\log\Release\Microsoft.TestPlatform.Acceptance.IntegrationTests_net9.0_x64.log [net9.0|x64]

Check failure on line 1 in Microsoft.TestPlatform.AcceptanceTests.DotnetTestMSBuildOutputTests.MSBuildLoggerCanBeEnabledByBuildPropertyAndDoesNotEatSpecialChars (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.vstest

Microsoft.TestPlatform.AcceptanceTests.DotnetTestMSBuildOutputTests.MSBuildLoggerCanBeEnabledByBuildPropertyAndDoesNotEatSpecialChars (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess) 

Assert.IsTrue failed. 'condition' expression: '_standardTestOutput.Contains(substring)'. 
StdOutput:

Expected substring: TESTERROR

Actual string: \u001b]9;4;3;\u001b\\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F TerminalLoggerTestProject \u001b[?25h\u001b[?25l\u001b[2F \u001b[KTerminalLoggerTestProject \u001b[?25h\u001b[?25l\u001b[2F \u001b[J\u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F TerminalLoggerTestProject \u001b[36;1mnet8.0\u001b[m \u001b[120G\u001b[57DShowInfoMessageIfProjectHasNoIsTestProjectProperty (0.0s) \u001b[?25h\u001b[?25l\u001b[2F \u001b[120G\u001b[6D(0.0s) \u001b[?25h\u001b[2F \u001b[J\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F \u001b[?25h\u001b[?25l\u001b[1F TerminalLoggerTestProject \u001b[36;1mnet48\u001b[m \u001b[120G\u001b[57D
Raw output 
   at Microsoft.TestPlatform.TestUtilities.IntegrationTestBase.StdOutputContains(String substring) in /_/test/Microsoft.TestPlatform.TestUtilities/IntegrationTestBase.cs:line 475
   at Microsoft.TestPlatform.AcceptanceTests.DotnetTestMSBuildOutputTests.MSBuildLoggerCanBeEnabledByBuildPropertyAndDoesNotEatSpecialChars(RunnerInfo runnerInfo) in /_/test/Microsoft.TestPlatform.Acceptance.IntegrationTests/DotnetTestMSBuildOutputTests.cs:line 38
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr)

Check failure on line 1 in Microsoft.TestPlatform.AcceptanceTests.DotnetTestMSBuildOutputTests.MSBuildLoggerCanBeDisabledByBuildProperty (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.vstest

Microsoft.TestPlatform.AcceptanceTests.DotnetTestMSBuildOutputTests.MSBuildLoggerCanBeDisabledByBuildProperty (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess) 

Assert.IsTrue failed. 'condition' expression: '_standardTestOutput.Contains(substring)'. 
StdOutput:

Expected substring: Failed! - Failed: 1, Passed: 1, Skipped: 1, Total: 3, Duration:

Actual string:
Raw output 
   at Microsoft.TestPlatform.TestUtilities.IntegrationTestBase.StdOutputContains(String substring) in /_/test/Microsoft.TestPlatform.TestUtilities/IntegrationTestBase.cs:line 475
   at Microsoft.TestPlatform.AcceptanceTests.DotnetTestMSBuildOutputTests.MSBuildLoggerCanBeDisabledByBuildProperty(RunnerInfo runnerInfo) in /_/test/Microsoft.TestPlatform.Acceptance.IntegrationTests/DotnetTestMSBuildOutputTests.cs:line 60
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr)

Check failure on line 1 in Microsoft.TestPlatform.AcceptanceTests.DotnetTestTests.RunDotnetTestWithCsproj (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.vstest

Microsoft.TestPlatform.AcceptanceTests.DotnetTestTests.RunDotnetTestWithCsproj (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess) 

Assert.IsTrue failed. 'condition' expression: '_standardTestOutput.Contains(substring)'. 
StdOutput:

Expected substring: 18.6.0-ci

Actual string:
Raw output 
   at Microsoft.TestPlatform.TestUtilities.IntegrationTestBase.StdOutputContains(String substring) in /_/test/Microsoft.TestPlatform.TestUtilities/IntegrationTestBase.cs:line 475
   at Microsoft.TestPlatform.AcceptanceTests.DotnetTestTests.RunDotnetTestWithCsproj(RunnerInfo runnerInfo) in /_/test/Microsoft.TestPlatform.Acceptance.IntegrationTests/DotnetTestTests.cs:line 33
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr)

Check failure on line 1 in Microsoft.TestPlatform.AcceptanceTests.DotnetTestTests.RunDotnetTestWithCsprojPassInlineSettings (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.vstest

Microsoft.TestPlatform.AcceptanceTests.DotnetTestTests.RunDotnetTestWithCsprojPassInlineSettings (Row: 0, Runner = net10.0, TargetFramework = net8.0, InProcess) 

Assert.IsTrue failed. 'condition' expression: '_standardTestOutput.Contains(substring)'. 
StdOutput:

Expected substring: 18.6.0-ci

Actual string:
Raw output 
   at Microsoft.TestPlatform.TestUtilities.IntegrationTestBase.StdOutputContains(String substring) in /_/test/Microsoft.TestPlatform.TestUtilities/IntegrationTestBase.cs:line 475
   at Microsoft.TestPlatform.AcceptanceTests.DotnetTestTests.RunDotnetTestWithCsprojPassInlineSettings(RunnerInfo runnerInfo) in /_/test/Microsoft.TestPlatform.Acceptance.IntegrationTests/DotnetTestTests.cs:line 67
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr)
View more details on Azure Pipelines