Skip to content

Revert "Revert "Upgrade Ubuntu and Azure Linux VMs and Containers"" #62304

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Revert "Revert "Upgrade Ubuntu and Azure Linux VMs and Containers"" #62304

wants to merge 1 commit into from
+9 −6

Conversation

richlander
Copy link
Member

Reverts #62265

Re-enable new OS images.

@richlander richlander requested review from wtgodbe and a team as code owners June 10, 2025 22:34
@github-actions github-actions bot added the area-mvc Includes: MVC, Actions and Controllers, Localization, CORS, most templates label Jun 10, 2025
@build-analysis build-analysis bot mentioned this pull request Jun 11, 2025
Open
3 tasks
@richlander
Copy link
Member Author

The aspnetcore-helix-matrix pipeline ran clean.

https://dev.azure.com/dnceng-public/public/_build/results?buildId=1064551&view=results

@BrennanConroy
Copy link
Member

The AzureLinux machine on PRs is still borked.

@wtgodbe
Copy link
Member

wtgodbe commented Jun 16, 2025

We do get console logs now, at least. This is from the "failed" Mvc.FunctionalTests workitem:

2025-06-11T15:22:25.0320616Z Test Run Successful.
2025-06-11T15:22:25.0320724Z Total tests: 1589
2025-06-11T15:22:25.0320751Z Passed: 1584
2025-06-11T15:22:25.0320779Z Skipped: 5
2025-06-11T15:22:25.0430894Z Total time: 4.4919 Minutes

  • exit 0
    ['Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0' END OF WORK ITEM LOG: Command exited with 0]

Not sure why that's getting reported as a failure

@dotnet-policy-service dotnet-policy-service bot added the pending-ci-rerun When assigned to a PR indicates that the CI checks should be rerun label Jun 24, 2025
@richlander
Copy link
Member Author

/azp run

@dotnet-policy-service dotnet-policy-service bot removed the pending-ci-rerun When assigned to a PR indicates that the CI checks should be rerun label Jun 24, 2025
@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 3 pipeline(s).

@richlander
Copy link
Member Author

From the logs. The first doesn't look very OS specific. The second looks like it could be the VM.

2025-06-24T22:33:16.5064416Z [xUnit.net 00:00:19.87]         | [0.040s] Templates.Mvc.Test.WebApiTemplateTest Information: ==> /datadisks/disk1/work/AB9C09E3/p/dotnet-cli/dotnet new "web" --debug:disable-sdk-templates --debug:custom-hive "/datadisks/disk1/work/AB9C09E3/w/AB1409A8/e/Hives/.templateEngine" [/datadisks/disk1/work/AB9C09E3/w/AB1409A8/e/]
2025-06-24T22:33:16.5064472Z [xUnit.net 00:00:19.87]         | [0.715s] Templates.Mvc.Test.WebApiTemplateTest Information: Process exited.
2025-06-24T22:33:16.5122271Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] No templates or subcommands found matching: 'web'.
2025-06-24T22:33:16.5122329Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] 
2025-06-24T22:33:16.5122477Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] To list installed templates similar to 'web', run:
2025-06-24T22:33:16.5122521Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR]    dotnet new list web
2025-06-24T22:33:16.5122571Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] To search for the templates on NuGet.org, run:
2025-06-24T22:33:16.5122732Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR]    dotnet new search web
2025-06-24T22:33:16.5122770Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] 
2025-06-24T22:33:16.5122809Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] 
2025-06-24T22:33:16.5123077Z [xUnit.net 00:00:19.87]         | [1.259s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] For details on the exit code, refer to https://aka.ms/templating-exit-codes#103
2025-06-24T22:33:16.5123113Z [xUnit.net 00:00:19.87]         | [1.264s] Templates.Mvc.Test.WebApiTemplateTest Information: ==> /datadisks/disk1/work/AB9C09E3/p/dotnet-cli/dotnet new "webapp" --debug:disable-sdk-templates --debug:custom-hive "/datadisks/disk1/work/AB9C09E3/w/AB1409A8/e/Hives/.templateEngine" [/datadisks/disk1/work/AB9C09E3/w/AB1409A8/e/]
2025-06-24T22:33:16.5123352Z [xUnit.net 00:00:19.87]         | [1.478s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] No templates or subcommands found matching: 'webapp'.
2025-06-24T22:33:16.5123386Z [xUnit.net 00:00:19.87]         | [1.481s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] 
2025-06-24T22:33:16.5123421Z [xUnit.net 00:00:19.87]         | [1.481s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] To list installed templates similar to 'webapp', run:
2025-06-24T22:33:16.5151090Z [xUnit.net 00:00:19.87]         | [1.481s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR]    dotnet new list webapp
2025-06-24T22:33:16.5151200Z [xUnit.net 00:00:19.87]         | [1.481s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] To search for the templates on NuGet.org, run:
2025-06-24T22:33:16.6151750Z [xUnit.net 00:00:19.87]         | [1.481s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR]    dotnet new search webapp
2025-06-24T22:33:16.6151924Z [xUnit.net 00:00:19.87]         | [1.481s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] 
2025-06-24T22:33:16.6151962Z [xUnit.net 00:00:19.87]         | [1.483s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] 
2025-06-24T22:33:16.6151992Z [xUnit.net 00:00:19.87]         | [1.484s] Templates.Mvc.Test.WebApiTemplateTest Information: [ERROR] For details on the exit code, refer to https://aka.ms/templating-exit-codes#103

And

--- Logging error ---
Traceback (most recent call last):
  File "/usr/lib/python3.12/logging/__init__.py", line 1164, in emit
    self.flush()
  File "/usr/lib/python3.12/logging/__init__.py", line 1144, in flush
    self.stream.flush()
OSError: [Errno 28] No space left on device
Call stack:
  File "/datadisks/disk1/work/AB9C09E3/p/reporter/run.py", line 68, in <module>
    main()
  File "/datadisks/disk1/work/AB9C09E3/p/reporter/run.py", line 65, in main
    reporter.report_results(all_results)
  File "/etc/helix/scripts/helix/test_reporting/packing_test_reporter.py", line 30, in report_results
    self._log.info("Packing %d test reports to '%s'", len(results), path)
Message: "Packing %d test reports to '%s'"
Arguments: (963, '/datadisks/disk1/work/AB9C09E3/w/C3C70A88/e/__test_report.json')
2025-06-24T22:37:49.529Z	INFO   	run.py	packing_test_reporter(33)	report_results	Packed 344460 bytes
--- Logging error ---
Traceback (most recent call last):
  File "/usr/lib/python3.12/logging/handlers.py", line 73, in emit
    if self.shouldRollover(record):
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/logging/handlers.py", line 193, in shouldRollover
    pos = self.stream.tell()
          ^^^^^^^^^^^^^^^^^^
OSError: [Errno 28] No space left on device
Call stack:
  File "/datadisks/disk1/work/AB9C09E3/p/reporter/run.py", line 68, in <module>
    main()
  File "/datadisks/disk1/work/AB9C09E3/p/reporter/run.py", line 65, in main
    reporter.report_results(all_results)
  File "/etc/helix/scripts/helix/test_reporting/packing_test_reporter.py", line 33, in report_results
    self._log.info("Packed %d bytes", os.path.getsize(path))
Message: 'Packed %d bytes'
Arguments: (344460,)
+ exit 0
['Microsoft.AspNetCore.SignalR.Client.FunctionalTests--net10.0' END OF WORK ITEM LOG: Command exited with 0]

@BrennanConroy
Copy link
Member

The first doesn't look very OS specific.

The first one isn't a test error. It's normal expected output.

Like previous runs, the helix run seems to have passed but still shows as a failure in AzDo

2025-06-24T23:18:57.3937805Z Test Run Successful.
2025-06-24T23:18:57.3937904Z Total tests: 143
2025-06-24T23:18:57.3937936Z Passed: 131
2025-06-24T23:18:57.3937966Z Skipped: 12
2025-06-24T23:18:57.3971158Z Total time: 46.0182 Minutes
2025-06-24T23:18:57.4345435Z [dotnet test - 06/24/2025 23:18:57.434]No artifact found, post-processing won't run.
2025-06-24T23:18:57.4392110Z '/datadisks/disk1/work/AB9C09E3/p/dotnet-cli/dotnet test Templates.Mvc.Tests.dll --diag:/datadisks/disk1/work/AB9C09E3/w/AB1409A8/uploads/vstest.log --logger xunit --logger "console;verbosity=normal" --blame-crash --blame-hang-timeout 15m --filter "Quarantined!=true|Quarantined=false"' completed with exit code '0'
2025-06-24T23:18:57.4400523Z Running tests complete
2025-06-24T23:18:57.4400607Z Uploading test results
2025-06-24T23:18:57.4405241Z Trying to upload results...
2025-06-24T23:18:57.4405562Z Copying TestResults/TestResults.xml to ./testResults.xml
2025-06-24T23:18:57.4638197Z Copying artifacts/log/ to /datadisks/disk1/work/AB9C09E3/w/AB1409A8/uploads/
2025-06-24T23:18:57.4640984Z Copying TestResults/**/Sequence*.xml to /datadisks/disk1/work/AB9C09E3/w/AB1409A8/uploads/
2025-06-24T23:18:57.7475928Z Test results uploaded
2025-06-24T23:18:57.7476198Z Completed Helix job with exit code '0'
Finished tests...exit_code=0

@richlander
Copy link
Member Author

richlander commented Jun 25, 2025 •
edited
Loading

Thanks for the analysis. That suggests a problem on the helix side, somehow.

I assume the second one is a legit issue, however. Yes?

@meghnave

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wtgodbe wtgodbe Awaiting requested review from wtgodbe wtgodbe is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
area-mvc Includes: MVC, Actions and Controllers, Localization, CORS, most templates
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@richlander @BrennanConroy @wtgodbe