xamarin-macios
xamarin-macios copied to clipboard
xamarin
[CI] Start moving to parse the configuration of the build in the tests pipelines
At the moment we are recaculating the configuration that was used in the build to decide which tests to run, that is not needed since the configuration was uploaded to the artifacts.
This change will allow to do the following:
- Load the default variables on the build pipeline this will allow us to set the name of the tests to match those of the build for easy parsing.
- Load the default variables to set the property comment in the PR.
- Do not recalculate the built platforms on the tests matrix.
- Do not calculate the API scan matrix, it is not needed for the tests.
:fire: Failed to compare API and create generator diff :fire:
Error: 'make' failed for the hash 477a708f198c66de4c8785cd41e583eed91c0569.
Pipeline on Agent Hash: 97a55873ff41ce6f940405790af7c320aa40c4fe [PR build]
:books: [CI Build] Artifacts :books:
Packages generated
View packages
Pipeline on Agent Hash: [PR build]
:books: [CI Build] Artifacts :books:
Packages generated
View packages
Pipeline on Agent Hash: [PR build]
:white_check_mark: API diff for current PR / commit
Legacy Xamarin (No breaking changes)
- ~iOS~ (no change detected)
- ~tvOS~ (no change detected)
- ~watchOS~ (no change detected)
- ~macOS~ (no change detected)
NET (empty diffs)
- ~iOS~: (empty diff detected)
- ~tvOS~: (empty diff detected)
- ~MacCatalyst~: (empty diff detected)
- ~macOS~: (empty diff detected)
:white_check_mark: API diff vs stable
Legacy Xamarin (No breaking changes)
.NET (No breaking changes)
:information_source: Generator diff
Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)
Pipeline on Agent Hash: ecf8441e660f1978f5c6ca8b33ec4e5ac45f1f88 [PR build]
:white_check_mark: API diff for current PR / commit
Legacy Xamarin (No breaking changes)
.NET (No breaking changes)
:white_check_mark: API diff vs stable
Legacy Xamarin (No breaking changes)
.NET (No breaking changes)
:information_source: Generator diff
Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)
Pipeline on Agent Hash: c6c7f072fad7cf7b97b4b4c9cbbe364faa9d96e5 [PR build]
:books: [CI Build] Artifacts :books:
Packages generated
View packages
Pipeline on Agent Hash: [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Ventura (13) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Ventura (13) passed.
Pipeline on Agent Hash: c6c7f072fad7cf7b97b4b4c9cbbe364faa9d96e5 [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Big Sur (11) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Big Sur (11) passed.
Pipeline on Agent Hash: c6c7f072fad7cf7b97b4b4c9cbbe364faa9d96e5 [PR build]
:computer: [CI Build] Tests on macOS X64 - Mac Sonoma (14) passed :computer:
:white_check_mark: All tests on macOS X64 - Mac Sonoma (14) passed.
Pipeline on Agent Hash: c6c7f072fad7cf7b97b4b4c9cbbe364faa9d96e5 [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Monterey (12) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Monterey (12) passed.
Pipeline on Agent Hash: c6c7f072fad7cf7b97b4b4c9cbbe364faa9d96e5 [PR build]
:x: [CI Build] Windows Integration Tests failed :x:
:x: Failed :x:
Pipeline on Agent Hash: c6c7f072fad7cf7b97b4b4c9cbbe364faa9d96e5 [PR build]
:fire: [CI Build] Test results :fire:
Test results
:x: Tests failed on VSTS: test results
0 tests crashed, 1 tests failed, 167 tests passed.
Failures
:x: dotnettests tests (iOS)
- DotNet tests: Failed (Execution failed with exit code 1)
Html Report (VSDrops) Download
Successes
:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 6 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 65 tests passed. Html Report (VSDrops) Download :white_check_mark: mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: mmp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mononative: All 6 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (iOS): All 11 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (watchOS): All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mtouch: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: xammac: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xcframework: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: xtro: All 2 tests passed. Html Report (VSDrops) Download
Pipeline on Agent Hash: c6c7f072fad7cf7b97b4b4c9cbbe364faa9d96e5 [PR build]
:fire: [CI Build] Build failed :fire:
Build failed for the job 'Detect API changes'
Pipeline on Agent Hash: e49a99e587adebd3c0093d83af98ce9422c302d2 [PR build]
:computer: [CI Build] Tests on macOS X64 - Mac Sonoma (14) passed :computer:
:white_check_mark: All tests on macOS X64 - Mac Sonoma (14) passed.
Pipeline on Agent Hash: e49a99e587adebd3c0093d83af98ce9422c302d2 [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Big Sur (11) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Big Sur (11) passed.
Pipeline on Agent Hash: e49a99e587adebd3c0093d83af98ce9422c302d2 [PR build]
:books: [CI Build] Artifacts :books:
Packages generated
View packages
Pipeline on Agent Hash: [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Monterey (12) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Monterey (12) passed.
Pipeline on Agent Hash: e49a99e587adebd3c0093d83af98ce9422c302d2 [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Ventura (13) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Ventura (13) passed.
Pipeline on Agent Hash: e49a99e587adebd3c0093d83af98ce9422c302d2 [PR build]
:x: [CI Build] Windows Integration Tests failed :x:
:x: Failed :x:
Pipeline on Agent Hash: e49a99e587adebd3c0093d83af98ce9422c302d2 [PR build]
:fire: [CI Build] Test results :fire:
Test results
:x: Tests failed on VSTS: test results
8 tests crashed, 2 tests failed, 122 tests passed.
Failures
:x: dotnettests tests (macOS)
- DotNet tests: Failed (Execution failed with exit code 1)
Html Report (VSDrops) Download
:x: dotnettests tests (tvOS)
- DotNet tests: Failed (Execution failed with exit code 1)
Html Report (VSDrops) Download
:x: monotouch tests (MacCatalyst)
:fire: Failed catastrophically on VSTS: test results - monotouch_maccatalyst (no summary found).
Html Report (VSDrops) Download
:x: monotouch tests (macOS)
:fire: Failed catastrophically on VSTS: test results - monotouch_macos (no summary found).
Html Report (VSDrops) Download
:x: monotouch tests (tvOS)
:fire: Failed catastrophically on VSTS: test results - monotouch_tvos (no summary found).
Html Report (VSDrops) Download
:x: monotouch tests (watchOS)
:fire: Failed catastrophically on VSTS: test results - monotouch_watchos (no summary found).
Html Report (VSDrops) Download
:x: mtouch tests
:fire: Failed catastrophically on VSTS: test results - mtouch (no summary found).
Html Report (VSDrops) Download
:x: xammac tests
:fire: Failed catastrophically on VSTS: test results - xammac (no summary found).
Html Report (VSDrops) Download
:x: xcframework tests
:fire: Failed catastrophically on VSTS: test results - xcframework (no summary found).
Html Report (VSDrops) Download
:x: xtro tests
:fire: Failed catastrophically on VSTS: test results - xtro (no summary found).
Html Report (VSDrops) Download
Successes
:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 6 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 65 tests passed. Html Report (VSDrops) Download :white_check_mark: mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: mmp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mononative: All 6 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (iOS): All 11 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download
Pipeline on Agent Hash: e49a99e587adebd3c0093d83af98ce9422c302d2 [PR build]
:books: [CI Build] Artifacts :books:
Packages generated
View packages
Pipeline on Agent Hash: [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Ventura (13) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Ventura (13) passed.
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:white_check_mark: API diff for current PR / commit
NET (empty diffs)
- ~iOS~: (empty diff detected)
- ~tvOS~: (empty diff detected)
- ~MacCatalyst~: (empty diff detected)
- ~macOS~: (empty diff detected)
:white_check_mark: API diff vs stable
.NET (No breaking changes)
:information_source: Generator diff
Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Big Sur (11) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Big Sur (11) passed.
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:computer: [CI Build] Tests on macOS M1 - Mac Monterey (12) passed :computer:
:white_check_mark: All tests on macOS M1 - Mac Monterey (12) passed.
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:computer: [CI Build] Tests on macOS X64 - Mac Sonoma (14) passed :computer:
:white_check_mark: All tests on macOS X64 - Mac Sonoma (14) passed.
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:fire: [CI Build] Test results :fire:
Test results
:x: Tests failed on VSTS: test results
0 tests crashed, 1 tests failed, 97 tests passed.
Failures
:x: dotnettests tests (MacCatalyst)
- DotNet tests: Failed (Execution failed with exit code 1)
Html Report (VSDrops) Download
Successes
:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 40 tests passed. Html Report (VSDrops) Download :warning: mac-binding-project: No tests selected. Html Report (VSDrops) Download :warning: mmp: No tests selected. Html Report (VSDrops) Download :warning: mononative: No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch (iOS): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (tvOS): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download :warning: mtouch: No tests selected. Html Report (VSDrops) Download :warning: xammac: No tests selected. Html Report (VSDrops) Download :white_check_mark: xcframework: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: xtro: All 1 tests passed. Html Report (VSDrops) Download
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:x: [CI Build] Windows Integration Tests failed :x:
:x: Failed :x:
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:fire: [CI Build] Test results :fire:
Test results
:x: Tests failed on VSTS: test results
0 tests crashed, 1 tests failed, 97 tests passed.
Failures
:x: dotnettests tests (MacCatalyst) [attempt 2]
- DotNet tests: Failed (Execution failed with exit code 1)
Html Report (VSDrops) Download
Successes
:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 40 tests passed. Html Report (VSDrops) Download :warning: mac-binding-project: No tests selected. Html Report (VSDrops) Download :warning: mmp: No tests selected. Html Report (VSDrops) Download :warning: mononative: No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch (iOS): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (tvOS): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download :warning: mtouch: No tests selected. Html Report (VSDrops) Download :warning: xammac: No tests selected. Html Report (VSDrops) Download :white_check_mark: xcframework: All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: xtro: All 1 tests passed. Html Report (VSDrops) Download
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]
:x: [CI Build] Windows Integration Tests failed :x:
:x: Failed :x:
Pipeline on Agent Hash: bf46ecedfe800e538379128cd38656c8f38768b7 [PR build]