Skip to content

[tests] Update the bgen tests.#25067

Draft
rolfbjarne wants to merge 14 commits intomainfrom
dev/rolf/copilot/fix-bgen-nunit4-build
Draft

[tests] Update the bgen tests.#25067
rolfbjarne wants to merge 14 commits intomainfrom
dev/rolf/copilot/fix-bgen-nunit4-build

Conversation

@rolfbjarne
Copy link
Copy Markdown
Member

  • Enable nullability and fix any issues.
  • Upgrade to NUnit v4.
  • Move code from tests/generator to tests/bgen to have everything in the same directory.

rolfbjarne and others added 10 commits March 30, 2026 17:42
- Logger.cs: Add = null! to event list properties initialized in
  Initialize(), make Parameters nullable to match ILogger interface,
  add null coalescing for Message properties
- TestBase.cs: Make engine/paths fields nullable (they're reset to null
  in SetUp), add = null! to ProjectPaths properties
- TestEngine.cs: Make GetRegisteredTaskObject/UnregisterTaskObject
  return object? to match IBuildEngine4 interface
- AssemblySetup.cs: Add ?? string.Empty for Path.GetDirectoryName
  which returns string?

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
- Add = null! to test properties initialized in Setup (Plist, CompiledPlist, Task)
- Use ?. for nullable Get<T>() return values in assertion chains
- Use ?? throw for PDictionary.FromFile which returns nullable
- Use ! for Task.AppManifest/CompiledAppManifest (set in ConfigureTask, non-null at runtime)
- Change PArray to PArray? for TryGetValue out parameter in iOS tests
- Use ?.Method() == true pattern for nullable PArray.Any() calls

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…acDev.Tests

Add #nullable enable to shared files tests/common/Tool.cs and
tests/common/mac/ProjectTestHelpers.cs. Fix all nullable warnings in
these files and in project-only files MSBuildProject.cs, TestBase.cs,
DetectSigningIdentityTests.cs, and TargetTests.cs. Also fix the
downstream BGenTool.cs which was affected by EnvironmentVariables
becoming nullable.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Fix CS8600/CS8601/CS8602/CS8603/CS8604/CS8625 errors across 7 test files:
- ACToolTaskTest: Use null-conditional on PartialAppManifest
- BGenTaskTest: Suppress CS8625 for deliberate null test
- CollectITunesArtworkTaskTests: Handle nullable Path.GetDirectoryName
- GetPropertyListValueTaskTests: Make expected parameter nullable
- LocalizationStringTest: Handle nullable reflection/XML APIs
- MergeAppBundleTaskTest: Nullable dict values, params, GetDirectoryName
- PropertyListEditorTaskTests: Nullable params, explicit PString, null guards

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…ull env var

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
* Enable nullability and fix any issues.
* Upgrade to NUnit v4.
* Move code from tests/generator to tests/bgen to have everything in the same directory.
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR modernizes and consolidates the binding generator (bgen) test suite by moving the former tests/generator tests into tests/bgen, enabling nullable reference types for the test project, and updating assertions/packages to align with the NUnit v4 upgrade.

Changes:

  • Removed the legacy tests/generator test harness and consolidated tests under tests/bgen.
  • Enabled nullable reference types for tests/bgen and updated code to compile cleanly under nullable analysis.
  • Added/relocated a large set of bgen API-definition test input files under tests/bgen/tests/ (plus related expected XML docs artifacts).

Reviewed changes

Copilot reviewed 18 out of 167 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
tests/generator/Makefile Removed legacy generator test make targets in favor of tests/bgen.
tests/generator/generator-tests.csproj Removed legacy generator test project (migrated to tests/bgen).
tests/generator/.gitignore Removed legacy generator-test ignore list (directory no longer used).
tests/common/Tool.cs Nullable-related updates to tool output parsing and NUnit assertion style updates.
tests/bgen/Asserts.cs New Cecil-based helper for asserting generated IL doesn’t contain throws.
tests/bgen/AttributeFactoryTests.cs Updated assertions to NUnit constraint model under the NUnit v4 upgrade.
tests/bgen/bgen-tests.csproj Enabled nullable, switched NUnit/Test SDK versions to repo properties, and excluded tests/** input files from compilation.
tests/bgen/BGenBase.cs Updated pathing to read API definition inputs from tests/bgen/tests.
tests/bgen/BGenTool.cs Updated pathing to tests/bgen/tests and modernized a few assertions.
tests/bgen/CollectionsExtensionsTests.cs Updated assertions to NUnit constraint model.
tests/bgen/ConstructorArgumentsTests.cs Updated assertions to NUnit constraint model.
tests/bgen/GeneratorTests.cs Added a response-file execution test for bgen.
tests/bgen/ErrorTests.cs Updated test inputs to come from tests/bgen/tests instead of tests/generator.
tests/bgen/NomenclatorTests.cs Nullable-related refactor + NUnit constraint assertion updates.
tests/bgen/NullabilityContextTests.cs NUnit constraint assertion updates; retains nullability-related reflection checks.
tests/bgen/PlatformNameExtensionsTests.cs Updated assertions to NUnit constraint model.
tests/bgen/ProtocolTests.cs Updated API definition path references after moving files.
tests/bgen/ReflectionTest.cs Updated assertions; still provides reflection helpers for other tests.
tests/bgen/StringExtensionTests.cs Updated assertions to NUnit constraint model.
tests/bgen/README.md Added brief documentation on adding new bgen tests.
tests/bgen/sof20696157.sh Added helper script used to generate sof20696157.cs test input.
tests/bgen/tests/abstract-type.cs Added bgen API-definition input for abstract type binding scenario.
tests/bgen/tests/arrayfromhandlebug.cs Added API-definition input reproducing array-from-handle scenario.
tests/bgen/tests/attributes-from-inlined-protocols.cs Added API-definition input for attribute propagation from inlined protocols.
tests/bgen/tests/availability-attributes.cs Added API-definition input covering various availability attribute combinations.
tests/bgen/tests/backingfieldtype.cs Added API-definition input covering [BackingFieldType] handling.
tests/bgen/tests/bi1036.cs Added API-definition input for BI1036 regression test.
tests/bgen/tests/bi1042.cs Added API-definition input for BI1042 regression test.
tests/bgen/tests/bi1046.cs Added API-definition input for BI1046 regression test.
tests/bgen/tests/bi1059.cs Added API-definition input for BI1059 regression test (duplicate attributes).
tests/bgen/tests/bi1077.cs Added API-definition input for BI1077 regression test.
tests/bgen/tests/bindas1048error.cs Added API-definition input for BindAs 1048 error case.
tests/bgen/tests/bindas1049error.cs Added API-definition input for BindAs 1049 error case.
tests/bgen/tests/bindas1050modelerror.cs Added API-definition input for BindAs 1050 model error case.
tests/bgen/tests/bindas1050protocolerror.cs Added API-definition input for BindAs 1050 protocol error case.
tests/bgen/tests/bindastests.cs Added API-definition input covering BindAs mapping scenarios.
tests/bgen/tests/bmac_smoke.cs Added API-definition input for bmac smoke scenario.
tests/bgen/tests/bmac-with-hyphen-in-name.cs Added API-definition input for bmac project name with hyphen scenario.
tests/bgen/tests/both-protected-and-internal.cs Added API-definition input for invalid protected+internal combination scenario.
tests/bgen/tests/btouch-with-hyphen-in-name.cs Added API-definition input for btouch/bgen name-with-hyphen scenario.
tests/bgen/tests/bug15283.cs Added API-definition input reproducing Bug 15283 block binding scenario.
tests/bgen/tests/bug15307.cs Added API-definition input reproducing Bug 15307 protocol conformance scenario.
tests/bgen/tests/bug15799.cs Added API-definition input reproducing Bug 15799 protocol I-prefix usage scenario.
tests/bgen/tests/bug16036.cs Added API-definition input reproducing Bug 16036 async+static scenario.
tests/bgen/tests/bug17232.cs Added API-definition input reproducing Bug 17232 field library-name mapping scenario.
tests/bgen/tests/bug18025.cs Added API-definition input reproducing Bug 18025 availability scenario.
tests/bgen/tests/bug23041.cs Added API-definition input reproducing Bug 23041 model/base-type scenario.
tests/bgen/tests/bug24078-ignore-methods-events.cs Added API-definition input for IgnoredInDelegate event generation scenario.
tests/bgen/tests/bug27428.cs Added API-definition input reproducing Bug 27428 namespace scenario.
tests/bgen/tests/bug27430.cs Added API-definition input reproducing Bug 27430 keyword/escaping scenarios.
tests/bgen/tests/bug27986.cs Added API-definition input reproducing Bug 27986 Preserve attribute propagation scenario.
tests/bgen/tests/bug29493.cs Added API-definition input reproducing Bug 29493 category collision scenario.
tests/bgen/tests/bug31788.cs Added API-definition input reproducing Bug 31788 marshal exceptions on property accessors scenario.
tests/bgen/tests/bug34042.cs Added API-definition input reproducing Bug 34042 cross-namespace base type scenario.
tests/bgen/tests/bug35176.cs Added API-definition input reproducing Bug 35176 availability-in-protocol scenario.
tests/bgen/tests/bug36457.cs Added API-definition input reproducing Bug 36457 delegate property scenario.
tests/bgen/tests/bug37527-missing-property.cs Added API-definition input reproducing Bug 37527 missing delegate property scenario.
tests/bgen/tests/bug37527-wrong-property.cs Added API-definition input reproducing Bug 37527 wrong delegate property naming scenario.
tests/bgen/tests/bug39614.cs Added API-definition input reproducing Bug 39614 generic type scenario.
tests/bgen/tests/bug40282.cs Added API-definition input reproducing Bug 40282 internal model/protocol scenario.
tests/bgen/tests/bug42742.cs Added API-definition input reproducing Bug 42742 Advice attribute propagation scenario.
tests/bgen/tests/bug42855.cs Added API-definition input reproducing Bug 42855 protocol+model warning scenario.
tests/bgen/tests/bug43579.cs Added API-definition input reproducing Bug 43579 delegate/event generation scenario.
tests/bgen/tests/bug46292.cs Added API-definition input reproducing Bug 46292 obsolete propagation scenario.
tests/bgen/tests/bug52570allowstaticmembers.cs Added API-definition input reproducing Bug 52570 allowStaticMembers scenario.
tests/bgen/tests/bug52570classinternal.cs Added API-definition input reproducing Bug 52570 internal category scenario.
tests/bgen/tests/bug52570methodinternal.cs Added API-definition input reproducing Bug 52570 internal method scenario.
tests/bgen/tests/bug53076.cs Added API-definition input reproducing Bug 53076 async wrappers in protocols scenario.
tests/bgen/tests/bug53076withmodel.cs Added API-definition input reproducing Bug 53076 with model scenario.
tests/bgen/tests/bug57531.cs Added API-definition input reproducing Bug 57531 async category method overload scenario.
tests/bgen/tests/bug57870.cs Added API-definition input reproducing Bug 57870 smart-enum wrap combinations scenario.
tests/bgen/tests/classNameCollision-enum.cs Added API-definition input for class name collision helper type.
tests/bgen/tests/classNameCollision.cs Added API-definition input reproducing class name collision scenario.
tests/bgen/tests/csharp10syntax.cs Added API-definition input ensuring bgen handles newer C# syntax (global using / file-scoped namespace).
tests/bgen/tests/delegate-nullable-return.cs Added API-definition input for delegate nullability attributes.
tests/bgen/tests/delegate-parameter-attributes.cs Added API-definition input for delegate-parameter attribute handling in protocols.
tests/bgen/tests/delegate-types.cs Added API-definition input for unsafe delegate signatures.
tests/bgen/tests/delegate-with-inativeobject-return-type.cs Added API-definition input for delegates returning native objects.
tests/bgen/tests/designated-initializer-issue-10106.cs Added API-definition input for designated initializer handling.
tests/bgen/tests/desk63279A.cs Added placeholder API-definition input for multi-file test scenario.
tests/bgen/tests/desk63279B.cs Added placeholder API-definition input for multi-file test scenario.
tests/bgen/tests/desk79124.cs Added API-definition input reproducing Desk79124 appearance scenario.
tests/bgen/tests/diamond-protocol.cs Added API-definition input for diamond protocol inlining scenario.
tests/bgen/tests/diamond-protocol-errors.cs Added API-definition input for diamond protocol error cases.
tests/bgen/tests/dispose-attribute.cs Added API-definition input for [Dispose] snippet generation/optimizable behavior.
tests/bgen/tests/editor-browsable.cs Added API-definition input for EditorBrowsable propagation scenarios.
tests/bgen/tests/errordomain.cs Added API-definition input for [ErrorDomain] with LibraryName.
tests/bgen/tests/errordomain-nolibraryname.cs Added API-definition input for [ErrorDomain] missing LibraryName error case.
tests/bgen/tests/ExpectedXmlDocs.tvOS.legacy.xml Added/updated expected XML docs output (tvOS legacy).
tests/bgen/tests/fieldenumtests.cs Added API-definition input for enum field backing type handling.
tests/bgen/tests/forcedtype.cs Added API-definition input for [ForcedType] behavior.
tests/bgen/tests/forum54078.cs Added API-definition input for forum54078 NSCoding ctor generation scenario.
tests/bgen/tests/generated-attribute-on-property-accessors.cs Added API-definition input for generated availability attributes on accessors.
tests/bgen/tests/generated-attribute-on-property-accessors2.cs Added API-definition input for generated attributes with per-accessor availability.
tests/bgen/tests/generic-strong-dictionary.cs Added API-definition input for generic NSDictionary strong dictionary generation.
tests/bgen/tests/generic-type-nsobject.cs Added API-definition input for generic constraints involving NSObject.
tests/bgen/tests/ghissue18645.cs Added API-definition input reproducing GH issue 18645 new-member hiding scenario.
tests/bgen/tests/ghissue3869.cs Added API-definition input reproducing GH issue 3869 delegate wrap ordering scenario.
tests/bgen/tests/ghissue5416a.cs Added API-definition input reproducing GH issue 5416 accessor nullability warnings scenario.
tests/bgen/tests/ghissue5416b.cs Added API-definition input reproducing GH issue 5416 method nullability warnings scenario.
tests/bgen/tests/ghissue5444.cs Added API-definition input reproducing GH issue 5444 wrap + new members scenario.
tests/bgen/tests/ghissue5692.cs Added API-definition input reproducing GH issue 5692 handler delegate scenario.
tests/bgen/tests/ghissue6626.cs Added API-definition input reproducing GH issue 6626 render-block delegate scenario.
tests/bgen/tests/ghissue6863_method.cs Added API-definition input reproducing GH issue 6863 BindAs parameter array mismatch.
tests/bgen/tests/ghissue6863_property.cs Added API-definition input reproducing GH issue 6863 BindAs property array mismatch.
tests/bgen/tests/ghissue7304.cs Added API-definition input reproducing GH issue 7304 internal wrap cast scenario.
tests/bgen/tests/ghissue9065.cs Added API-definition input reproducing GH issue 9065 static member in sealed class scenario.
tests/bgen/tests/ignore-unavailable-protocol.cs Added API-definition input for ignoring unavailable protocol conformance scenario.
tests/bgen/tests/inativeobject-arrays-in-blocks.cs Added API-definition input for INativeObject arrays in blocks scenario.
tests/bgen/tests/inativeobjects-in-blocks.cs Added API-definition input for INativeObject in nested block callback scenario.
tests/bgen/tests/inativeobjects-in-blocks-sources.cs Added supporting source type for INativeObject-in-block tests.
tests/bgen/tests/internal-delegate.cs Added API-definition input for internal delegate binding behavior.
tests/bgen/tests/is-direct-binding.cs Added API-definition input for IsDirectBinding generation behavior.
tests/bgen/tests/issue19612.cs Added API-definition input reproducing Issue 19612 protocol inheritance scenario.
tests/bgen/tests/issue3875.cs Added API-definition input reproducing Issue 3875 model/protocol naming scenario.
tests/bgen/tests/issue3875B.cs Added API-definition input reproducing Issue 3875 with custom model name scenario.
tests/bgen/tests/issue3875C.cs Added API-definition input reproducing Issue 3875 alternate file scenario.
tests/bgen/tests/missing-export-property.cs Added API-definition input for missing [Export] on property error case.
tests/bgen/tests/multiple-api-definitions1.cs Added placeholder API-definition input for multi-file test scenario.
tests/bgen/tests/multiple-api-definitions2-a.cs Added placeholder API-definition input for multi-file test scenario.
tests/bgen/tests/multiple-api-definitions2-b.cs Added placeholder API-definition input for multi-file test scenario.
tests/bgen/tests/nativeenum.cs Added API-definition input covering native enums and fields/delegates usage.
tests/bgen/tests/nativeenum-extensions.cs Added stub conversion helpers used by native enum tests.
tests/bgen/tests/newer-availability-in-inlined-protocol.cs Added API-definition input for availability merging across inlined protocols.
tests/bgen/tests/nfloat.cs Added API-definition input covering nfloat return/property/accessor exception marshaling.
tests/bgen/tests/nint-delegates.cs Added API-definition input for nint/nuint delegate and predicate handling.
tests/bgen/tests/no-availability-for-accessors.cs Added API-definition input ensuring availability attributes aren’t placed on accessors.
tests/bgen/tests/noasyncinternalwrapper.cs Added API-definition input ensuring no async wrapper for internal/required cases.
tests/bgen/tests/noasyncwarningcs0219.cs Added API-definition input for async codegen avoiding CS0219 warnings.
tests/bgen/tests/nowarn.cs Added API-definition input for nowarn behavior tests.
tests/bgen/tests/NSApplicationPublicEnsureMethods.cs Added API-definition input for public Ensure* methods needed in generated code.
tests/bgen/tests/nscopying-nullability.cs Added API-definition input for INSCopying nullability handling.
tests/bgen/tests/obsoletedosplatform.cs Added API-definition input for ObsoletedOSPlatform attributes scenario.
tests/bgen/tests/preview.cs Added API-definition input for [Experimental] attribute propagation tests.
tests/bgen/tests/property-redefination-ios.cs Added API-definition input for property redefinition on iOS scenario.
tests/bgen/tests/property-redefination-mac.cs Added API-definition input for property redefinition on macOS scenario.
tests/bgen/tests/protocol-and-basetype-no-model.cs Added API-definition input for protocol+basetype validation scenario.
tests/bgen/tests/protocol-bind-property.cs Added API-definition input for [Bind] on protocol property accessors.
tests/bgen/tests/protocol-duplicate-abstract.cs Added API-definition input for duplicate abstract member merge behavior.
tests/bgen/tests/protocol-duplicate-abstract-error.cs Added API-definition input for duplicate abstract member error case.
tests/bgen/tests/protocol-duplicate-method-diff-length.cs Added API-definition input for duplicate selector length mismatch error case.
tests/bgen/tests/protocol-duplicate-method-diff-out.cs Added API-definition input for duplicate selector out/ref mismatch error case.
tests/bgen/tests/protocol-duplicate-method-diff-return.cs Added API-definition input for duplicate selector return-type mismatch error case.
tests/bgen/tests/protocol-duplicate-method-diff-type.cs Added API-definition input for duplicate selector parameter-type mismatch error case.
tests/bgen/tests/protocols.cs Added API-definition input for protocol constructor/static member/inlining scenarios.
tests/bgen/tests/ref-out-parameters.cs Added API-definition input for ref/out parameter handling across types.
tests/bgen/tests/release-attribute.cs Added API-definition input for [return: Release] on managed/native/INativeObject returns.
tests/bgen/tests/return-release.cs Added API-definition input for [return: Release] in protocols.
tests/bgen/tests/smartenumwithframework.cs Added API-definition input for smart enum fields with framework-qualified library names.
tests/bgen/tests/snippet-attributes.cs Added API-definition input for pre/prologue/post snippet attributes and optimizable behavior.
tests/bgen/tests/strong-dict-native-enum.cs Added API-definition input for strong dictionaries with native enum values.
tests/bgen/tests/strong-dict-support-templated-dicts.cs Added API-definition input for templated strong dictionaries with classic NSDictionary types.
tests/bgen/tests/strongdictionary-errors.cs Added API-definition input for strong dictionary error cases.
tests/bgen/tests/types-in-multiple-namespaces.cs Added API-definition input for types referenced across multiple namespaces.
tests/bgen/tests/underlyingfieldtype.cs Added API-definition input for verifying underlying field type mappings for various primitives.
tests/bgen/tests/virtualwrap.cs Added API-definition input for virtual vs non-virtual wrap generation.
tests/bgen/tests/vsts-970507.cs Added API-definition input reproducing VSTS-970507 out-NSObject scenario.
tests/bgen/tests/warnaserror.cs Added API-definition input for warn-as-error behavior tests.
tests/bgen/tests/xmldocs.cs Added API-definition input and XML doc expectations coverage (including Async XmlDocs attributes).
Comments suppressed due to low confidence (4)

tests/bgen/ReflectionTest.cs:12

  • Avoid the null-forgiving operator (!) in these helpers. Since you already assert non-null, prefer an explicit null check that fails the test (or throw) and then return the non-null variable; same applies to GetProperty and GetMethod below.
    tests/bgen/NullabilityContextTests.cs:175
  • Avoid null-forgiving (!) when accessing propertyInfo.GetMethod/ReturnParameter. After asserting propertyInfo is not null, do an explicit null check on GetMethod/SetMethod (failing the test if missing) and then pass the non-null values to context.Create.
    tests/bgen/NullabilityContextTests.cs:271
  • There are multiple null-forgiving usages on info.ElementType / nested ElementType in these assertions. Since these tests assume an array/nested-array shape, consider asserting info.ElementType (and any nested ElementType) is not null first (failing the test if it is) and then using the non-null locals, instead of !.
    tests/bgen/NomenclatorTests.cs:37
  • The test fields are declared nullable and then accessed throughout the file using null-forgiving (attributeManager!, nomenclator!). Prefer making these fields non-nullable and initializing them in the constructor/SetUp (or otherwise failing fast if initialization didn’t run) to avoid relying on ! in the tests.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@rolfbjarne rolfbjarne marked this pull request as draft April 2, 2026 16:14
@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [CI Build #be577be] Build passed (Build packages) ✅

Pipeline on Agent
Hash: be577bed3a924a715c71dbad346fa3959a97133a [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

🔥 [CI Build #be577be] Build failed (Build macOS tests) 🔥

Build failed for the job 'Build macOS tests' (with job status 'Failed')

Pipeline on Agent
Hash: be577bed3a924a715c71dbad346fa3959a97133a [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

🔥 [CI Build #be577be] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

6 tests crashed, 86 tests failed, 40 tests passed.

Failures

❌ dotnettests tests (iOS)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(iOS): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/2/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(iOS): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/2/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildFatMonoTouchTest(iOS,"iossi...: 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/2/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • ... and 1 more

Html Report (VSDrops) Download

❌ dotnettests tests (MacCatalyst)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(MacCatalyst): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(MacCatalyst): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildFatMonoTouchTest(MacCatalys...: 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • ... and 1 more

Html Report (VSDrops) Download

❌ dotnettests tests (macOS)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(MacOSX): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(MacOSX): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildFatMonoTouchTest(MacOSX,"os...: 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • ... and 1 more

Html Report (VSDrops) Download

❌ dotnettests tests (tvOS)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(TVOS): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(TVOS): 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...
    • Xamarin.Tests.DotNetProjectTest.BuildInterdependentBindingProjec...: 'dotnet build' failed with exit code 1
      Full command: /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.300-p...

Html Report (VSDrops) Download

❌ generator tests

🔥 Failed catastrophically on VSTS: test results - generator (no summary found).

Html Report (VSDrops) Download

❌ interdependent-binding-projects tests

4 tests failed, 0 tests passed.

Failed tests

  • interdependent-binding-projects/macOS/Debug: BuildFailure
  • interdependent-binding-projects/Mac Catalyst/Debug: BuildFailure
  • interdependent-binding-projects/iOS - simulator/Debug: BuildFailure
  • interdependent-binding-projects/tvOS - simulator/Debug: BuildFailure

Html Report (VSDrops) Download

❌ linker tests

28 tests failed, 16 tests passed.

Failed tests

  • link sdk/macOS/Debug: BuildFailure
  • link sdk/macOS/Release: BuildFailure
  • link sdk/Mac Catalyst/Debug: BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • link sdk/Mac Catalyst/Release: BuildFailure
  • link sdk/iOS - simulator/Debug: BuildFailure
  • link sdk/iOS - simulator/Release: BuildFailure
  • link sdk/tvOS - simulator/Debug: BuildFailure
  • link sdk/tvOS - simulator/Release: BuildFailure
  • link all/macOS/Debug: BuildFailure
  • link all/macOS/Debug (don't bundle original resources): BuildFailure
  • link all/macOS/Release: BuildFailure
  • link all/Mac Catalyst/Debug: BuildFailure
  • link all/Mac Catalyst/Debug (don't bundle original resources): BuildFailure
  • link all/Mac Catalyst/Release: BuildFailure
  • link all/iOS - simulator/Debug: BuildFailure
  • link all/iOS - simulator/Release: BuildFailure
  • link all/iOS - simulator/Debug (don't bundle original resources): BuildFailure
  • link all/tvOS - simulator/Debug: BuildFailure
  • link all/tvOS - simulator/Release: BuildFailure
  • link all/tvOS - simulator/Debug (don't bundle original resources): BuildFailure
  • trimmode link/macOS/Debug: BuildFailure
  • trimmode link/macOS/Release: BuildFailure
  • trimmode link/Mac Catalyst/Debug: BuildFailure
  • trimmode link/Mac Catalyst/Release: BuildFailure
  • trimmode link/iOS - simulator/Debug: BuildFailure
  • trimmode link/iOS - simulator/Release: BuildFailure
  • trimmode link/tvOS - simulator/Debug: BuildFailure
  • trimmode link/tvOS - simulator/Release: BuildFailure

Html Report (VSDrops) Download

❌ monotouch tests (iOS)

11 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/iOS - simulator/Debug: BuildFailure
  • monotouch-test/iOS - simulator/Debug (LinkSdk): BuildFailure
  • monotouch-test/iOS - simulator/Debug (static registrar): BuildFailure
  • monotouch-test/iOS - simulator/Release (all optimizations): BuildFailure
  • monotouch-test/iOS - simulator/Debug (ARM64): BuildFailure
  • monotouch-test/iOS - simulator/Release (NativeAOT, ARM64): BuildFailure
  • monotouch-test/iOS - simulator/Debug (managed static registrar): BuildFailure
  • monotouch-test/iOS - simulator/Release (managed static registrar, all optimizations): BuildFailure
  • monotouch-test/iOS - simulator/Release (NativeAOT, x64): BuildFailure
  • monotouch-test/iOS - simulator/Debug (interpreter): BuildFailure
  • monotouch-test/iOS - simulator/Release (interpreter): BuildFailure

Html Report (VSDrops) Download

❌ monotouch tests (MacCatalyst)

15 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/Mac Catalyst/Debug: BuildFailure
  • monotouch-test/Mac Catalyst/Debug (ARM64): BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • monotouch-test/Mac Catalyst/Debug (managed static registrar): BuildFailure
  • monotouch-test/Mac Catalyst/Debug (static registrar): BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • monotouch-test/Mac Catalyst/Debug (static registrar, ARM64): BuildFailure
  • monotouch-test/Mac Catalyst/Release (managed static registrar): BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • monotouch-test/Mac Catalyst/Release (managed static registrar, all optimizations): BuildFailure
  • monotouch-test/Mac Catalyst/Release (NativeAOT): BuildFailure
  • monotouch-test/Mac Catalyst/Release (NativeAOT, ARM64): BuildFailure
  • monotouch-test/Mac Catalyst/Release (NativeAOT, x64): BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • monotouch-test/Mac Catalyst/Release (static registrar): BuildFailure
  • monotouch-test/Mac Catalyst/Release (static registrar, all optimizations): BuildFailure
  • monotouch-test/Mac Catalyst/Release (ARM64, LLVM): BuildFailure
  • monotouch-test/Mac Catalyst/Debug (interpreter): BuildFailure
  • monotouch-test/Mac Catalyst/Release (interpreter): BuildFailure

Html Report (VSDrops) Download

❌ monotouch tests (macOS)

12 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/macOS/Debug: BuildFailure
  • monotouch-test/macOS/Debug (ARM64): BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • monotouch-test/macOS/Debug (managed static registrar): BuildFailure
  • monotouch-test/macOS/Debug (static registrar): BuildFailure
  • monotouch-test/macOS/Debug (static registrar, ARM64): BuildFailure
  • monotouch-test/macOS/Release (managed static registrar): BuildFailure
  • monotouch-test/macOS/Release (managed static registrar, all optimizations): BuildFailure
  • monotouch-test/macOS/Release (NativeAOT): BuildFailure
  • monotouch-test/macOS/Release (NativeAOT, ARM64): BuildFailure
  • monotouch-test/macOS/Release (NativeAOT, x64): BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • monotouch-test/macOS/Release (static registrar): BuildFailure
  • monotouch-test/macOS/Release (static registrar, all optimizations): BuildFailure

Html Report (VSDrops) Download

❌ monotouch tests (tvOS)

11 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/tvOS - simulator/Debug: BuildFailure
  • monotouch-test/tvOS - simulator/Debug (LinkSdk): BuildFailure
  • monotouch-test/tvOS - simulator/Debug (static registrar): BuildFailure
  • monotouch-test/tvOS - simulator/Release (all optimizations): BuildFailure
  • monotouch-test/tvOS - simulator/Debug (ARM64): BuildFailure
  • monotouch-test/tvOS - simulator/Release (NativeAOT, ARM64): BuildFailure
  • monotouch-test/tvOS - simulator/Debug (managed static registrar): BuildFailure
  • monotouch-test/tvOS - simulator/Release (managed static registrar, all optimizations): BuildFailure
  • monotouch-test/tvOS - simulator/Release (NativeAOT, x64): BuildFailure
  • monotouch-test/tvOS - simulator/Debug (interpreter): BuildFailure
  • monotouch-test/tvOS - simulator/Release (interpreter): BuildFailure

Html Report (VSDrops) Download

❌ windows tests

1 tests failed, 2 tests passed.

Failed tests

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(MacOSX): Failed: 'dotnet build' failed with exit code 1

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(iOS): Failed: 'dotnet build' failed with exit code 1

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(TVOS): Failed: 'dotnet build' failed with exit code 1

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(iOS): Failed: 'dotnet build' failed with exit code 1

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(MacCatalyst): Failed: 'dotnet build' failed with exit code 1

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest(MacOSX): Failed: 'dotnet build' failed with exit code 1

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(MacCatalyst): Failed: 'dotnet build' failed with exit code 1

  • Local .NET tests/Xamarin.Tests.DotNetProjectTest.BuildBindingsTest2(TVOS): Failed: 'dotnet build' failed with exit code 1

Html Report (VSDrops) Download

❌ Tests on macOS Monterey (12) tests

🔥 Failed catastrophically on VSTS: test results - mac_monterey (no summary found).

Html Report (VSDrops) Download

❌ Tests on macOS Ventura (13) tests

🔥 Failed catastrophically on VSTS: test results - mac_ventura (no summary found).

Html Report (VSDrops) Download

❌ Tests on macOS Sonoma (14) tests

🔥 Failed catastrophically on VSTS: test results - mac_sonoma (no summary found).

Html Report (VSDrops) Download

❌ Tests on macOS Sequoia (15) tests

🔥 Failed catastrophically on VSTS: test results - mac_sequoia (no summary found).

Html Report (VSDrops) Download

❌ Tests on macOS Tahoe (26) tests

🔥 Failed catastrophically on VSTS: test results - mac_tahoe (no summary found).

Html Report (VSDrops) Download

Successes

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 6 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ sharpie: All 1 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

macOS tests

Linux Build Verification

Linux build succeeded

Pipeline on Agent
Hash: be577bed3a924a715c71dbad346fa3959a97133a [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #fdefe09] Build passed (Detect API changes) ✅

Pipeline on Agent
Hash: fdefe09e7ceea8667246ad2b916cda2ffdb45fde [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ API diff for current PR / commit

NET (empty diffs)

✅ API diff vs stable

NET (empty diffs)

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: fdefe09e7ceea8667246ad2b916cda2ffdb45fde [PR build]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants