[skills] Update tests skill for MTP device tests + docs#11680
Merged
jonathanpeppers merged 2 commits intoJun 17, 2026
Conversation
Reflect the Mono.Android device-test migration from NUnitLite to stock NUnit/MTP in the tests skill and related documentation. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
simonrozsival
added
the
ready-to-review
Contributor
There was a problem hiding this comment.
Pull request overview
Updates dotnet/android’s testing documentation and the tests Copilot skill to reflect the post-dotnet/android#11224 on-device device-test flow: install via -t:Install, then execute stock NUnit tests via dotnet test using Microsoft Testing Platform (MTP), producing .trx results.
Changes:
- Update on-device runtime test instructions from legacy
RunTestApp/NUnitLite to-t:Install+dotnet test --no-build --report-trx(MTP) and document.trxoutput locations. - Expand the tests skill/catalog to include on-device MTP command shape (including JcwGen) and note remaining legacy NUnitLite exceptions.
- Remove/adjust stale references to
Xamarin.Android.NUnitLitesources and old result-file guidance in docs/Copilot instructions.
Show a summary per file
| File | Description |
|---|---|
| tests/Mono.Android-Tests/Mono.Android-Tests/Mono.Android.NET-Tests.csproj | Updates comment to describe category filtering behavior in the MTP dotnet test flow. |
| Documentation/workflow/UnitTests.md | Rewrites on-device unit test guidance to use -t:Install + dotnet test with .trx outputs. |
| Documentation/project-docs/ExploringSources.md | Removes stale reference to Xamarin.Android.NUnitLite sources. |
| Documentation/building/unix/instructions.md | Updates test taxonomy wording for on-device instrumentation tests; trims trailing whitespace. |
| .github/skills/tests/SKILL.md | Updates skill workflow/commands to the current on-device MTP/NUnit execution pattern. |
| .github/skills/tests/references/test-catalog.md | Updates catalog guidance for full-build and on-device MTP tests; adds JcwGen command shape; notes legacy NUnitLite exceptions. |
| .github/copilot-instructions.md | Updates troubleshooting guidance to reproduce device tests using the MTP dotnet test command shape and .trx results. |
Copilot's findings
- Files reviewed: 7/7 changed files
- Comments generated: 1
Comment on lines
393
to
+396
| There are a category of tests which run on the device itself, these test the | ||
| runtime behaviour. These run `NUnit` tests directly on the device. Some of | ||
| these are located in the runtime itself. We build them within the repo then run | ||
| the tests on the device. They use a custom mobile version of `NUnit` called | ||
| `NUnitLite`. For the most part they are the same. | ||
| runtime behaviour. The main runtime tests use stock `NUnit` through Microsoft | ||
| Testing Platform (MTP). We build and install them within the repo, then run | ||
| `dotnet test` from the test project directory. |
Member
Author
There was a problem hiding this comment.
@jonathanpeppers this seems wrong. I thought we deleted NUnitLite completely and therefore these tests might not be able to run at all currently? or is this just a hallucination?
Member
There was a problem hiding this comment.
There are several Xamarin.Android test projects that haven't been running anywhere for a couple years, I think we should just delete them:
simonrozsival
changed the title
Removed legacy NUnitLite exceptions section from test catalog.
jonathanpeppers
approved these changes
Jun 17, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Update the
testsskill and related documentation after #11224 migrated Mono.Android device tests from NUnitLite to stock NUnit through Microsoft Testing Platform (MTP).Changes
.github/skills/teststo document the current-t:Install+dotnet test --no-build --report-trxdevice-test flow..trxresult output underbin/Test*/TestResults.Validation
python3 ~/.copilot/skills/skill-creator/scripts/quick_validate.py .github/skills/testsgit diff --check.githubandDocumentationfor staleRunTestApp/old result-file guidance.Device test note
Attempted to run the CoreCLR trimmable
Mono.Android.NET-Testsdevice lane with the new MTP command shape, but local SDK provisioning was blocked by a missing Android SDK docs file duringmake all, leaving Android workload packs unavailable.