Add VSTest to MTP migration skill

[Evangelink]

Replaces #346

[Copilot]

Pull request overview

This PR adds a new migrate-vstest-to-mtp skill to the dotnet-test plugin, providing guidance for migrating .NET test projects from VSTest to Microsoft.Testing.Platform (MTP). It covers MSTest, NUnit, and xUnit.net frameworks, including CI/CD pipeline updates, CLI argument translation, and behavioral differences.

Changes:

• Added the migrate-vstest-to-mtp SKILL.md with a comprehensive 10-step migration workflow covering all three major .NET test frameworks.
• Added eval scenarios (10 goals) with fixtures for MSTest, NUnit, xUnit.net, MSTest.Sdk, and CI pipeline migration scenarios.
• Updated plugin description in plugin.json, README.md, and both marketplace.json files to reflect the new migration capability.

Reviewed changes

Copilot reviewed 17 out of 17 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
plugins/dotnet-test/skills/migrate-vstest-to-mtp/SKILL.md	New skill document with detailed VSTest→MTP migration workflow
tests/dotnet-test/migrate-vstest-to-mtp/eval.yaml	10 eval scenarios covering various migration paths
tests/dotnet-test/migrate-vstest-to-mtp/fixtures/*	Test fixture files (csproj, cs, yml) for each scenario
plugins/dotnet-test/plugin.json	Updated description to include "migrating"
README.md	Updated dotnet-test plugin description
.github/plugin/marketplace.json	Updated dotnet-test description
.claude-plugin/marketplace.json	Updated dotnet-test description (kept in sync)

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

[github-actions]

Skill Validation Results

Skill	Scenario	Quality (Isolated)	Quality (Plugin)	Skills Loaded	Overfit	Verdict
migrate-vstest-to-mtp	Migrate MSTest project from VSTest to Microsoft.Testing.Platform	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill, report_intent	✅ 0.06	✅
migrate-vstest-to-mtp	Migrate NUnit project from VSTest to Microsoft.Testing.Platform	1.0/5 → 5.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅
migrate-vstest-to-mtp	Migrate xUnit.net v2 project from VSTest to Microsoft.Testing.Platform	1.0/5 → 5.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, report_intent, view, bash / ✅ migrate-vstest-to-mtp; tools: skill, report_intent, view, glob, bash	✅ 0.06	✅
migrate-vstest-to-mtp	Update Azure DevOps pipeline from VSTest task to MTP	2.7/5 → 5.0/5 🟢	2.7/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅
migrate-vstest-to-mtp	Migrate MSTest.Sdk project that explicitly uses VSTest	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅
migrate-vstest-to-mtp	Translate dotnet test VSTest arguments to MTP equivalents	4.3/5 → 5.0/5 🟢	4.3/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, report_intent / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅
migrate-vstest-to-mtp	Handle exit code 8 when migrating from VSTest to MTP	3.0/5 → 4.7/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, glob / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅
migrate-vstest-to-mtp	Configure dotnet test MTP mode on .NET 10 SDK	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, glob / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅
migrate-vstest-to-mtp	Migrate xUnit.net VSTest filter syntax to MTP	1.3/5 → 3.0/5 🟢	1.3/5 → 2.7/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅
migrate-vstest-to-mtp	Full VSTest to MTP migration plan for MSTest solution	4.0/5 → 4.7/5 🟢	4.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.06	✅

Model: claude-opus-4.6 | Judge: claude-opus-4.6

Full results

[github-actions]

Skill Validation Results

Skill	Scenario	Quality (Isolated)	Quality (Plugin)	Skills Loaded	Overfit	Verdict
migrate-vstest-to-mtp	Migrate MSTest project from VSTest to Microsoft.Testing.Platform	5.0/5 → 4.0/5 🔴	5.0/5 → 3.7/5 🔴	✅ migrate-vstest-to-mtp; tools: skill, report_intent, view / ✅ migrate-vstest-to-mtp; tools: skill, report_intent, bash	✅ 0.11	❌
migrate-vstest-to-mtp	Migrate NUnit project from VSTest to Microsoft.Testing.Platform	1.7/5 → 3.3/5 🟢	1.7/5 → 3.3/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.11	✅
migrate-vstest-to-mtp	Migrate xUnit.net v2 project from VSTest to Microsoft.Testing.Platform	1.3/5 → 5.0/5 🟢	1.3/5 → 4.7/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, report_intent, view, glob, bash / ✅ migrate-vstest-to-mtp; tools: skill, report_intent, view, bash, glob	✅ 0.11	✅
migrate-vstest-to-mtp	Update Azure DevOps pipeline from VSTest task to MTP	2.3/5 → 5.0/5 🟢	2.3/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.11	✅
migrate-vstest-to-mtp	Migrate MSTest.Sdk project that explicitly uses VSTest	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.11	✅
migrate-vstest-to-mtp	Translate dotnet test VSTest arguments to MTP equivalents	4.7/5 → 5.0/5 🟢	4.7/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill, report_intent	✅ 0.11	✅
migrate-vstest-to-mtp	Handle exit code 8 when migrating from VSTest to MTP	2.7/5 → 4.7/5 🟢	2.7/5 → 4.3/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, glob, create / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.11	✅
migrate-vstest-to-mtp	Configure dotnet test MTP mode on .NET 10 SDK	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.11	✅
migrate-vstest-to-mtp	Migrate xUnit.net VSTest filter syntax to MTP	1.7/5 → 1.0/5 🔴	1.7/5 → 2.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ run-tests; migrate-vstest-to-mtp; tools: skill, bash	✅ 0.11	❌
migrate-vstest-to-mtp	Full VSTest to MTP migration plan for MSTest solution	2.7/5 → 4.3/5 🟢	2.7/5 → 4.7/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, create / ✅ migrate-vstest-to-mtp; tools: skill, create	✅ 0.11	✅

Model: claude-opus-4.6 | Judge: claude-opus-4.6

Full results

[Copilot]

Pull request overview

This PR adds a new migrate-vstest-to-mtp skill to the dotnet-test plugin, providing comprehensive guidance for migrating .NET test projects from VSTest to Microsoft.Testing.Platform (MTP). It replaces the earlier PR #346 with a refined implementation.

Changes:

• Adds SKILL.md with a 10-step migration workflow covering MSTest, NUnit, and xUnit.net frameworks, CLI argument translation, CI/CD pipeline updates, and behavioral differences.
• Adds eval.yaml with 10 evaluation scenarios and 5 fixture directories for testing the skill.
• Updates plugin descriptions in plugin.json, both marketplace.json files, and README.md to include "migrating" in the dotnet-test plugin description.

Reviewed changes

Copilot reviewed 17 out of 17 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
plugins/dotnet-test/skills/migrate-vstest-to-mtp/SKILL.md	New skill document with full VSTest→MTP migration workflow
tests/dotnet-test/migrate-vstest-to-mtp/eval.yaml	10 eval scenarios covering all migration goals
tests/dotnet-test/migrate-vstest-to-mtp/fixtures/*	5 fixture directories with .csproj, .cs, and .yml test files
plugins/dotnet-test/plugin.json	Updated description to include "migrating"
README.md	Updated dotnet-test plugin description
.github/plugin/marketplace.json	Updated dotnet-test description
.claude-plugin/marketplace.json	Updated dotnet-test description

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

[github-actions]

Skill Validation Results

Skill	Scenario	Quality (Isolated)	Quality (Plugin)	Skills Loaded	Overfit	Verdict
migrate-vstest-to-mtp	Migrate MSTest project from VSTest to Microsoft.Testing.Platform	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, bash / ✅ migrate-vstest-to-mtp; tools: skill, report_intent, view	✅ 0.10	✅
migrate-vstest-to-mtp	Migrate NUnit project from VSTest to Microsoft.Testing.Platform	1.3/5 → 5.0/5 🟢	1.3/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.10	✅
migrate-vstest-to-mtp	Migrate xUnit.net v2 project from VSTest to Microsoft.Testing.Platform	1.3/5 → 5.0/5 🟢	1.3/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, report_intent, bash, view / ✅ migrate-vstest-to-mtp; tools: skill, report_intent, view, bash	✅ 0.10	✅
migrate-vstest-to-mtp	Update Azure DevOps pipeline from VSTest task to MTP	2.3/5 → 5.0/5 🟢	2.3/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.10	✅
migrate-vstest-to-mtp	Migrate MSTest.Sdk project that explicitly uses VSTest	3.7/5 → 5.0/5 🟢	3.7/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.10	✅
migrate-vstest-to-mtp	Translate dotnet test VSTest arguments to MTP equivalents	4.3/5 → 5.0/5 🟢	4.3/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, report_intent / ✅ migrate-vstest-to-mtp; tools: report_intent, skill	✅ 0.10	✅
migrate-vstest-to-mtp	Handle exit code 8 when migrating from VSTest to MTP	3.3/5 → 5.0/5 🟢	3.3/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill, glob, create / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.10	✅
migrate-vstest-to-mtp	Configure dotnet test MTP mode on .NET 10 SDK	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.10	✅
migrate-vstest-to-mtp	Migrate xUnit.net VSTest filter syntax to MTP	1.7/5 → 4.0/5 🟢	1.7/5 → 3.7/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.10	❌ [1]
migrate-vstest-to-mtp	Full VSTest to MTP migration plan for MSTest solution	2.7/5 → 5.0/5 🟢	2.7/5 → 5.0/5 🟢	✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill	✅ 0.10	✅

[1] (Plugin) Quality improved but weighted score is -21.8% due to: judgment

Model: claude-opus-4.6 | Judge: claude-opus-4.6

Full results