Adjust for timeout issues

[JanKrivanek]

Mativation

Prevention from high cancelation rate (#288 (comment))

[Copilot]

Pull request overview

Updates the GitHub Actions evaluation workflow scheduling and timeout configuration to reduce scheduled run cancellations/timeouts impacting the repository’s evaluation pipeline.

Changes:

• Adjust the scheduled evaluation cron frequency from every 3 hours to every 5 hours.
• Increase the evaluate job timeout from 90 minutes to 150 minutes.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File	Description
.github/workflows/evaluation.yml	Reduces scheduled trigger frequency to mitigate overlapping runs/cancellations.
.github/workflows/evaluation-run.yml	Extends evaluation job timeout to better accommodate longer runs.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

[github-actions]

Skill Validation Results

Skill	Scenario	Quality (Isolated)	Quality (Plugin)	Skills Loaded	Overfit	Verdict
csharp-scripts	Test a C# language feature with a script	3.0/5 → 4.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ csharp-scripts; tools: skill, create / ✅ csharp-scripts; tools: skill, create, edit	🟡 0.32	✅
nuget-trusted-publishing	Set up trusted publishing for a new NuGet library	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ nuget-trusted-publishing; tools: skill / ✅ nuget-trusted-publishing; tools: skill	✅ 0.11	✅
nuget-trusted-publishing	Set up NuGet publishing without mentioning trusted publishing	2.0/5 → 4.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ nuget-trusted-publishing; tools: report_intent, skill, task, view, glob, bash, read_agent, create / ✅ nuget-trusted-publishing; tools: skill, report_intent, task, view, glob, bash, create	✅ 0.11	✅
nuget-trusted-publishing	Migrate existing workflow from API key to trusted publishing	3.0/5 → 4.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ nuget-trusted-publishing; tools: skill, bash / ✅ nuget-trusted-publishing; tools: skill, task, bash	✅ 0.11	✅
dotnet-pinvoke	Generate LibraryImport declaration from C header (.NET 8+)	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ dotnet-pinvoke; tools: skill / ✅ dotnet-pinvoke; tools: skill	✅ 0.08	❌ [1]
dotnet-pinvoke	Generate LibraryImport declaration from C header (.NET Framework)	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ dotnet-pinvoke; tools: skill, report_intent, create / ✅ dotnet-pinvoke; tools: report_intent, skill	✅ 0.08	❌ [2]
dotnet-trace-collect	High CPU in Kubernetes on Linux (.NET 8)	4.0/5 → 3.0/5 🔴	4.0/5 → 4.0/5	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	❌
dotnet-trace-collect	.NET Framework on Windows without admin privileges	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	.NET 10 on Linux with root access and native call stacks	1.0/5 → 4.0/5 🟢	1.0/5 → 3.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Memory leak on Linux (.NET 8)	3.0/5 → 3.0/5	3.0/5 → 3.0/5	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Slow requests on Windows with PerfView	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Excessive GC on Linux (.NET 8)	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Hang or deadlock diagnosis on Linux	3.0/5 → 3.0/5	3.0/5 → 2.0/5 🔴	✅ dotnet-trace-collect; tools: skill / ⚠️ NOT ACTIVATED	✅ 0.13	❌
dotnet-trace-collect	Windows container high CPU with PerfView	1.0/5 → 5.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Long-running intermittent issue with PerfView triggers	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Linux pre-.NET 10 needing native call stacks	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Windows modern .NET with admin high CPU	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: report_intent, skill, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Memory leak on .NET Framework Windows	4.0/5 → 5.0/5 🟢	4.0/5 → 4.0/5	✅ dotnet-trace-collect; tools: report_intent, skill, view, bash / ✅ dotnet-trace-collect; tools: report_intent, skill, view	✅ 0.13	✅
dotnet-trace-collect	Kubernetes with console access prefers console tools	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	❌ [3]
dotnet-trace-collect	Container installation without .NET SDK	3.0/5 → 2.0/5 🔴	3.0/5 → 4.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	❌
dotnet-trace-collect	HTTP 500s from downstream service on Linux (.NET 8)	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Networking timeouts on Windows with admin (.NET 8)	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: report_intent, skill, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Assembly loading failure on Linux (.NET 8)	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: report_intent, skill, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
microbenchmarking	Investigate runtime upgrade performance impact	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ microbenchmarking; tools: skill, read_bash / ✅ microbenchmarking; tools: skill	✅ 0.14	✅
clr-activation-debugging	Diagnose unexpected FOD dialog from native build tool	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	❌ [4]
clr-activation-debugging	Diagnose FOD suppressed but activation still failing	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	❌ [5]
clr-activation-debugging	Explain why same binary behaves differently under different launch methods	1.0/5 → 4.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	✅
clr-activation-debugging	Analyze healthy managed EXE activation	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	❌ [6]
clr-activation-debugging	Identify multiple activation sequences in a single log	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	❌ [7]
clr-activation-debugging	Explain useLegacyV2RuntimeActivationPolicy in activation log	2.0/5 → 3.0/5 🟢	2.0/5 → 3.0/5 🟢	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	✅
clr-activation-debugging	Decline non-CLR-activation issue	1.0/5 → 5.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ clr-activation-debugging; tools: skill, glob / ✅ clr-activation-debugging; tools: skill	✅ 0.07	✅
analyzing-dotnet-performance	Detects compiled regex startup budget and regex chain allocations	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [8]
analyzing-dotnet-performance	Detects CurrentCulture comparer and compiled regex budget in inflection rules	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [9]
analyzing-dotnet-performance	Finds per-call Dictionary allocation not hoisted to static	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [10]
analyzing-dotnet-performance	Catches compound allocations in recursive number converter with ToLower	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [11]
analyzing-dotnet-performance	Finds StringComparison.Ordinal missing and FrozenDictionary opportunities	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	✅
analyzing-dotnet-performance	Detects Aggregate+Replace chain and struct missing IEquatable	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [12]
analyzing-dotnet-performance	Finds branched Replace chain in format string manipulation	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [13]
analyzing-dotnet-performance	Catches LINQ on hot-path string processing and All(char.IsUpper)	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [14]
analyzing-dotnet-performance	Detects LINQ pipeline in TimeSpan formatting and collection processing	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [15]
analyzing-dotnet-performance	Flags Span inconsistencies and compound method chains in truncation library	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [16]
analyzing-dotnet-performance	Identifies unsealed leaf classes and locale hierarchy patterns	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	❌ [17]
android-tombstone-symbolication	Symbolicate .NET frames in an Android tombstone	4.0/5 → 5.0/5 🟢	4.0/5 → 3.0/5 🔴	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill	✅ 0.18	❌
android-tombstone-symbolication	Recognize tombstone with no .NET frames	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ android-tombstone-symbolication; tools: skill, bash / ✅ android-tombstone-symbolication; tools: skill	✅ 0.18	❌ [18]
android-tombstone-symbolication	Symbolicate CoreCLR frames in an Android tombstone	1.0/5 ⏰ → 4.0/5 🟢	1.0/5 ⏰ → 4.0/5 🟢	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill	✅ 0.18	✅
android-tombstone-symbolication	Recognize NativeAOT tombstone with app binary and libSystem.Native.so	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill, read_bash, stop_bash	✅ 0.18	✅
android-tombstone-symbolication	Symbolicate multi-thread tombstone	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill	✅ 0.18	✅
android-tombstone-symbolication	Handle .NET frames with no BuildId metadata	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ android-tombstone-symbolication; tools: skill, bash / ✅ android-tombstone-symbolication; tools: skill, bash	✅ 0.18	❌ [19]
android-tombstone-symbolication	Symbolicate tombstone with multiple .NET libraries and different BuildIds	4.0/5 → 3.0/5 🔴	4.0/5 → 2.0/5 ⏰ 🔴	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill, read_bash	✅ 0.18	❌
android-tombstone-symbolication	Reject iOS crash log as wrong format	5.0/5 → 5.0/5	5.0/5 → 5.0/5	ℹ️ not activated (expected) / ℹ️ not activated (expected)	✅ 0.18	❌ [20]
dump-collect	Configure automatic crash dumps for CoreCLR app on Linux	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ dump-collect; tools: report_intent, skill, view, bash / ✅ dump-collect; tools: skill, report_intent, view	✅ 0.13	❌ [21]
dump-collect	Set up NativeAOT crash dumps with createdump in Kubernetes	3.0/5 → 2.0/5 🔴	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	✅ 0.13	✅ [22]
dump-collect	Recover crash dump from macOS NativeAOT without createdump	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ dump-collect; tools: report_intent, skill, view, bash, glob / ✅ dump-collect; tools: skill, report_intent, view	✅ 0.13	❌
dump-collect	Configure CoreCLR dump collection in Alpine Docker as non-root	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	✅ 0.13	✅
dump-collect	Advisory: macOS NativeAOT crash dump recovery steps	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	✅ 0.13	✅
dump-collect	Advisory: CoreCLR Alpine Docker non-root configuration	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	✅ 0.13	✅
dump-collect	Advisory: NativeAOT Kubernetes dump collection setup	2.0/5 → 2.0/5	2.0/5 → 5.0/5 🟢	✅ dump-collect; tools: report_intent, skill, view, bash / ✅ dump-collect; tools: report_intent, skill, view	✅ 0.13	❌ [23]
dump-collect	Detect runtime and configure crash dumps for unknown .NET app on Linux	4.0/5 → 2.0/5 🔴	4.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	✅ 0.13	❌
dump-collect	Decline dump analysis request	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	ℹ️ not activated (expected) / ℹ️ not activated (expected)	✅ 0.13	✅
optimizing-ef-core-queries	Optimize bulk operations with EF Core 7+ ExecuteUpdate and ExecuteDelete	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	⚠️ NOT ACTIVATED / ✅ optimizing-ef-core-queries; tools: skill	🟡 0.41	✅
build-parallelism	Analyze build parallelism bottlenecks	1.0/5 ⏰ → 1.0/5 ⏰	1.0/5 ⏰ → 1.0/5 ⏰	✅ build-parallelism; tools: skill, task / ✅ binlog-generation; build-parallelism; tools: skill, task, glob	✅ 0.14	❌ [24]
including-generated-files	Diagnose generated file inclusion failure	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	⚠️ NOT ACTIVATED / ✅ including-generated-files; tools: skill	🟡 0.22	✅
msbuild-antipatterns	Review MSBuild files for anti-patterns and style issues	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ msbuild-antipatterns; tools: skill / ✅ msbuild-antipatterns; tools: skill, glob	✅ 0.07	❌ [25]
build-perf-baseline	Establish build performance baseline and recommend optimizations	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ build-perf-baseline; tools: skill / ✅ build-perf-baseline; build-perf-diagnostics; binlog-failure-analysis; tools: skill, task	🟡 0.29	❌ [26]
msbuild-modernization	Modernize legacy project to SDK-style	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ msbuild-modernization; tools: skill, edit, bash / ✅ msbuild-modernization; tools: skill	✅ 0.04	❌ [27]
directory-build-organization	Organize build infrastructure for a multi-project repo	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ directory-build-organization; tools: skill / ✅ directory-build-organization; msbuild-antipatterns; tools: task, bash, skill	✅ 0.14	✅
check-bin-obj-clash	Diagnose bin/obj output path clashes	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ check-bin-obj-clash; tools: skill, glob / ✅ check-bin-obj-clash; tools: skill, glob	✅ 0.14	❌ [28]
incremental-build	Analyze incremental build issues	3.0/5 → 4.0/5 🟢	3.0/5 → 3.0/5	✅ incremental-build; tools: skill / ✅ incremental-build; tools: skill	✅ 0.12	✅
eval-performance	Analyze MSBuild evaluation performance issues	4.0/5 → 4.0/5	4.0/5 → 4.0/5	✅ eval-performance; tools: skill / ✅ eval-performance; tools: skill	✅ 0.12	❌ [29]
build-perf-diagnostics	Analyze analyzer performance impact on builds	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ build-perf-diagnostics; tools: skill / ✅ binlog-generation; build-perf-diagnostics; tools: skill	🟡 0.26	❌ [30]
binlog-generation	Build project with /bl flag	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ binlog-generation; tools: skill / ✅ binlog-generation; tools: skill	🔴 0.59	✅
binlog-generation	Build with /bl in PowerShell	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ binlog-generation; tools: skill / ✅ binlog-generation; tools: skill	🔴 0.59	✅
binlog-generation	Build multiple configurations with unique binlogs	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ binlog-generation; tools: skill / ✅ binlog-generation; tools: skill	🔴 0.59	✅
binlog-failure-analysis	Diagnose build failures from binlog only (no source files)	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ binlog-failure-analysis; tools: skill / ✅ binlog-failure-analysis; tools: skill	✅ 0.04	❌ [31]
dotnet-maui-doctor	Plan macOS MAUI setup with Xcode	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill, web_fetch / ✅ dotnet-maui-doctor; tools: skill	🟡 0.23	✅
dotnet-maui-doctor	Plan Linux MAUI environment for Android	3.0/5 → 1.0/5 ⏰ 🔴	3.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill, view, read_bash / ✅ dotnet-maui-doctor; tools: skill, view	🟡 0.23	❌
dotnet-maui-doctor	Guardrail against workload update and repair	1.0/5 → 2.0/5 🟢	1.0/5 → 3.0/5 🟢	✅ dotnet-maui-doctor; tools: report_intent, skill / ✅ dotnet-maui-doctor; tools: report_intent, skill	🟡 0.23	✅
dotnet-maui-doctor	Diagnose non-Microsoft JDK causing build failure	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill / ✅ dotnet-maui-doctor; tools: skill	🟡 0.23	✅
dotnet-maui-doctor	Plan complete MAUI setup on Windows	4.0/5 → 3.0/5 🔴	4.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill / ✅ dotnet-maui-doctor; tools: skill	🟡 0.23	❌
dotnet-maui-doctor	Prevent incorrect JAVA_HOME configuration	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill / ✅ dotnet-maui-doctor; tools: skill	🟡 0.23	✅
dotnet-maui-doctor	Determine required Android SDK packages for specific .NET version	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: report_intent, skill, view, bash / ✅ dotnet-maui-doctor; tools: report_intent, skill, view, bash	🟡 0.23	✅
dotnet-maui-doctor	Fix stale MAUI workloads after SDK update	2.0/5 → 2.0/5 ⏰	2.0/5 → 4.0/5 🟢	✅ dotnet-maui-doctor; tools: skill, bash, web_fetch / ✅ dotnet-maui-doctor; tools: skill	🟡 0.23	❌ [32]
technology-selection	ML.NET classification on tabular data	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill	🟡 0.33	✅
technology-selection	LLM integration with MEAI abstraction	1.0/5 → 3.0/5 🟢	1.0/5 → 4.0/5 🟢	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill	🟡 0.33	✅
technology-selection	Reject LLM for tabular classification	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ technology-selection; tools: skill, read_bash / ✅ technology-selection; tools: skill	🟡 0.33	✅
technology-selection	Agentic workflow with guardrails	1.0/5 ⏰ → 1.0/5 ⏰	1.0/5 ⏰ → 2.0/5 ⏰ 🟢	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill, grep, edit, create	🟡 0.33	❌ [33]
technology-selection	Natural-language scenario decomposition — RAG chatbot	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill	🟡 0.33	❌ [34]
technology-selection	RAG pipeline with vector search	4.0/5 → 5.0/5 🟢	4.0/5 → 4.0/5	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill	🟡 0.33	❌ [35]
migrate-dotnet9-to-dotnet10	Console app with System.Linq.Async, SIGTERM, and BufferedStream	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, grep, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌ [36]
migrate-dotnet9-to-dotnet10	Expression tree code broken by C# 14 span overload resolution	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view	—	❌ [37]
migrate-dotnet9-to-dotnet10	ASP.NET Core app with WebHostBuilder, OpenAPI, and forwarded headers	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	ASP.NET Core app with OpenAPI transformers using Microsoft.OpenApi v1 APIs	2.0/5 → 4.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view	—	✅
migrate-dotnet9-to-dotnet10	EF Core app with Azure SQL JSON columns and parameterized collections	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌
migrate-dotnet9-to-dotnet10	EF Core app with dynamic ExecuteUpdate and complex types	5.0/5 → 3.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌
migrate-dotnet9-to-dotnet10	SQLite app with DateTimeOffset timezone handling	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅ [38]
migrate-dotnet9-to-dotnet10	Worker service with config null array binding and ProviderAlias assembly change	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	Cryptography app with OpenSSL, X.509, and Rfc2898DeriveBytes	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌
migrate-dotnet9-to-dotnet10	SDK and NuGet obscure tooling changes	4.0/5 → 3.0/5 🔴	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	❌
migrate-dotnet9-to-dotnet10	JSON polymorphism with conflicting property names and XmlSerializer	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	WinForms and WPF desktop app with System.Drawing and DynamicResource	2.0/5 → 3.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	Containerized single-file app with P/Invoke and IDispatchEx	2.0/5 ⏰ → 3.0/5 🟢	2.0/5 ⏰ → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	App using SslStream properties and SystemEvents	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌ [39]
migrate-dotnet9-to-dotnet10	Library with NuGet auditing, transitive deps, and InlineArray	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill, report_intent, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view	—	✅
migrate-dotnet9-to-dotnet10	C# 14 compiler breaking changes — field keyword, extension keyword, disposal	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view	—	✅
migrate-dotnet9-to-dotnet10	Blazor WASM app with generic math shift masking and tar operations	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view, bash, glob, stop_bash / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view	—	✅
migrate-dotnet8-to-dotnet9	App with empty environment variables, ZIP encoding, and keyed DI services	2.0/5 → 3.0/5 🟢	2.0/5 → 4.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash, create / ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash	—	✅
migrate-dotnet8-to-dotnet9	C# 13 compiler breaking changes — InlineArray on record, iterator safe context, collection expressions	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill, report_intent, view, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill, report_intent, view	—	✅
migrate-dotnet8-to-dotnet9	ASP.NET Core app with DI validation, forwarded headers, and HttpClientFactory casting	2.0/5 → 2.0/5	2.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill, create / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	✅
migrate-dotnet8-to-dotnet9	EF Core app with migration patterns and Cosmos DB discriminator	3.0/5 → 3.0/5	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash	—	✅
migrate-dotnet8-to-dotnet9	EF Core Cosmos DB app with existing documents and composite id format	4.0/5 → 3.0/5 🔴	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	❌
migrate-dotnet8-to-dotnet9	App with JsonDocument null deserialization and BinaryFormatter fallback	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	❌ [40]
migrate-dotnet8-to-dotnet9	CI pipeline with Terminal Logger parsing and version constraints	2.0/5 → 2.0/5	2.0/5 → 5.0/5 🟢	ℹ️ not activated (expected) / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	✅
migrate-dotnet8-to-dotnet9	WinForms app with custom UserControls and PictureBox URL loading	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	✅
migrate-dotnet8-to-dotnet9	Containerized app with zlib dependency and runtime configuration	5.0/5 → 4.0/5 🔴	5.0/5 → 4.0/5 🔴	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	❌
migrate-dotnet8-to-dotnet9	EF Core Cosmos DB app with discriminator and sync I/O	4.0/5 → 3.0/5 🔴	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	❌
migrate-dotnet8-to-dotnet9	Library with String.Trim span overload, keyed services, and InlineArray	5.0/5 → 3.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash	—	❌
migrate-dotnet8-to-dotnet9	Containerized app with env var precedence reversal and zlib removal	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill	—	❌ [41]
thread-abort-migration	Worker thread with abort-based cancellation	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ thread-abort-migration; tools: skill / ✅ thread-abort-migration; tools: skill	✅ 0.14	✅
thread-abort-migration	Timeout enforcement via Thread.Abort	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ thread-abort-migration; tools: skill / ✅ thread-abort-migration; tools: skill	✅ 0.14	❌ [42]
thread-abort-migration	Blocking WaitHandle with Thread.Interrupt	3.0/5 → 3.0/5	3.0/5 → 4.0/5 🟢	✅ thread-abort-migration; tools: skill, report_intent, bash / ✅ thread-abort-migration; tools: report_intent, skill	✅ 0.14	✅
thread-abort-migration	ASP.NET Response.End and Response.Redirect with Thread.Abort	4.0/5 → 5.0/5 🟢	4.0/5 → 4.0/5	✅ thread-abort-migration; tools: skill, report_intent, bash / ✅ thread-abort-migration; tools: report_intent, skill	✅ 0.14	✅
thread-abort-migration	Thread.Join and Thread.Sleep only — should not migrate	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.14	✅
migrate-nullable-references	Enable NRT in a small library with mixed nullability	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-nullable-references; tools: skill / ✅ migrate-nullable-references; tools: skill	✅ 0.12	❌ [43]
migrate-nullable-references	File-by-file migration: only modify the targeted file	5.0/5 → 5.0/5	5.0/5 → 5.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.12	❌ [44]
migrate-nullable-references	Enable NRT in ASP.NET Core Web API with EF Core	4.0/5 → 4.0/5	4.0/5 → 3.0/5 🔴	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.12	❌
dotnet-aot-compat	Make Azure.ResourceManager AOT-compatible	2.0/5 ⏰ → 2.0/5 ⏰	2.0/5 ⏰ → 1.0/5 ⏰ 🔴	✅ dotnet-aot-compat; tools: skill, read_agent, create / ✅ dotnet-aot-compat; tools: skill	✅ 0.13	❌
migrate-dotnet10-to-dotnet11	Console app with compression and TAR operations	4.0/5 → 4.0/5	4.0/5 → 4.0/5	✅ migrate-dotnet10-to-dotnet11; tools: skill / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	❌ [45]
migrate-dotnet10-to-dotnet11	C# 15 compiler breaking changes — Span safe-context, nameof, with()	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view, bash / ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view	✅ 0.04	✅
migrate-dotnet10-to-dotnet11	EF Core app with Cosmos DB provider using sync APIs	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	❌ [46]
migrate-dotnet10-to-dotnet11	Deployment to older hardware with minimum requirement changes	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view, bash / ✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view	✅ 0.04	✅
migrate-dotnet10-to-dotnet11	Cryptography app using DSA on macOS	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view, bash / ✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view	✅ 0.04	❌ [47]
migrate-dotnet10-to-dotnet11	Basic TFM update with Docker and global.json	4.0/5 → 4.0/5	4.0/5 → 4.0/5	✅ migrate-dotnet10-to-dotnet11; tools: skill / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	❌ [48]
migrate-dotnet10-to-dotnet11	C# 15 dynamic operator and ref readonly delegate issues	1.0/5 ⏰ → 2.0/5 🟢	1.0/5 ⏰ → 5.0/5 🟢	⚠️ NOT ACTIVATED / ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view	✅ 0.04	✅
run-tests	Run tests in a VSTest MSTest project	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	🟡 0.28	❌ [49]
run-tests	Run tests with trx reporting on MTP project (SDK 9)	2.0/5 → 4.0/5 🟢	2.0/5 → 4.0/5 🟢	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill, glob	🟡 0.28	✅
run-tests	Run tests with blame-hang on MTP project (SDK 10)	1.0/5 → 1.0/5	1.0/5 → 2.0/5 🟢	⚠️ NOT ACTIVATED / ✅ run-tests; tools: skill	🟡 0.28	❌ [50]
run-tests	Run tests in a multi-TFM project targeting a specific framework	1.0/5 → 3.0/5 🟢	1.0/5 → 3.0/5 🟢	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	🟡 0.28	✅
run-tests	Filter MSTest tests by category on VSTest	1.0/5 → 2.0/5 🟢	1.0/5 → 3.0/5 🟢	✅ run-tests; tools: skill, grep / ✅ run-tests; tools: skill	🟡 0.28	✅
run-tests	Filter NUnit tests by class name on VSTest	3.0/5 → 2.0/5 🔴	3.0/5 → 2.0/5 🔴	✅ run-tests; tools: skill, bash / ✅ run-tests; tools: skill, bash	🟡 0.28	❌
run-tests	Filter xUnit v3 tests by class on MTP	1.0/5 → 2.0/5 🟢	1.0/5 → 2.0/5 🟢	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill, glob	🟡 0.28	✅
run-tests	Filter xUnit v3 tests by trait on MTP	1.0/5 → 2.0/5 🟢	1.0/5 → 2.0/5 🟢	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill, glob	🟡 0.28	✅
run-tests	Filter TUnit tests by class using treenode-filter	1.0/5 → 5.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ run-tests; tools: skill / ✅ run-tests; tools: skill	🟡 0.28	✅
run-tests	Combine multiple filter criteria on VSTest MSTest	2.0/5 → 4.0/5 🟢	2.0/5 → 4.0/5 🟢	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill, glob	🟡 0.28	✅
run-tests	MTP project on SDK 9 must use -- separator for args	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill, bash	🟡 0.28	❌ [51]
run-tests	MTP project on SDK 10 passes args directly	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ run-tests; tools: skill / ✅ run-tests; tools: skill, glob	🟡 0.28	❌ [52]
run-tests	Detect test platform from Directory.Build.props	1.0/5 → 5.0/5 🟢	1.0/5 → 2.0/5 🟢	✅ run-tests; tools: skill / ✅ run-tests; tools: skill	🟡 0.28	✅
run-tests	Negative test: do not use MTP syntax for a VSTest project	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill, glob	🟡 0.28	✅

[1] (Plugin) Quality unchanged but weighted score is -3.5% due to: tokens (23949 → 49874), tool calls (2 → 4)
[2] (Plugin) Quality unchanged but weighted score is -10.0% due to: tokens (12058 → 31029), tool calls (0 → 2), time (16.9s → 36.7s)
[3] (Isolated) Quality improved but weighted score is -4.7% due to: tokens (11662 → 107301), tool calls (0 → 6), time (9.4s → 39.8s)
[4] (Plugin) Quality unchanged but weighted score is -9.7% due to: quality, tool calls (4 → 7), tokens (47013 → 64174), time (17.0s → 21.8s)
[5] (Plugin) Quality unchanged but weighted score is -4.4% due to: tool calls (4 → 7), tokens (47112 → 64032), time (16.1s → 20.9s)
[6] (Plugin) Quality unchanged but weighted score is -8.0% due to: tokens (34946 → 70314), tool calls (3 → 5), time (11.8s → 17.9s)
[7] (Plugin) Quality unchanged but weighted score is -8.5% due to: tokens (34980 → 64188), tool calls (3 → 8), time (12.8s → 22.3s)
[8] (Plugin) Quality unchanged but weighted score is -1.3% due to: time (13.2s → 17.0s), tokens (34918 → 39115)
[9] (Plugin) Quality unchanged but weighted score is -4.6% due to: tokens (34942 → 52200), time (12.2s → 18.3s), tool calls (3 → 4)
[10] (Plugin) Quality unchanged but weighted score is -0.7% due to: tokens (34869 → 38823)
[11] (Plugin) Quality unchanged but weighted score is -6.3% due to: tokens (23068 → 38906), time (8.6s → 14.2s), tool calls (2 → 3)
[12] (Isolated) Quality unchanged but weighted score is -12.5% due to: judgment
[13] (Isolated) Quality unchanged but weighted score is -0.6% due to: efficiency metrics
[14] (Isolated) Quality unchanged but weighted score is -4.4% due to: tokens (34872 → 49029), time (12.2s → 19.7s), tool calls (3 → 4)
[15] (Plugin) Quality unchanged but weighted score is -0.7% due to: tokens (46742 → 52152)
[16] (Plugin) Quality unchanged but weighted score is -0.6% due to: tokens (46789 → 52092)
[17] (Plugin) Quality unchanged but weighted score is -1.9% due to: time (12.4s → 19.0s), tokens (34908 → 38926)
[18] (Plugin) Quality unchanged but weighted score is -7.1% due to: tokens (24164 → 45227), time (10.4s → 16.5s), tool calls (2 → 3)
[19] (Plugin) Quality unchanged but weighted score is -7.8% due to: tokens (24818 → 63323), tool calls (2 → 5)
[20] (Isolated) Quality unchanged but weighted score is -10.7% due to: judgment, quality
[21] (Isolated) Quality unchanged but weighted score is -10.0% due to: tokens (11780 → 98190), tool calls (0 → 8), time (11.6s → 35.0s)
[22] (Isolated) Quality dropped but weighted score is +14.2% due to: tool calls (19 → 9)
[23] (Isolated) Quality unchanged but weighted score is -33.2% due to: judgment, quality, tokens (12478 → 84448), tool calls (0 → 8), time (20.4s → 52.1s)
[24] (Plugin) Quality unchanged but weighted score is -2.4% due to: tokens (299871 → 373666), tool calls (21 → 31)
[25] (Isolated) Quality unchanged but weighted score is -5.5% due to: tokens (40908 → 87958), tool calls (11 → 16)
[26] (Isolated) Quality improved but weighted score is -2.0% due to: judgment
[27] (Plugin) Quality unchanged but weighted score is -5.2% due to: tokens (39001 → 73692)
[28] (Isolated) Quality improved but weighted score is -8.5% due to: tokens (102511 → 237574), tool calls (11 → 22), time (78.1s → 109.3s)
[29] (Plugin) Quality unchanged but weighted score is -8.4% due to: quality, tokens (37149 → 45130), time (22.4s → 28.5s)
[30] (Isolated) Quality improved but weighted score is -23.1% due to: judgment, quality, tokens (99263 → 159757), tool calls (9 → 15)
[31] (Plugin) Quality unchanged but weighted score is -1.7% due to: tool calls (23 → 38), tokens (529019 → 663049)
[32] (Isolated) Quality unchanged but weighted score is -5.4% due to: tokens (35859 → 261934), errors (0 → 1), tool calls (3 → 18), time (26.2s → 120.0s)
[33] (Isolated) Quality unchanged but weighted score is -1.3% due to: tokens (1035964 → 1305820)
[34] (Plugin) Quality unchanged but weighted score is -8.2% due to: tokens (161358 → 292796), quality, time (105.9s → 167.6s)
[35] (Plugin) Quality unchanged but weighted score is -6.2% due to: tokens (113317 → 293182), time (86.4s → 130.9s), tool calls (12 → 18)
[36] (Isolated) Quality unchanged but weighted score is -3.6% due to: tokens (51913 → 93228), time (31.9s → 84.7s), tool calls (7 → 10)
[37] (Isolated) Quality unchanged but weighted score is -6.1% due to: tokens (16384 → 87668), tool calls (0 → 6)
[38] (Isolated) Quality dropped but weighted score is +6.4% due to: tool calls (23 → 5), time (48.6s → 34.5s), tokens (96487 → 86832)
[39] (Plugin) Quality unchanged but weighted score is -0.6% due to: tokens (46576 → 54846)
[40] (Isolated) Quality unchanged but weighted score is -17.5% due to: judgment, tokens (224823 → 381245), tool calls (20 → 32)
[41] (Isolated) Quality unchanged but weighted score is -11.6% due to: tokens (63800 → 179534), quality, tool calls (13 → 21), time (101.7s → 146.2s)
[42] (Plugin) Quality improved but weighted score is -3.1% due to: tokens (12510 → 31402), tool calls (0 → 1)
[43] (Isolated) Quality unchanged but weighted score is -7.2% due to: tokens (104696 → 253934), time (78.7s → 119.9s), tool calls (23 → 31)
[44] (Isolated) Quality unchanged but weighted score is -6.5% due to: tokens (61869 → 111626), tool calls (8 → 13), time (32.1s → 43.8s)
[45] (Isolated) Quality unchanged but weighted score is -22.7% due to: quality, judgment
[46] (Isolated) Quality improved but weighted score is -10.1% due to: judgment, tokens (63720 → 77764)
[47] (Isolated) Quality unchanged but weighted score is -25.0% due to: judgment, quality, tokens (13012 → 77534), tool calls (0 → 6)
[48] (Plugin) Quality unchanged but weighted score is -6.0% due to: tokens (11665 → 30808), tool calls (0 → 1), time (7.2s → 21.1s)
[49] (Plugin) Quality unchanged but weighted score is -0.6% due to: efficiency metrics
[50] (Isolated) Quality unchanged but weighted score is -0.1% due to: efficiency metrics
[51] (Plugin) Quality unchanged but weighted score is -5.3% due to: tokens (23157 → 45721), tool calls (2 → 5), time (10.2s → 17.9s)
[52] (Plugin) Quality unchanged but weighted score is -7.8% due to: tokens (34920 → 63734), tool calls (3 → 10), time (13.7s → 20.2s)

⏰ timeout — run hit the scenario timeout limit; scoring may be impacted by aborting model execution before it could produce its full output

Model: claude-opus-4.6 | Judge: claude-opus-4.6

Full results

[danmoseley]

Several still timed out in table above. But an improvement

[Copilot]

Pull request overview

Increases the GitHub Actions evaluation job timeout to reduce cancellation/timeouts for long-running evaluation runs (notably the dotnet-upgrade matrix leg), improving overall repository health signal and lowering workflow cancellation rates.

Changes:

• Increase evaluate job timeout from 90 minutes to 180 minutes in the reusable evaluation workflow.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

[github-actions]

Skill Validation Results

Skill	Scenario	Quality (Isolated)	Quality (Plugin)	Skills Loaded	Overfit	Verdict
csharp-scripts	Test a C# language feature with a script	3.0/5 → 3.0/5	3.0/5 → 4.0/5 🟢	✅ csharp-scripts; tools: skill, create / ✅ csharp-scripts; tools: skill, create, edit	🟡 0.34	✅
nuget-trusted-publishing	Set up trusted publishing for a new NuGet library	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ nuget-trusted-publishing; tools: skill, task / ✅ nuget-trusted-publishing; tools: skill, task, read_agent	✅ 0.14	✅
nuget-trusted-publishing	Set up NuGet publishing without mentioning trusted publishing	2.0/5 → 5.0/5 🟢	2.0/5 → 4.0/5 🟢	✅ nuget-trusted-publishing; tools: skill, report_intent, glob, view, bash, create / ✅ nuget-trusted-publishing; tools: skill, report_intent, task, view, glob, read_agent, bash, create	✅ 0.14	✅
nuget-trusted-publishing	Migrate existing workflow from API key to trusted publishing	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ nuget-trusted-publishing; tools: skill / ✅ nuget-trusted-publishing; tools: skill	✅ 0.14	✅
dotnet-pinvoke	Generate LibraryImport declaration from C header (.NET 8+)	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-pinvoke; tools: skill / ✅ dotnet-pinvoke; tools: skill	✅ 0.07	✅
dotnet-pinvoke	Generate LibraryImport declaration from C header (.NET Framework)	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ dotnet-pinvoke; tools: skill, report_intent, create / ✅ dotnet-pinvoke; tools: report_intent, skill	✅ 0.07	❌ [1]
dotnet-trace-collect	High CPU in Kubernetes on Linux (.NET 8)	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: report_intent, skill, view, glob, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	❌ [2]
dotnet-trace-collect	.NET Framework on Windows without admin privileges	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	.NET 10 on Linux with root access and native call stacks	1.0/5 → 5.0/5 🟢	1.0/5 → 4.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Memory leak on Linux (.NET 8)	3.0/5 → 3.0/5	3.0/5 → 3.0/5	✅ dotnet-trace-collect; tools: skill, report_intent, view, glob, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Slow requests on Windows with PerfView	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Excessive GC on Linux (.NET 8)	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Hang or deadlock diagnosis on Linux	3.0/5 → 3.0/5	3.0/5 → 3.0/5	✅ dotnet-trace-collect; tools: skill, report_intent, view, glob, bash / ✅ dotnet-trace-collect; tools: report_intent, skill, view	✅ 0.13	✅
dotnet-trace-collect	Windows container high CPU with PerfView	1.0/5 → 4.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	✅
dotnet-trace-collect	Long-running intermittent issue with PerfView triggers	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ dotnet-trace-collect; tools: report_intent, skill, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Linux pre-.NET 10 needing native call stacks	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: report_intent, skill, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Windows modern .NET with admin high CPU	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Memory leak on .NET Framework Windows	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: report_intent, skill, view	✅ 0.13	✅
dotnet-trace-collect	Kubernetes with console access prefers console tools	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ dotnet-trace-collect; tools: report_intent, skill, view, glob, bash / ✅ dotnet-trace-collect; tools: report_intent, skill, view	✅ 0.13	❌ [3]
dotnet-trace-collect	Container installation without .NET SDK	3.0/5 → 1.0/5 🔴	3.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill / ✅ dotnet-trace-collect; tools: skill	✅ 0.13	❌
dotnet-trace-collect	HTTP 500s from downstream service on Linux (.NET 8)	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	❌ [4]
dotnet-trace-collect	Networking timeouts on Windows with admin (.NET 8)	1.0/5 → 5.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
dotnet-trace-collect	Assembly loading failure on Linux (.NET 8)	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dotnet-trace-collect; tools: skill, report_intent, view, glob, bash / ✅ dotnet-trace-collect; tools: skill, report_intent, view	✅ 0.13	✅
microbenchmarking	Investigate runtime upgrade performance impact	3.0/5 → 5.0/5 🟢	3.0/5 → 3.0/5	✅ microbenchmarking; tools: skill, task / ✅ microbenchmarking; tools: skill	✅ 0.10	✅
clr-activation-debugging	Diagnose unexpected FOD dialog from native build tool	1.0/5 → 1.0/5	1.0/5 → 2.0/5 🟢	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	❌ [5]
clr-activation-debugging	Diagnose FOD suppressed but activation still failing	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill, glob / ✅ clr-activation-debugging; tools: skill	✅ 0.07	❌ [6]
clr-activation-debugging	Explain why same binary behaves differently under different launch methods	1.0/5 → 5.0/5 🟢	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	✅
clr-activation-debugging	Analyze healthy managed EXE activation	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	❌ [7]
clr-activation-debugging	Identify multiple activation sequences in a single log	1.0/5 → 2.0/5 🟢	1.0/5 → 1.0/5	✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill	✅ 0.07	✅
clr-activation-debugging	Explain useLegacyV2RuntimeActivationPolicy in activation log	3.0/5 → 4.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ clr-activation-debugging; tools: report_intent, skill / ✅ clr-activation-debugging; tools: report_intent, skill	✅ 0.07	✅
clr-activation-debugging	Decline non-CLR-activation issue	1.0/5 → 5.0/5 🟢	1.0/5 → 5.0/5 🟢	✅ clr-activation-debugging; tools: skill / ℹ️ not activated (expected)	✅ 0.07	✅
analyzing-dotnet-performance	Detects compiled regex startup budget and regex chain allocations	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [8]
analyzing-dotnet-performance	Detects CurrentCulture comparer and compiled regex budget in inflection rules	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [9]
analyzing-dotnet-performance	Finds per-call Dictionary allocation not hoisted to static	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [10]
analyzing-dotnet-performance	Catches compound allocations in recursive number converter with ToLower	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [11]
analyzing-dotnet-performance	Finds StringComparison.Ordinal missing and FrozenDictionary opportunities	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [12]
analyzing-dotnet-performance	Detects Aggregate+Replace chain and struct missing IEquatable	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [13]
analyzing-dotnet-performance	Finds branched Replace chain in format string manipulation	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	✅
analyzing-dotnet-performance	Catches LINQ on hot-path string processing and All(char.IsUpper)	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [14]
analyzing-dotnet-performance	Detects LINQ pipeline in TimeSpan formatting and collection processing	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [15]
analyzing-dotnet-performance	Flags Span inconsistencies and compound method chains in truncation library	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [16]
analyzing-dotnet-performance	Identifies unsealed leaf classes and locale hierarchy patterns	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.13	❌ [17]
android-tombstone-symbolication	Symbolicate .NET frames in an Android tombstone	4.0/5 → 5.0/5 🟢	4.0/5 → 2.0/5 🔴	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill, read_bash, stop_bash	✅ 0.12	✅ [18]
android-tombstone-symbolication	Recognize tombstone with no .NET frames	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ android-tombstone-symbolication; tools: skill, bash / ✅ android-tombstone-symbolication; tools: skill, bash	✅ 0.12	❌ [19]
android-tombstone-symbolication	Symbolicate CoreCLR frames in an Android tombstone	2.0/5 ⏰ → 5.0/5 🟢	2.0/5 ⏰ → 3.0/5 🟢	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill	✅ 0.12	✅
android-tombstone-symbolication	Recognize NativeAOT tombstone with app binary and libSystem.Native.so	3.0/5 → 4.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill, read_bash, stop_bash	✅ 0.12	✅
android-tombstone-symbolication	Symbolicate multi-thread tombstone	2.0/5 ⏰ → 4.0/5 🟢	2.0/5 ⏰ → 5.0/5 🟢	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill	✅ 0.12	✅
android-tombstone-symbolication	Handle .NET frames with no BuildId metadata	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ android-tombstone-symbolication; tools: skill, bash / ✅ android-tombstone-symbolication; tools: skill, bash	✅ 0.12	❌ [20]
android-tombstone-symbolication	Symbolicate tombstone with multiple .NET libraries and different BuildIds	4.0/5 → 4.0/5	4.0/5 → 1.0/5 ⏰ 🔴	✅ android-tombstone-symbolication; tools: skill / ✅ android-tombstone-symbolication; tools: skill, read_bash	✅ 0.12	❌
android-tombstone-symbolication	Reject iOS crash log as wrong format	5.0/5 → 5.0/5	5.0/5 → 5.0/5	ℹ️ not activated (expected) / ℹ️ not activated (expected)	✅ 0.12	❌ [21]
dump-collect	Configure automatic crash dumps for CoreCLR app on Linux	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ dump-collect; tools: report_intent, skill, view, bash / ✅ dump-collect; tools: skill, report_intent, view	🟡 0.28	❌ [22]
dump-collect	Set up NativeAOT crash dumps with createdump in Kubernetes	2.0/5 → 2.0/5	2.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	🟡 0.28	❌ [23]
dump-collect	Recover crash dump from macOS NativeAOT without createdump	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill, report_intent, view, bash / ✅ dump-collect; tools: skill, report_intent, view	🟡 0.28	✅
dump-collect	Configure CoreCLR dump collection in Alpine Docker as non-root	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	🟡 0.28	✅
dump-collect	Advisory: macOS NativeAOT crash dump recovery steps	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	🟡 0.28	✅
dump-collect	Advisory: CoreCLR Alpine Docker non-root configuration	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	🟡 0.28	✅
dump-collect	Advisory: NativeAOT Kubernetes dump collection setup	3.0/5 → 3.0/5	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: report_intent, skill, view, bash / ✅ dump-collect; tools: skill, report_intent, view	🟡 0.28	❌ [24]
dump-collect	Detect runtime and configure crash dumps for unknown .NET app on Linux	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ dump-collect; tools: skill / ✅ dump-collect; tools: skill	🟡 0.28	✅
dump-collect	Decline dump analysis request	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	ℹ️ not activated (expected) / ℹ️ not activated (expected)	🟡 0.28	✅
optimizing-ef-core-queries	Optimize bulk operations with EF Core 7+ ExecuteUpdate and ExecuteDelete	4.0/5 → 4.0/5	4.0/5 → 4.0/5	✅ optimizing-ef-core-queries; tools: report_intent, skill / ✅ optimizing-ef-core-queries; tools: report_intent, skill	🟡 0.31	❌ [25]
build-parallelism	Analyze build parallelism bottlenecks	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ build-parallelism; tools: skill, task, glob / ✅ build-parallelism; binlog-generation; tools: skill, task, glob	✅ 0.15	❌ [26]
including-generated-files	Diagnose generated file inclusion failure	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ including-generated-files; tools: skill / ✅ including-generated-files; tools: skill	🟡 0.21	✅
msbuild-antipatterns	Review MSBuild files for anti-patterns and style issues	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ msbuild-antipatterns; tools: skill, glob, task, read_agent, bash, edit / ✅ msbuild-antipatterns; tools: skill	✅ 0.07	❌ [27]
build-perf-baseline	Establish build performance baseline and recommend optimizations	4.0/5 → 5.0/5 🟢	4.0/5 → 4.0/5	✅ build-perf-baseline; tools: skill / ✅ build-perf-baseline; build-perf-diagnostics; msbuild-antipatterns; binlog-failure-analysis; tools: skill	🟡 0.29	✅
msbuild-modernization	Modernize legacy project to SDK-style	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ msbuild-modernization; tools: skill, edit, bash / ✅ msbuild-modernization; tools: skill	✅ 0.06	✅
directory-build-organization	Organize build infrastructure for a multi-project repo	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ directory-build-organization; tools: skill, create, edit, bash / ✅ msbuild-antipatterns; directory-build-organization; tools: skill, create, edit, bash	✅ 0.15	✅
check-bin-obj-clash	Diagnose bin/obj output path clashes	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ check-bin-obj-clash; tools: skill, glob / ✅ check-bin-obj-clash; tools: skill, glob	✅ 0.14	❌ [28]
incremental-build	Analyze incremental build issues	3.0/5 → 3.0/5	3.0/5 → 3.0/5	✅ incremental-build; tools: skill / ✅ incremental-build; tools: skill	✅ 0.13	✅
eval-performance	Analyze MSBuild evaluation performance issues	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ eval-performance; tools: skill / ✅ eval-performance; tools: skill	✅ 0.11	✅
build-perf-diagnostics	Analyze analyzer performance impact on builds	3.0/5 ⏰ → 5.0/5 🟢	3.0/5 ⏰ → 5.0/5 🟢	✅ build-perf-diagnostics; tools: skill / ✅ binlog-generation; build-perf-diagnostics; tools: skill	✅ 0.19	✅
binlog-generation	Build project with /bl flag	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ binlog-generation; tools: skill / ✅ binlog-generation; tools: skill	🟡 0.41	✅
binlog-generation	Build with /bl in PowerShell	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ binlog-generation; tools: skill / ✅ binlog-generation; tools: skill	🟡 0.41	✅
binlog-generation	Build multiple configurations with unique binlogs	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ binlog-generation; tools: skill / ✅ binlog-generation; tools: skill	🟡 0.41	✅
binlog-failure-analysis	Diagnose build failures from binlog only (no source files)	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ binlog-failure-analysis; tools: skill / ✅ binlog-failure-analysis; tools: skill	✅ 0.04	✅
dotnet-maui-doctor	Plan macOS MAUI setup with Xcode	3.0/5 → 1.0/5 ⏰ 🔴	3.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill, web_fetch / ✅ dotnet-maui-doctor; tools: skill	🟡 0.22	❌
dotnet-maui-doctor	Plan Linux MAUI environment for Android	3.0/5 → 1.0/5 ⏰ 🔴	3.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill, view / ✅ dotnet-maui-doctor; tools: skill, view	🟡 0.22	❌
dotnet-maui-doctor	Guardrail against workload update and repair	1.0/5 → 3.0/5 🟢	1.0/5 → 3.0/5 🟢	✅ dotnet-maui-doctor; tools: report_intent, skill / ✅ dotnet-maui-doctor; tools: report_intent, skill	🟡 0.22	✅
dotnet-maui-doctor	Diagnose non-Microsoft JDK causing build failure	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: skill / ✅ dotnet-maui-doctor; tools: skill	🟡 0.22	✅
dotnet-maui-doctor	Plan complete MAUI setup on Windows	4.0/5 → 3.0/5 🔴	4.0/5 → 4.0/5	✅ dotnet-maui-doctor; tools: skill, bash / ✅ dotnet-maui-doctor; tools: skill	🟡 0.22	❌
dotnet-maui-doctor	Prevent incorrect JAVA_HOME configuration	2.0/5 → 5.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: report_intent, skill / ✅ dotnet-maui-doctor; tools: report_intent, skill, view	🟡 0.22	✅
dotnet-maui-doctor	Determine required Android SDK packages for specific .NET version	2.0/5 → 4.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ dotnet-maui-doctor; tools: report_intent, skill, view, bash / ✅ dotnet-maui-doctor; tools: report_intent, skill, view	🟡 0.22	✅
dotnet-maui-doctor	Fix stale MAUI workloads after SDK update	2.0/5 → 4.0/5 🟢	2.0/5 → 4.0/5 🟢	✅ dotnet-maui-doctor; tools: skill / ✅ dotnet-maui-doctor; tools: skill	🟡 0.22	✅
technology-selection	ML.NET classification on tabular data	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill, task	🟡 0.38	✅
technology-selection	LLM integration with MEAI abstraction	1.0/5 → 3.0/5 🟢	1.0/5 → 3.0/5 🟢	✅ technology-selection; tools: skill, task / ✅ technology-selection; tools: skill	🟡 0.38	✅
technology-selection	Reject LLM for tabular classification	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ technology-selection; tools: skill, task, create / ✅ technology-selection; tools: skill	🟡 0.38	✅
technology-selection	Agentic workflow with guardrails	2.0/5 → 1.0/5 ⏰ 🔴	2.0/5 → 1.0/5 ⏰ 🔴	✅ technology-selection; tools: skill, task / ✅ technology-selection; tools: skill, task	🟡 0.38	❌
technology-selection	Natural-language scenario decomposition — RAG chatbot	3.0/5 → 4.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill	🟡 0.38	✅
technology-selection	RAG pipeline with vector search	3.0/5 → 5.0/5 🟢	3.0/5 → 4.0/5 🟢	✅ technology-selection; tools: skill / ✅ technology-selection; tools: skill	🟡 0.38	✅
migrate-dotnet9-to-dotnet10	Console app with System.Linq.Async, SIGTERM, and BufferedStream	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌ [29]
migrate-dotnet9-to-dotnet10	Expression tree code broken by C# 14 span overload resolution	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view	—	❌ [30]
migrate-dotnet9-to-dotnet10	ASP.NET Core app with WebHostBuilder, OpenAPI, and forwarded headers	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	ASP.NET Core app with OpenAPI transformers using Microsoft.OpenApi v1 APIs	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	✅
migrate-dotnet9-to-dotnet10	EF Core app with Azure SQL JSON columns and parameterized collections	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	❌
migrate-dotnet9-to-dotnet10	EF Core app with dynamic ExecuteUpdate and complex types	5.0/5 → 2.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌
migrate-dotnet9-to-dotnet10	SQLite app with DateTimeOffset timezone handling	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌ [31]
migrate-dotnet9-to-dotnet10	Worker service with config null array binding and ProviderAlias assembly change	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	Cryptography app with OpenSSL, X.509, and Rfc2898DeriveBytes	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	❌
migrate-dotnet9-to-dotnet10	SDK and NuGet obscure tooling changes	4.0/5 → 3.0/5 🔴	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅ [32]
migrate-dotnet9-to-dotnet10	JSON polymorphism with conflicting property names and XmlSerializer	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	WinForms and WPF desktop app with System.Drawing and DynamicResource	2.0/5 → 3.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	Containerized single-file app with P/Invoke and IDispatchEx	4.0/5 → 3.0/5 🔴	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	❌
migrate-dotnet9-to-dotnet10	App using SslStream properties and SystemEvents	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	Library with NuGet auditing, transitive deps, and InlineArray	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill, report_intent, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view	—	✅
migrate-dotnet9-to-dotnet10	C# 14 compiler breaking changes — field keyword, extension keyword, disposal	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet9-to-dotnet10; tools: skill / ✅ migrate-dotnet9-to-dotnet10; tools: skill	—	✅
migrate-dotnet9-to-dotnet10	Blazor WASM app with generic math shift masking and tar operations	5.0/5 → 3.0/5 🔴	5.0/5 → 4.0/5 🔴	✅ migrate-dotnet9-to-dotnet10; tools: skill, view, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view	—	❌
migrate-dotnet8-to-dotnet9	App with empty environment variables, ZIP encoding, and keyed DI services	4.0/5 → 3.0/5 🔴	4.0/5 → 4.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	❌
migrate-dotnet8-to-dotnet9	C# 13 compiler breaking changes — InlineArray on record, iterator safe context, collection expressions	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill, report_intent, view, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill, report_intent, view	✅ 0.08	✅
migrate-dotnet8-to-dotnet9	ASP.NET Core app with DI validation, forwarded headers, and HttpClientFactory casting	2.0/5 → 3.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill, create / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	✅
migrate-dotnet8-to-dotnet9	EF Core app with migration patterns and Cosmos DB discriminator	4.0/5 → 3.0/5 🔴	4.0/5 → 4.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	❌
migrate-dotnet8-to-dotnet9	EF Core Cosmos DB app with existing documents and composite id format	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	✅
migrate-dotnet8-to-dotnet9	App with JsonDocument null deserialization and BinaryFormatter fallback	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	✅
migrate-dotnet8-to-dotnet9	CI pipeline with Terminal Logger parsing and version constraints	2.0/5 → 3.0/5 🟢	2.0/5 → 5.0/5 🟢	ℹ️ not activated (expected) / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	✅
migrate-dotnet8-to-dotnet9	WinForms app with custom UserControls and PictureBox URL loading	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	❌ [33]
migrate-dotnet8-to-dotnet9	Containerized app with zlib dependency and runtime configuration	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	❌ [34]
migrate-dotnet8-to-dotnet9	EF Core Cosmos DB app with discriminator and sync I/O	5.0/5 → 3.0/5 🔴	5.0/5 → 4.0/5 🔴	✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	❌
migrate-dotnet8-to-dotnet9	Library with String.Trim span overload, keyed services, and InlineArray	3.0/5 → 3.0/5	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash	✅ 0.08	❌ [35]
migrate-dotnet8-to-dotnet9	Containerized app with env var precedence reversal and zlib removal	5.0/5 → 4.0/5 🔴	5.0/5 → 5.0/5	✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill	✅ 0.08	❌
thread-abort-migration	Worker thread with abort-based cancellation	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ thread-abort-migration; tools: skill / ✅ thread-abort-migration; tools: skill	✅ 0.08	✅
thread-abort-migration	Timeout enforcement via Thread.Abort	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ thread-abort-migration; tools: skill, report_intent, bash / ✅ thread-abort-migration; tools: skill	✅ 0.08	❌ [36]
thread-abort-migration	Blocking WaitHandle with Thread.Interrupt	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ thread-abort-migration; tools: skill / ✅ thread-abort-migration; tools: report_intent, skill	✅ 0.08	✅
thread-abort-migration	ASP.NET Response.End and Response.Redirect with Thread.Abort	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ thread-abort-migration; tools: skill, report_intent, bash / ✅ thread-abort-migration; tools: report_intent, skill	✅ 0.08	✅
thread-abort-migration	Thread.Join and Thread.Sleep only — should not migrate	3.0/5 → 5.0/5 🟢	3.0/5 → 5.0/5 🟢	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.08	✅
migrate-nullable-references	Enable NRT in a small library with mixed nullability	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-nullable-references; tools: skill / ✅ migrate-nullable-references; tools: skill	✅ 0.06	❌ [37]
migrate-nullable-references	File-by-file migration: only modify the targeted file	5.0/5 → 5.0/5	5.0/5 → 5.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.06	❌ [38]
migrate-nullable-references	Enable NRT in ASP.NET Core Web API with EF Core	3.0/5 → 3.0/5	3.0/5 → 3.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.06	✅
dotnet-aot-compat	Make Azure.ResourceManager AOT-compatible	2.0/5 ⏰ → 2.0/5 ⏰	2.0/5 ⏰ → 2.0/5 ⏰	✅ dotnet-aot-compat; tools: skill, read_agent / ✅ dotnet-aot-compat; tools: skill	✅ 0.12	✅
migrate-dotnet10-to-dotnet11	Console app with compression and TAR operations	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	✅
migrate-dotnet10-to-dotnet11	C# 15 compiler breaking changes — Span safe-context, nameof, with()	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view, bash / ✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view	✅ 0.04	❌ [39]
migrate-dotnet10-to-dotnet11	EF Core app with Cosmos DB provider using sync APIs	4.0/5 → 4.0/5	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	✅
migrate-dotnet10-to-dotnet11	Deployment to older hardware with minimum requirement changes	5.0/5 → 5.0/5	5.0/5 → 5.0/5	✅ migrate-dotnet10-to-dotnet11; tools: skill / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	✅
migrate-dotnet10-to-dotnet11	Cryptography app using DSA on macOS	4.0/5 → 5.0/5 🟢	4.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill, bash / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	❌ [40]
migrate-dotnet10-to-dotnet11	Basic TFM update with Docker and global.json	3.0/5 → 4.0/5 🟢	3.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: skill / ✅ migrate-dotnet10-to-dotnet11; tools: skill	✅ 0.04	✅
migrate-dotnet10-to-dotnet11	C# 15 dynamic operator and ref readonly delegate issues	2.0/5 → 4.0/5 🟢	2.0/5 → 5.0/5 🟢	✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view, bash / ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view	✅ 0.04	✅
run-tests	Run tests in a VSTest MSTest project	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ⚠️ NOT ACTIVATED	✅ 0.17	✅
run-tests	Run tests with trx reporting on MTP project (SDK 9)	4.0/5 → 4.0/5	4.0/5 → 3.0/5 🔴	✅ run-tests; tools: skill / ✅ run-tests; tools: skill, glob	✅ 0.17	✅
run-tests	Run tests with blame-hang on MTP project (SDK 10)	1.0/5 → 1.0/5	1.0/5 → 1.0/5	⚠️ NOT ACTIVATED / ✅ run-tests; tools: skill	✅ 0.17	❌ [41]
run-tests	Run tests in a multi-TFM project targeting a specific framework	2.0/5 → 3.0/5 🟢	2.0/5 → 2.0/5	✅ run-tests; tools: skill / ✅ run-tests; tools: skill	✅ 0.17	✅
run-tests	Filter MSTest tests by category on VSTest	1.0/5 → 2.0/5 🟢	1.0/5 → 2.0/5 🟢	✅ run-tests; tools: skill / ✅ run-tests; tools: skill, grep	✅ 0.17	✅
run-tests	Filter NUnit tests by class name on VSTest	2.0/5 → 2.0/5	2.0/5 → 2.0/5	✅ run-tests; tools: skill / ✅ run-tests; tools: skill	✅ 0.17	✅
run-tests	Filter xUnit v3 tests by class on MTP	1.0/5 → 2.0/5 🟢	1.0/5 → 2.0/5 🟢	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill	✅ 0.17	✅
run-tests	Filter xUnit v3 tests by trait on MTP	1.0/5 → 2.0/5 🟢	1.0/5 → 2.0/5 🟢	✅ run-tests; tools: skill, glob / ✅ run-tests; tools: skill, glob	✅ 0.17	✅
run-tests	Filter TUnit tests by class using treenode-filter	1.0/5 → 5.0/5 🟢	1.0/5 → 4.0/5 🟢	✅ run-tests; tools: skill, bash / ✅ run-tests; tools: skill	✅ 0.17	✅
run-tests	Combine multiple filter criteria on VSTest MSTest	3.0/5 → 5.0/5 🟢	3.0/5 → 3.0/5	✅ run-tests; tools: skill, bash / ✅ run-tests; tools: skill, bash	✅ 0.17	✅
run-tests	MTP project on SDK 9 must use -- separator for args	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ run-tests; tools: skill, glob, bash / ✅ run-tests; tools: bash, skill	✅ 0.17	❌ [42]
run-tests	MTP project on SDK 10 passes args directly	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ run-tests; tools: skill / ✅ run-tests; tools: skill, glob	✅ 0.17	❌ [43]
run-tests	Detect test platform from Directory.Build.props	1.0/5 → 2.0/5 🟢	1.0/5 → 2.0/5 🟢	✅ run-tests; tools: skill / ✅ run-tests; tools: skill	✅ 0.17	✅
run-tests	Negative test: do not use MTP syntax for a VSTest project	1.0/5 → 1.0/5	1.0/5 → 1.0/5	✅ run-tests; tools: skill, bash / ✅ run-tests; tools: skill, bash	✅ 0.17	❌ [44]

[1] (Isolated) Quality unchanged but weighted score is -25.0% due to: completion (✓ → ✗), tokens (11871 → 49060), tool calls (0 → 3), time (10.6s → 24.6s)
[2] (Isolated) Quality improved but weighted score is -2.0% due to: tokens (12008 → 88884), tool calls (0 → 7), time (18.7s → 38.1s)
[3] (Plugin) Quality unchanged but weighted score is -10.0% due to: tokens (11664 → 53797), tool calls (0 → 4), time (9.5s → 21.1s)
[4] (Plugin) Quality unchanged but weighted score is -6.8% due to: tokens (11707 → 53835), tool calls (0 → 3), time (9.7s → 23.5s)
[5] (Isolated) Quality unchanged but weighted score is -4.5% due to: tokens (47172 → 67767), tool calls (4 → 6), time (17.4s → 24.7s)
[6] (Isolated) Quality unchanged but weighted score is -7.9% due to: tokens (47222 → 87059), tool calls (4 → 9), time (21.6s → 31.7s)
[7] (Plugin) Quality unchanged but weighted score is -4.6% due to: tokens (34953 → 51251), tool calls (3 → 5), time (14.5s → 18.2s)
[8] (Plugin) Quality unchanged but weighted score is -0.2% due to: tokens (35175 → 39041)
[9] (Isolated) Quality unchanged but weighted score is -0.2% due to: efficiency metrics
[10] (Plugin) Quality unchanged but weighted score is -0.5% due to: tokens (34984 → 38937)
[11] (Plugin) Quality unchanged but weighted score is -0.4% due to: tokens (34951 → 38920)
[12] (Isolated) Quality unchanged but weighted score is -0.1% due to: efficiency metrics
[13] (Plugin) Quality unchanged but weighted score is -0.6% due to: tokens (34950 → 38919)
[14] (Isolated) Quality unchanged but weighted score is -4.2% due to: tokens (34840 → 49022), time (11.8s → 18.0s), tool calls (3 → 4)
[15] (Isolated) Quality unchanged but weighted score is -3.5% due to: tokens (34847 → 48868), tool calls (3 → 4), time (14.2s → 18.2s)
[16] (Plugin) Quality unchanged but weighted score is -1.1% due to: tokens (46884 → 52073), time (15.4s → 18.7s)
[17] (Plugin) Quality unchanged but weighted score is -0.7% due to: tokens (34844 → 38803)
[18] (Plugin) Quality dropped but weighted score is +0.4% due to: efficiency metrics
[19] (Plugin) Quality unchanged but weighted score is -7.7% due to: tokens (24462 → 45796), tool calls (2 → 5), time (14.2s → 18.9s)
[20] (Plugin) Quality unchanged but weighted score is -8.3% due to: tokens (24771 → 64285), tool calls (2 → 7), time (21.8s → 28.9s)
[21] (Plugin) Quality unchanged but weighted score is -0.5% due to: tokens (24779 → 27381)
[22] (Isolated) Quality unchanged but weighted score is -9.6% due to: tokens (11919 → 53950), tool calls (0 → 5), time (15.5s → 28.7s)
[23] (Isolated) Quality unchanged but weighted score is -15.6% due to: judgment, quality, tokens (59556 → 85241)
[24] (Isolated) Quality unchanged but weighted score is -10.0% due to: tokens (12530 → 85528), tool calls (0 → 8), time (21.7s → 44.1s)
[25] (Plugin) Quality unchanged but weighted score is -12.4% due to: tokens (11823 → 26403), quality, tool calls (0 → 2), time (8.2s → 15.5s)
[26] (Isolated) Quality unchanged but weighted score is -1.1% due to: tool calls (20 → 26)
[27] (Isolated) Quality unchanged but weighted score is -6.4% due to: tokens (40942 → 245957), tool calls (11 → 26), time (49.6s → 91.3s)
[28] (Isolated) Quality improved but weighted score is -3.3% due to: tokens (161799 → 232443), tool calls (13 → 19)
[29] (Isolated) Quality unchanged but weighted score is -10.8% due to: tokens (48059 → 107205), quality, time (32.2s → 50.6s)
[30] (Isolated) Quality unchanged but weighted score is -6.0% due to: tokens (16856 → 106862), tool calls (0 → 7)
[31] (Isolated) Quality unchanged but weighted score is -11.8% due to: tokens (51406 → 106090), quality, time (19.7s → 38.2s), tool calls (4 → 6)
[32] (Isolated) Quality dropped but weighted score is +4.0% due to: tokens (354864 → 129356), tool calls (40 → 8), time (130.8s → 72.0s)
[33] (Isolated) Quality improved but weighted score is -14.3% due to: judgment, quality, tool calls (22 → 27)
[34] (Plugin) Quality unchanged but weighted score is -4.4% due to: tokens (65123 → 122538), tool calls (16 → 22)
[35] (Isolated) Quality unchanged but weighted score is -24.7% due to: completion (✓ → ✗), tokens (73672 → 211011), time (58.1s → 114.2s), tool calls (14 → 27)
[36] (Isolated) Quality improved but weighted score is -4.9% due to: tokens (12625 → 46026), tool calls (0 → 3), time (19.2s → 36.5s)
[37] (Isolated) Quality unchanged but weighted score is -6.9% due to: tokens (125325 → 277852), time (60.9s → 94.0s), tool calls (24 → 29)
[38] (Isolated) Quality unchanged but weighted score is -8.9% due to: tokens (74984 → 158087), time (32.1s → 61.2s), tool calls (9 → 15)
[39] (Isolated) Quality unchanged but weighted score is -6.1% due to: tokens (15444 → 77941), tool calls (0 → 5)
[40] (Isolated) Quality improved but weighted score is -18.5% due to: quality, tokens (24857 → 94180), tool calls (2 → 7)
[41] (Plugin) Quality unchanged but weighted score is -4.5% due to: tokens (35065 → 53537), time (16.9s → 24.2s), tool calls (3 → 4)
[42] (Plugin) Quality unchanged but weighted score is -9.5% due to: tokens (23206 → 53483), tool calls (2 → 4), time (10.4s → 18.8s)
[43] (Plugin) Quality unchanged but weighted score is -8.6% due to: tokens (34961 → 63026), tool calls (3 → 7), time (11.3s → 20.7s)
[44] (Plugin) Quality unchanged but weighted score is -26.0% due to: quality, tokens (23058 → 63103), tool calls (2 → 5), time (7.8s → 23.6s)

⏰ timeout — run hit the scenario timeout limit; scoring may be impacted by aborting model execution before it could produce its full output

Model: claude-opus-4.6 | Judge: claude-opus-4.6

Full results