Skip to content

Skill quality dashboard: path adherence scoring, token tracking, and CI pipeline #1102

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kvenkatrajan merged 8 commits into from
Mar 3, 2026
+1,181 −3
Merged

Skill quality dashboard: path adherence scoring, token tracking, and CI pipeline #1102

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
6264516
Add skill quality dashboard: trace parser, path adherence, and CI pip…
banibrata-de Mar 2, 2026
d3c78fa
fix: add ESM __dirname polyfill to resource/create integration test
banibrata-de Mar 2, 2026
ba72b4b
fix: resolve ESLint errors in generate-quality-report.js
banibrata-de Mar 2, 2026
503bd50
fix: resolve CodeQL TOCTOU race condition in token summary write
banibrata-de Mar 2, 2026
969a20e
fix: remove unused functions and token cost fields
banibrata-de Mar 3, 2026
2ce9a93
fix: address Copilot PR review comments
banibrata-de Mar 3, 2026
a2782e1
Address all PR review comments from JasonYe and Copilot reviewer
banibrata-de Mar 3, 2026
15558d9
Address JasonYe review: remove markdown fallback, redact full JSON, f…
banibrata-de Mar 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .github/workflows/test-all-integration.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -292,6 +292,10 @@ jobs:
echo "No skill report found"
fi

- name: Generate quality report
if: always()
run: npm run quality-report || true

- name: Export report
if: always()
id: export-report
Expand Down
5 changes: 5 additions & 0 deletions tests/microsoft-foundry/resource/create/integration.test.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,13 @@
* Tests the skill"s behavior when invoked with real scenarios
*/

import * as path from "path";
import { fileURLToPath } from "url";
import { loadSkill, type LoadedSkill } from "../../../utils/skill-loader";

const __filename = fileURLToPath(import.meta.url);
const __dirname = path.dirname(__filename);

const SKILL_NAME = "microsoft-foundry";

describe(`${SKILL_NAME}_resource-create - Integration Tests`, () => {
Expand Down
1 change: 1 addition & 0 deletions tests/package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@
"coverage:grid": "node scripts/generate-coverage-grid.js",
"report": "npx tsx scripts/generate-test-reports.ts",
"results": "node scripts/show-test-results.js",
"quality-report": "node scripts/generate-quality-report.js",
"update:snapshots": "node scripts/update-snapshots.js",
"typecheck": "tsc --noEmit",
"lint": "eslint",
Expand Down
Loading
Loading