-
Notifications
You must be signed in to change notification settings - Fork 34
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Problem Statement
With the fix for issue #309, leaderboard submissions can now include assessments with fewer than 25 attributes (when --exclude is used). However, users viewing the leaderboard have no way to know if a submission used exclusions, making it difficult to compare scores fairly.
Proposed Solution
Add a visual indicator on the leaderboard UI to show when a submission has excluded attributes. This could be:
- A badge or icon next to the score (e.g., "22/25 attributes")
- A tooltip explaining which attributes were excluded
- A filter option to show only full assessments (25/25)
Alternatives Considered
- Reject exclusions for leaderboard — Too restrictive; some attributes may not apply to all projects
- Separate leaderboards — Full vs. partial assessments; adds complexity
- Score normalization — Adjust scores based on attributes assessed; could be misleading
Use Cases
- User wants to compare their full assessment against others and filter out partial submissions
- User wants to understand why a project has a high score with fewer attributes
- Maintainer wants to identify trends in which attributes are commonly excluded
Additional Context
Related to issue #309 (schema validation fix) which enabled partial assessments to be submitted.
The attributes_total and attributes_assessed fields are already present in the assessment JSON, so no data changes are needed — only UI updates.
Acceptance Criteria
- Leaderboard shows attribute count (e.g., "22/25") for each submission
- Submissions with < 25 attributes have a visual indicator (badge, icon, or color)
- Optional: Filter to show only full assessments (25/25)
- Optional: Tooltip showing which attributes were excluded (if available in metadata)
Priority
- Medium (nice to have)
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request