Skip to content

Conversation

@mitalipo
Copy link
Contributor

@mitalipo mitalipo commented Mar 10, 2025

Description

This PR adds a script to generate Model Cards to document model details and analyze performance of language models on benchmarks. Review #236 for more detail.

Issues

#236

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)

Dependencies

Development and tools:

  • python ">=3.10, <3.12"

New added Dependencies

Tests

Unittests located here: https://github.com/mitalipo/GenAIEval/blob/mitalipo/model-card/tests/test_model_card_gen.py

@joshuayao joshuayao linked an issue Mar 13, 2025 that may be closed by this pull request
@ashahba ashahba marked this pull request as ready for review March 14, 2025 16:43
@ashahba ashahba requested a review from lkk12014402 as a code owner March 14, 2025 16:43
@qgao007 qgao007 self-requested a review March 14, 2025 16:50
@ashahba ashahba added the WIP label Mar 14, 2025
@ashahba ashahba added this to the v1.3 milestone Mar 14, 2025
Copy link
Contributor

@daniel-de-leon-user293 daniel-de-leon-user293 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@qgao007 qgao007 removed the WIP label Mar 25, 2025
Copy link
Collaborator

@qgao007 qgao007 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Copy link
Collaborator

@ashahba ashahba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ashahba ashahba merged commit 2e10d19 into opea-project:main Apr 1, 2025
13 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Model Card for Language Model Performance

5 participants