Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Eval modalities #1

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

Eval modalities #1

wants to merge 10 commits into from

Commits on Feb 5, 2024

  1. feat: Add support for models from modalities

    @rrutmann
    rrutmann committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    1f711cf View commit details
    Browse the repository at this point in the history

  2. test(eval): Test models from modalities

    @rrutmann
    rrutmann committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    51a0cf5 View commit details
    Browse the repository at this point in the history

  3. test(modalities): Pass max_length to greedy_until

    @rrutmann
    rrutmann committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    b304f2d View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. refactor(HF_test): Test greedy_until() for 20 tokens

    @ajude2s
    ajude2s committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    1908cd8 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. Update tests/test_models.py 

    Co-authored-by: Alexander Weber <[email protected]>
    @ajude2s @lllAlexanderlll
    ajude2s and lllAlexanderlll committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    5ef5928 View commit details
    Browse the repository at this point in the history

  2. fix(eval): Using the array accessor instead

    @ajude2s
    ajude2s committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    03b7c20 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/eval_modalities' into eval_modal… 

    …ities
    @ajude2s
    ajude2s committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    ba25e26 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. feat(checkpointing): 

    - Added support for evaluation of Mamba model
    @ajude2s
    ajude2s committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    7c5a9c0 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. feat(Modalities): Adapted eval harness to be able to evaluate generic… 

    … modalities models.
    @ajude2s
    ajude2s committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    09dd787 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. feat(DownstreamEval): 

    Adapted for modalities
    @ajude2s
    ajude2s committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    bf873c6 View commit details
    Browse the repository at this point in the history