Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,306 workflow runs
3,306 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Remove newline that broke unimodal task list table Unit Tests #5721: Pull request #3489 opened by ntenenz
Action required ntenenz:patch-1
ntenenz:patch-1
Action required
Remove newline that broke unimodal task list table Tasks Modified #5748: Pull request #3489 opened by ntenenz
Action required ntenenz:patch-1
ntenenz:patch-1
Action required
Add Task (Financial mmlu ko) Unit Tests #5720: Pull request #2699 synchronize by choics2623
Action required choics2623:financial_mmlu_ko
choics2623:financial_mmlu_ko
Action required
Add Task (Financial mmlu ko) Tasks Modified #5747: Pull request #2699 synchronize by choics2623
Action required choics2623:financial_mmlu_ko
choics2623:financial_mmlu_ko
Action required
feat: Add hf-mistral3 adapter for Ministral-3 models (#3487) Tasks Modified #5746: Commit 249f53e pushed by baberabb
10s main
main
10s
feat: Add hf-mistral3 adapter for Ministral-3 models (#3487) Unit Tests #5719: Commit 249f53e pushed by baberabb
4m 21s main
main
4m 21s
Add IFEval tasks in Spanish and Catalan (#3467) Tasks Modified #5745: Commit d03c492 pushed by baberabb
30s main
main
30s
Add IFEval tasks in Spanish and Catalan (#3467) Unit Tests #5718: Commit d03c492 pushed by baberabb
4m 35s main
main
4m 35s
Add truthfulqa_va to catalan bench (#3469) Unit Tests #5717: Commit bcbaa4d pushed by baberabb
4m 16s main
main
4m 16s
Add truthfulqa_va to catalan bench (#3469) Tasks Modified #5744: Commit bcbaa4d pushed by baberabb
53s main
main
53s
OpenAI Multilingual MMLU (#3473) Tasks Modified #5743: Commit 1f34bdc pushed by baberabb
25m 51s main
main
25m 51s
OpenAI Multilingual MMLU (#3473) Unit Tests #5716: Commit 1f34bdc pushed by baberabb
4m 19s main
main
4m 19s
Update get_tokenizer import for vLLM compatibility (#3482) Tasks Modified #5742: Commit 1c29f83 pushed by baberabb
14s main
main
14s
Update get_tokenizer import for vLLM compatibility (#3482) Unit Tests #5715: Commit 1c29f83 pushed by baberabb
4m 11s main
main
4m 11s
fix: handle a=0 as valid answer index in build_qa_turn (#3488) Tasks Modified #5741: Commit 05b5abc pushed by baberabb
40s main
main
40s
fix: handle a=0 as valid answer index in build_qa_turn (#3488) Unit Tests #5714: Commit 05b5abc pushed by baberabb
4m 29s main
main
4m 29s
fix: handle a=0 as valid answer index in build_qa_turn Tasks Modified #5740: Pull request #3488 opened by ezylopx5
38s ezylopx5:fix/fewshot-answer-index-zero
ezylopx5:fix/fewshot-answer-index-zero
38s
fix: handle a=0 as valid answer index in build_qa_turn Unit Tests #5713: Pull request #3488 opened by ezylopx5
4m 28s ezylopx5:fix/fewshot-answer-index-zero
ezylopx5:fix/fewshot-answer-index-zero
4m 28s
feat: Add hf-mistral3 adapter for Ministral-3 models Tasks Modified #5739: Pull request #3487 opened by medhakimbedhief
10s medhakimbedhief:feature/hf-mistral3-adapter
medhakimbedhief:feature/hf-mistral3-adapter
10s
feat: Add hf-mistral3 adapter for Ministral-3 models Unit Tests #5712: Pull request #3487 opened by medhakimbedhief
4m 48s medhakimbedhief:feature/hf-mistral3-adapter
medhakimbedhief:feature/hf-mistral3-adapter
4m 48s
feat: support local directory as dataset_path Unit Tests #5711: Pull request #3485 opened by fanjingxiang
Action required fanjingxiang:local-dataset-support
fanjingxiang:local-dataset-support
Action required
feat: support local directory as dataset_path Tasks Modified #5738: Pull request #3485 opened by fanjingxiang
Action required fanjingxiang:local-dataset-support
fanjingxiang:local-dataset-support
Action required
Added ULQA benchmark Unit Tests #5710: Pull request #3340 synchronize by keramjan
Action required keramjan:ulqa
keramjan:ulqa
Action required
Added ULQA benchmark Tasks Modified #5737: Pull request #3340 synchronize by keramjan
Action required keramjan:ulqa
keramjan:ulqa
Action required
Implement new translation tasks for google WMT24++ datasets Tasks Modified #5736: Pull request #3480 synchronize by grzegorz-aniol
Action required grzegorz-aniol:task-wmt24pp
grzegorz-aniol:task-wmt24pp
Action required