From 4a46ee9fadb6a7cfd2a1dfa77376477aa3ff28fc Mon Sep 17 00:00:00 2001 From: Kadir Nar Date: Mon, 6 May 2024 01:50:08 +0300 Subject: [PATCH] Update benckmarks.md --- benckmarks.md | 10 ++++++++-- 1 file changed, 8 insertions(+), 2 deletions(-) diff --git a/benckmarks.md b/benckmarks.md index f2ebca4..51a6e7c 100644 --- a/benckmarks.md +++ b/benckmarks.md @@ -1,8 +1,14 @@ -**Metrics on Mozilla-Foundation/Common-Voice-17-0 dataset** +This evaluation was performed on the Mozilla-Foundation/Common-Voice-17-0 dataset, a widely-used benchmark for speech-to-text models. | Model | Metric Value | | ------------------------------------ | ------------ | -| distil-whisper/distil-large-v3 | 120.48 | | distil-whisper/distil-large-v3 + Hqq | 120.88 | +| distil-whisper/distil-large-v3 | 120.48 | +| distil-whisper/distil-large-v3 + Bnb | 120.14 | + + +Bnb: https://github.com/TimDettmers/bitsandbytes + +Dataset: https://huggingface.co/datasets/mozilla-foundation/common_voice_17_0 Hqq: https://github.com/mobiusml/hqq/