Benchmarking Faster Whisper using CPU and Tesla T4 GPU (AWS g4dn.xlarge instance)

[monikkinom]

Sharing the results of benchmarking different models on the AWS g4dn.xlarge instance for transcripting an audio file with the text "Hey buddy, I'm here to offer an iPhone 13 128GB for free"

model size	device	quantization	time	transcription
tiny.en	cuda	int8	0.21860456466674805s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny.en	cuda	int8_float32	0.2388448715209961s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny.en	cuda	int8_float16	0.2349863052368164s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny.en	cuda	float16	0.23281264305114746s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny.en	cuda	float32	0.25150179862976074s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cuda	int8	0.23393893241882324s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cuda	int8_float32	0.2371842861175537s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cuda	int8_float16	0.235670804977417s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cuda	float16	0.2296285629272461s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cuda	float32	0.243455171585083s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
base.en	cuda	int8	0.2411036491394043s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base.en	cuda	int8_float32	0.24760937690734863s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base.en	cuda	int8_float16	0.22373437881469727s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base.en	cuda	float16	0.22319245338439941s	Hey, buddy, I'm here to offer an iPhone 13128GB for free.
base.en	cuda	float32	0.2897958755493164s	Hey, buddy, I'm here to offer an iPhone 13128GB for free.
base	cuda	int8	0.23314642906188965s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base	cuda	int8_float32	0.2886037826538086s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base	cuda	int8_float16	0.23955726623535156s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base	cuda	float16	0.23618555068969727s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base	cuda	float32	0.3005833625793457s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cuda	int8	0.3882155418395996s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cuda	int8_float32	0.4098544120788574s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cuda	int8_float16	0.37961459159851074s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cuda	float16	0.2868187427520752s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cuda	float32	0.4247562885284424s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small	cuda	int8	0.42312097549438477s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
small	cuda	int8_float32	0.44453930854797363s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
small	cuda	int8_float16	0.357820987701416s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
small	cuda	float16	0.2975349426269531s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
small	cuda	float32	0.4467751979827881s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
medium.en	cuda	int8	0.5530414581298828s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
medium.en	cuda	int8_float32	0.6344377994537354s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
medium.en	cuda	int8_float16	0.5690398216247559s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
medium.en	cuda	float16	0.465712308883667s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium.en	cuda	float32	0.85396409034729s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cuda	int8	0.631263017654419s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cuda	int8_float32	0.6290638446807861s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cuda	int8_float16	0.633054256439209s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cuda	float16	0.513416051864624s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cuda	float32	0.9271214008331299s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
large-v1	cuda	int8	0.7759385108947754s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
large-v1	cuda	int8_float32	0.8662433624267578s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
large-v1	cuda	int8_float16	0.723508358001709s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
large-v1	cuda	float16	0.7273612022399902s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v1	cuda	float32	1.617983341217041s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cuda	int8	0.7354493141174316s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cuda	int8_float32	0.8665182590484619s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cuda	int8_float16	0.7443127632141113s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cuda	float16	0.7436847686767578s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cuda	float32	1.5736503601074219s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cuda	int8	0.7340312004089355s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cuda	int8_float32	0.8619117736816406s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cuda	int8_float16	0.7645719051361084s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cuda	float16	0.7345490455627441s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cuda	float32	1.5680127143859863s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
tiny.en	cpu	int8	1.0078403949737549s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny.en	cpu	int16	1.052320957183838s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny.en	cpu	int8_float32	0.8625619411468506s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny.en	cpu	float32	1.1897306442260742s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cpu	int8	0.9162118434906006s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cpu	int16	0.9861640930175781s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cpu	int8_float32	0.9071886539459229s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
tiny	cpu	float32	1.2706995010375977s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
base.en	cpu	int8	1.5125148296356201s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base.en	cpu	int16	1.8036713600158691s	Hey, buddy, I'm here to offer an iPhone 13128GB for free.
base.en	cpu	int8_float32	1.5270497798919678s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base.en	cpu	float32	2.2677557468414307s	Hey, buddy, I'm here to offer an iPhone 13128GB for free.
base	cpu	int8	1.5653600692749023s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base	cpu	int16	1.9130408763885498s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base	cpu	int8_float32	1.6006948947906494s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
base	cpu	float32	2.3500845432281494s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cpu	int8	4.515511512756348s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cpu	int16	5.055927753448486s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cpu	int8_float32	4.409548044204712s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small.en	cpu	float32	7.240082740783691s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
small	cpu	int8	4.74600887298584s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
small	cpu	int16	5.461743593215942s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
small	cpu	int8_float32	4.370435476303101s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
small	cpu	float32	7.21729588508606s	Hey buddy, I'm here to offer an iPhone 13128GB for free.
medium.en	cpu	int8	11.097458124160767s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium.en	cpu	int16	15.048250675201416s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium.en	cpu	int8_float32	10.98620080947876s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium.en	cpu	float32	19.918462991714478s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cpu	int8	12.092268228530884s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cpu	int16	15.711641788482666s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cpu	int8_float32	11.599420070648193s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
medium	cpu	float32	21.38808012008667s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
large-v1	cpu	int8	20.70479440689087s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v1	cpu	int16	28.1750545501709s	Hey buddy, I'm here to offer an iPhone 13 128GB for free.
large-v1	cpu	int8_float32	20.982126474380493s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v1	cpu	float32	40.581615686416626s	Hey buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cpu	int8	20.956523180007935s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cpu	int16	27.91238570213318s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cpu	int8_float32	20.859272718429565s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large-v2	cpu	float32	41.3666455745697s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cpu	int8	20.998391151428223s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cpu	int16	28.04013204574585s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cpu	int8_float32	20.422232627868652s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.
large	cpu	float32	40.78734731674194s	Hey Buddy, I'm here to offer an iPhone 13 128 GB for free.