whisper.cpp v1.8.1 works on Windows Strix Halo AMD Ryzen AI Max+ 395 APU with Vulkan

[davidsdearaujo]

I finally got whisper.cpp working on my Beelink GTR9 Pro AI that has an AMD Ryzen AI MAX+ 395 (full specs in the My system specs section)

Performance

It took around 3 minutes to transcribe a 1h 20m audio using ggml-large-v3-turbo:

Binaries

Here are the whisper.cpp binaries that I built for Windows using Vulkan:

ggml-whisper.cpp-vulkan.zip

Files

• bench.exe
• ggml.dll
• ggml-base.dll
• ggml-cpu.dll
• ggml-vulkan.dll
• main.exe
• quantize.exe
• test-vad.exe
• test-vad-full.exe
• vad-speech-segments.exe
• whisper.dll
• whisper-bench.exe
• whisper-cli.exe
• whisper-server.exe

My Device Specs

• Device name: DESKTOP-RJBAU4F
• Processor: AMD RYZEN AI MAX+ 395 w/ Radeon 8060S (3.00 GHz)
• Installed RAM 128 GB (63.6 GB usable)

My System Specs

• Edition: Windows 11 Pro
• Version: 25H2
• OS build: 26200.7171
• System type: 64-bit operating system, x64-based processor

Build Yourself

Requirements

• Git
• Vulkan SDK
• CMake

Installing requirements

IMPORTANT
Make sure you run the terminal as admin so it can install everything properly.

Vulkan SDK

Vulkan Runtime came installed by default, but for building these binaries we needed to install the Vulkan SDK – you can find it in their official link:

Screenshot

Chocolatey

The next requirements can be installed manually, though a package manager or however you prefer.
I personally like to install stuff though Chocolatey:

1. Install Chocolatey from their official instructions;
2. Restart the terminal;

After that Chocolatey is installed in your PC, let's use it to install the next requirements:

• Git: choco install git – Chocolatey instructions
• CMake: choco install cmake – Chocolatey instructions;

All Requirements Installed

Now you are good to go! Follow the next steps to build your very own binaries.

Building whisper.cpp binaries using Vulkan SDK

Run these commands in your terminal:

# Clone the repo
git clone https://github.com/ggml-org/whisper.cpp

# Go to the repo folder
cd whisper.cpp

# Create build files 
cmake -B build -DGGML_VULKAN=ON -DGGML_HIPBLAS=OFF -DGGML_HIP=OFF -DGGML_CUDA=OFF

# Build releases
cmake --build build --config Release

After these steps you should see your own binaries in the whisper.cpp/build/bin/Release.