Tabby does not use GPU on my Windows machine

[andithang]

Hi. I am facing an issue when running Tabby on my machine. It utilizes my Intel GPU instead of my NVIDIA GPU even though I am running it with --device cuda.

OS: Windows 11 Home Single Language 64-bit
CPU: 11th Intel(R) Core i7 11800H 2.3GHz
GPU 0: NVIDIA GeForce RTX 3050 Ti Dedicated: 4GB, Shared: 8GB
GPU 1: Intel UHD Graphics 8GB

Tabby's version: 0.31.0 - tabby_x86_64-windows-msvc-cuda124.zip

Information about GPU
Output of nvidia-smi (This was captured while Tabby was running and no GPU process presented):

Output of nvcc --version:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Wed_Jul_16_20:06:48_Pacific_Daylight_Time_2025
Cuda compilation tools, release 13.0, V13.0.48
Build cuda_13.0.r13.0/compiler.36260728_0

Additional context
Running command: .\tabby.exe serve --model StarCoder-1B --device cuda.