21 lines (16 loc) · 725 Bytes

LLAMA CPP Manager

Tool to manage LLAMA.CPP model configurations.

Features

Load / Unload a model
Store multiple model configurations.
PWA, can be installed as a desktop app.
Monitor usage of CPU, GPU, RAM and VRAM

Important

Model Discovery: Model location is currently hardcoded in server.js file, this needs to be updated to the location where you store your models.

Getting Started

Install dependencies: npm install
Start the server: node run start
Open browser to http://localhost:3001

PS:

This tool was vibecoded using QWEN3-30B-A3B_2507_Q4 model.