LLAMA CPP Manager

Tool to manage LLAMA.CPP model configurations.

Features

• Load / Unload a model
• Store multiple model configurations.
• PWA, can be installed as a desktop app.
• Monitor usage of CPU, GPU, RAM and VRAM

Important

• Model Discovery: Model location is currently hardcoded in server.js file, this needs to be updated to the location where you store your models.

Getting Started

1. Install dependencies: npm install
2. Start the server: node run start
3. Open browser to http://localhost:3001

PS:

This tool was vibecoded using QWEN3-30B-A3B_2507_Q4 model.