pip install -r requirements.txtpython test_install.pypython ai_cli.pyStarts the CLI and automatically shows a model selector if LM Studio is running! Choose from available models with your keyboard.
python ai_cli.py --skip-selectorStarts the CLI with a demo interface - no AI model needed. Use --skip-selector to skip the model selector.
MODEL_PATH="Qwen/Qwen2.5-0.5B-Instruct" python ai_cli.py --skip-selectorLoads a real AI model for actual inference. Use --skip-selector to skip the interactive menu.
run.batAutomatically detects if you have a MODEL_PATH set and starts accordingly.
run.batAutomatically detects if you have a MODEL_PATH set and starts accordingly.
.\run.ps1set MODEL_PATH="Qwen/Qwen2.5-0.5B-Instruct"
python ai_cli.py "%MODEL_PATH%"copy .env.example .env
notepad .envEdit .env to set your preferred MODEL_PATH permanently.
Once running, try these messages:
Hello!- Greet the AIWhat can you do?- See capabilitiesTell me a joke- Get entertainmentHelp me write code- Get coding assistancequit,exit, orq- Exit the application
# Try using py instead
py ai_cli.pypip install -r requirements.txtpip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118| Command | Description |
|---|---|
python ai_cli.py |
Start demo mode (no model) |
MODEL_PATH="..." python ai_cli.py |
Start with specific model |
run.bat |
Windows batch launcher |
.\run.ps1 |
PowerShell launcher |
Enjoy your local AI assistant! 🎉