Skip to content

Latest commit

 

History

History
61 lines (37 loc) · 1.45 KB

File metadata and controls

61 lines (37 loc) · 1.45 KB

Troubleshooting

Issues

Also, check GitHub Issues for the repository.

Missing Python.h

Error message: fatal error: Python.h: No such file or directory

This is fixed by installing uv managed python:

curl -LsSf https://astral.sh/uv/install.sh | sh
uv python install --reinstall

Re-install the package:

rm -rf .venv
uv sync --extra=cu128

CUDA driver version insufficient

Fix: Update NVIDIA drivers to latest version compatible with CUDA CUDA 12.8.1

Check driver compatibility:

nvidia-smi | grep "CUDA Version:"

Out of Memory (OOM) errors**

Fix: Use 2B models instead of 14B, multi-GPU, or reduce batch size/resolution

Guide

Logs

Logs are saved to <output_dir>/*.log.

Profiling

To profile, pass the --profile flag. A pyinstrument profile will be exported to <output_dir>/profile.pyisession.

View the profile:

pyinstrument --load=<output_dir>/profile.pyisession

Export the profile:

pyinstrument --load=<output_dir>/profile.pyisession -r html -o <output_dir>/profile.html

See pyinstrument.