0.8.2b is an emergency fix
We received reports there is a bug causing NaN during fine-tuning llama3.2-11b vision model. Anyone who uses 0.8 is recommended to upgrade to 0.8.2b.
Note: AOTriton 0.8.1b adds head dimension 512 support and thus the binary size increases compared with 0.8b
This is a point release
0.8.2b can be used as drop-in replacement of 0.7b shared object file.
What's Changed
- Fix missing batch_index when calculating bias pointer by @xinyazhang in #68
Full Changelog: 0.8.1b...0.8.2b
Contributors
xinyazhang