V0.1.4.post2: support multi-gpu, remove pycuda
·
8 commits
to main
since this release
What's Changed
- Feature(MInference): update HF demo information, thanks @ak's sponsoring by @iofu728 in #22
- Feature(MInference): remove pycuda; #20
- Feature(MInference): support multi-gpu; #25
- Feature(MInference): add unittest by @iofu728 in #31 #32
- Fixes #28 the import warnings;
- Fixed #25 fix the apply_rotary_pos_emb_single;
- Fixed phi-3 vs kernel;
Full Changelog: v0.1.4.post1...v0.1.4.post2
Contributors
ak and iofu728