Skip to content

Releases: ModelTC/lightllm

3.0.0

01 Nov 10:02
@hiworldwzj hiworldwzj
3.0.0
d9e3ba2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
3.0.0 Pre-release
Pre-release

Version 3.0.0

Updates

  1. Support for CUDA Graph
  2. Improved Memory Management
  3. Startup Optimization
    • Use --mem_fraction
    • Automatically read eos_id and data_type information from config.json
  4. Refactor of Multimodal Code
Assets 2
Loading