Skip to content

0.1.6

Pre-release
Pre-release
Compare
Choose a tag to compare
@slundberg slundberg released this 06 Dec 00:59
· 616 commits to main since this release

What's Changed

  • preliminary support for log_probs using the compute_log_probs=True model constructor arg.
  • A new guidance.cpp module that allows us to have high speed implementations of key objects.
  • reduce memory requirements (and probably improve speed) for llama.cpp tests by @paulbkoch in #485
  • Many bug fixes :)

Full Changelog: 0.1.5...0.1.6