0.1.6
Pre-release
Pre-release
What's Changed
- preliminary support for log_probs using the
compute_log_probs=True
model constructor arg. - A new
guidance.cpp
module that allows us to have high speed implementations of key objects. - reduce memory requirements (and probably improve speed) for llama.cpp tests by @paulbkoch in #485
- Many bug fixes :)
Full Changelog: 0.1.5...0.1.6