prompttools 0.0.33

Major Features Updates

New APIs

• OpenAIChatExperiment - it can now call functions.
• LangChain Sequential Chain
• LangChain Router Chain
• LanceDB
• Initial support for benchmarking (with HellaSwag)

Other Improvements

There are also many fixes and improvements we made to different experiments. Notably, we refactored how evaluate works. In this version, the evaluation function being passed into experiment.evaluate() should handle a row of data plus other optional keyword arguments. Please see our updated example notebooks as references.

Playground

The playground now supports shareable links. You can use the Share button to create a link and share your experiment setup with your teammates.

Community

Shout out to @HashemAlsaket, @AyushExel, @pramitbhatia25 @mmmaia actively participating and contributing new features!

If you have suggestions on the API or use cases you'd like to be covered, please open a GitHub issue. We'd love to hear thoughts and feedback. As always, we welcome new contributors to our repo and we have a few good first issues to get you started.