Skip to content

v0.6.1 release

Compare
Choose a tag to compare
@wangxingjun778 wangxingjun778 released this 22 Nov 06:34

Release Notes

  1. Add CMMLU benchmark #198
  2. Add publish workflow #186
  3. Adapt RAGAS v0.2.5 and update readme #205
  4. Adapt MTEB v1.19 #196

Bug Fixes

  1. Set datasets version: dataset>=3.0.0, <=3.0.1 #184
  2. Set pyarrow version to <=17.0.0 to avoid installation issue on OSX. #187
  3. Add timeout for download punkt.zip #206

Documentation Updates

  1. Update OpenCompass list all datasets docs #199
  2. Update RAGAS v0.2.5 docs #205

中文说明

特性

  1. 支持CMMLU benchmark #198
  2. 支持publish 流程 #186
  3. 适配RAGAS v0.2.5并更新文档 #205
  4. 适配 MTEB v1.19 #196

缺陷修复

  1. 设置datasets 版本,修复兼容性问题: dataset>=3.0.0, <=3.0.1 #184
  2. 设置 pyarrow版本:<=17.0.0 修复在OSX操作系统下的安装问题 #187
  3. 增加下载punkt.zip时的超时时间 #206

文档更新

  1. 更新OpenCompass作为backend时所支持的数据集列表文档 #199
  2. 更新RAGAS v0.2.5 文档 #205