John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations in text classification and new robustness tests.

[ArshaanNazir]

John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations for text classification and new robustness tests.

---

📢 Overview

LangTest 1.1.0 🚀 comes with brand new features, including: new capabilities to run different types of toxicity tests (lgbtqphobia, ideology, racism, xenophobia, sexism), support for doing templatic augmentations, extending support for HF datasets for summarization, support for BBQ-data, custom-replacement dicts for representation tests, CSV augmentations for text classification, using poetry as a dependency manager and adding new robustness tests (adjective-swapping and strip-all-punctuation) with many other enhancements and bug fixes!

A big thank you to our early-stage community for their contributions, feedback, questions, and feature requests 🎉

Make sure to give the project a star right here ⭐

---

🔥 New Features & Enhancements

• Adding support for improved toxicity tests Feature/toxicity types #628
• Adding support for templatic augmentations Feature/add support for templatic augmentation #629
• Adding support for strip_all_punctuation test Feature/add strip all punctutation perturbation #618
• Adding support for adjective-swap tests feature/ Robustness Tests -> Adjective synonym/antonym Swap #611
• Adding support for custom replacement dictionaries for representation and bias tests Custom replacement dictionaries for representation and bias tests #600
• Adding support for BBQ-data Dataset/BBQ data #609
• Adding support for CSV augmentations in text classification task Feature/Added support for CSV augmentations in text classification task #617
• Adding support for hf datasets for summarization Add support for hf datasets summarization #589
• Adding poetry as a dependency manager feature: add poetry #588
• Adding support for listing all available tests feature/Listing available tests #592
• Adding support for enabling user to only install the backend libraries needed feature: installation modes #597

---

🐛 Bug Fixes

• Model hub handler fix: model hub handler #601
• Fixing augmentations for swap-entities Fix/augmentations swap entities #622
• add_contraction bug for QA/Sum Fix/add_contraction bug for QA/Sum #615

---

❓ How to Use

Get started now! 👇

pip install langtest[transformers]

Create your test harness in 3 lines of code 🧪

# Import and create a Harness object
from langtest import Harness

h = Harness(task='ner', model='dslim/bert-base-NER', hub='huggingface')

# Generate test cases, run them and view a report
h.generate().run().report()

---

📖 Documentation

• LangTest: Documentation
• LangTest: Notebooks
• LangTest: Test Types
• LangTest: GitHub Repo

---

❤️ Community support

• Slack For live discussion with the LangTest community, join the #langtest channel
• GitHub For bug reports, feature requests, and contributions
• Discussions To engage with other community members, share ideas, and show off how you use NLP Test!

We would love to have you join the mission 👉 open an issue, a PR, or give us some feedback on features you'd like to see! 🙌

---

♻️ Changelog

What's Changed

• feature: add poetry by @JulesBelveze in feature: add poetry #588
• Add support for hf datasets summarization by @Prikshit7766 in Add support for hf datasets summarization #589
• Feature/poetry tasks by @JulesBelveze in Feature/poetry tasks #591
• feature: installation modes by @JulesBelveze in feature: installation modes #597
• feature/Listing available tests by @RakshitKhajuria in feature/Listing available tests #592
• Save augmentations by @RakshitKhajuria in Save augmentations #593
• fix: model hub handler by @JulesBelveze in fix: model hub handler #601
• chore: docstring check by @JulesBelveze in chore: docstring check #599
• Custom replacement dictionaries for representation and bias tests by @Prikshit7766 in Custom replacement dictionaries for representation and bias tests #600
• chore/remove logs by @JulesBelveze in chore/remove logs #610
• fix(dependency): missing huggingface-hub dependency by @JulesBelveze in fix(dependency): missing huggingface-hub dependency #613
• Fix/add_contraction bug for QA/Sum by @RakshitKhajuria in Fix/add_contraction bug for QA/Sum #615
• Dataset/BBQ data by @RakshitKhajuria in Dataset/BBQ data #609
• feature/ Robustness Tests -> Adjective synonym/antonym Swap by @RakshitKhajuria in feature/ Robustness Tests -> Adjective synonym/antonym Swap #611
• Fix/hf datasets summarization default prompt by @Prikshit7766 in Fix/hf datasets summarization default prompt #623
• Feature/add strip all punctutation perturbation by @ArshaanNazir in Feature/add strip all punctutation perturbation #618
• Feature/Added support for CSV augmentations in text classification task by @Prikshit7766 in Feature/Added support for CSV augmentations in text classification task #617
• chore/nbs-website-update by @RakshitKhajuria in chore/nbs-website-update #619
• Fix/augmentations swap entities by @ArshaanNazir in Fix/augmentations swap entities #622
• Feature/toxicity types by @alytarik in Feature/toxicity types #628
• fix/add bbq into package data by @alytarik in fix/add bbq into package data #633
• Docs/new toxicity nb and website by @alytarik in Docs/new toxicity nb and website #630
• Hot-Fixes by @RakshitKhajuria in Hot-Fixes #631
• Hot fix/strip all punctuation by @ArshaanNazir in Hot fix/strip all punctuation #632
• Blogpost notebook by @Prikshit7766 in Blogpost notebook #634
• Feature/add support for templatic augmentation by @chakravarthik27 in Feature/add support for templatic augmentation #629
• qa minor-fix by @Prikshit7766 in qa minor-fix #637
• fix(dependency): monkey patch import in toxicity by @JulesBelveze in fix(dependency): monkey patch import in toxicity #640
• fixing some dependencies by @ArshaanNazir in fixing some dependencies #642
• Release/1.1.0 by @ArshaanNazir in Release/1.1.0 #645

Full Changelog: 1.0.0...1.1.0

---

This discussion was created from the release John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations in text classification and new robustness tests. .