Skip to content

Examples of using Evidently to evaluate, test and monitor ML models.

License

Notifications You must be signed in to change notification settings

evidentlyai/community-examples

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

87 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Evidently community examples

Examples of using Evidently to evaluate, test and monitor ML models.

📊 Tutorials

Code tutorials showing specific use cases, Evidently functionality or example dataset analysis. Come with blog posts or detailed explanations.

If you are new to Evidently, explore the official Quickstarts.

Title Code Blog Author Tags
How to run and debug LLM regression tests Jupyter notebook - Evidently team test_suites, llm, text_descriptors
How to create an LLM judge Jupyter notebook - Evidently team test_suites, llm, text_descriptors
How to monitor LLM testing results Jupyter notebook Tutorial Evidently team test_suites, llm, text_descriptors
How to run regression testing for LLMs Jupyter notebook Tutorial Evidently team test_suites, llm, text_descriptors
How to create ML model cards Jupyter notebook Tutorial Evidently team reports, data_quality, model_quality, classification
How to use descriptors to monitor text data Jupyter notebook - with model training Tutorial Evidently team reports, test_suites, text_data, nlp, data_drift, text_descriptors
How to monitor NLP models in production Jupyter notebook - with model training Tutorial Evidently team reports, text_data, nlp, data_drift, text_descriptors, classification
How to break a model in 20 days. A tutorial on production model analytics. Jupyter notebook Tutorial Evidently team reports, data_drift, model_quality, regression
How to compare models pre-deployment. Jupyter notebook Tutorial Evidently team reports, model_quality, classification
How to design ML monitoring. Tutorial from CS 329S: Machine Learning Systems Design. Jupyter notebook Tutorial Evidently team reports, data_drift, model_quality, regression

💻 Examples

Code examples and how-tos on using Evidently and specific features.

If you are new to Evidently, see the entry-level sample notebooks with all Evidently metrics and tests.

Title Code Author Tags
How to convert raw text data to embeddings and evaluate data drift. Jupyter notebook Sangam SwadiK reports, text_data, nlp, data_drift, embeddings
Comparing data drift tests for different distributions types. Jupyter notebook Antonis Stellas reports, data_drift

🏗️ Integrations

Examples of using Evidently with other tools.

See core deployment blueprints in the integrations folder in main Evidently repository.

Title Code Blog Author Tags
How to send email alerts on drift Evidently and AWS SES Example repo Tutorial Marcello Victorino data drift

🎥 Events

Examples from specific events, meetups or workshops using Evidently.

Title Code Video Author Tags

📚 Blogs

Blogs about Evidently, published on external platforms.

Title Blog Author Tags

See the official Evidently blog for more articles.

About

Examples of using Evidently to evaluate, test and monitor ML models.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published