v0.6.5

What's Changed

• Fix ValueStats for binary category column. by @Liraim in #1495
• Fix Recommender Rank Metric Preset In recsys.py by @taljacob2 in #1466

New Contributors

• @taljacob2 made their first contribution in #1466

Full Changelog: v0.6.4...v0.6.5

v0.6.4

What's Changed

• Classification Presets tests configuration. by @Liraim in #1475
• Add ValueStats / TextEvals / DataSummaryPreset tests. by @Liraim in #1485
• multiple categorycount categories by @mike0sv in #1483
• Implement generation of data definitions for pandas datasets. by @Liraim in #1488
• Support pandas.DataFrame in Report.run. by @Liraim in #1489
• bylabelcount metric type by @mike0sv in #1484
• Small fixes for descriptors: naming issues, removal of unused functions, updated thresholds by @emeli-dral in #1490
• Minor fixes for data definition and tests. by @Liraim in #1491
• Support partial data definitions by @Liraim in #1492
• Add test params to regression presets. by @Liraim in #1493

Full Changelog: v0.6.3...v0.6.4

v0.6.3

What's Changed

• UI: bit refactor by @DimaAmega in #1474
• Add disclaimers to the old docs by @elenasamuylova in #1470
• fix out of range metric by @mike0sv in #1473
• support options in future descriptors by @mike0sv in #1471
• Context Relevance descriptor by @Liraim in #1472
• Feature/rag descriptors by @emeli-dral in #1478
• Add additional providers for ContextRelevance. by @Liraim in #1477
• allow unknown metrics to be uploaded by @mike0sv in #1476
• updated descriptors example by @emeli-dral in #1479

Full Changelog: v0.6.2...v0.6.3

v0.6.2

What's Changed

• Fix/test hover by @mike0sv in #1467
• Fix columns definitions and data drift configuration. by @Liraim in #1465
• Feature/llm wrappers by @mike0sv in #1464
• Fix linked metrics in presets renders. by @Liraim in #1469
• use async litellm by @mike0sv in #1468

Full Changelog: v0.6.1...v0.6.2

v0.6.1

What's Changed

• Fix deserialization BaseWidgetInfo in converted metrics. by @Liraim in #1457
• Fix missing tests for top level metrics on converting new snapshot by @Liraim in #1458
• Fix threshold type in LessThan test. by @Liraim in #1460
• boolean label by @mike0sv in #1456
• Fix proper convert for data_definition to input_data. by @Liraim in #1461
• add render tag for v2 values by @mike0sv in #1459
• Fix Binary Classification with different configurations. by @Liraim in #1463
• remove scikit-learn<1.6.0 limit by @DimaAmega in #1451
• UI: snapshot actions wrapper by @DimaAmega in #1462

Full Changelog: v0.6.0...v0.6.1

v0.6.0

What's Changed

• add test_fingerprint to test widget by @mike0sv in #1386
• fix get dataset permissions by @svetleo-evidently in #1399
• fix get dataset permissions by @svetleo-evidently in #1401
• Docs: misc updates by @elenasamuylova in #1397
• Metrics redesign by @Liraim in #1389
• Store tests datasets in repo. by @Liraim in #1416
• New reports improvements. by @Liraim in #1414
• Openai errors by @svetleo-evidently in #1417
• fix descriptors params: include_reasoning and include_score by @svetleo-evidently in #1419
• Reference support in new version. by @Liraim in #1415
• default tests and include_tests logic by @mike0sv in #1418
• Support reference in metrics. by @Liraim in #1420
• Render for new ValueDrift and DataDriftPreset. by @Liraim in #1421
• Add approxvalue support in tests. by @Liraim in #1425
• recsys metrics by @mike0sv in #1423
• not equal by @mike0sv in #1424
• fixes by @mike0sv in #1426
• Fix data drift params and tests. by @Liraim in #1428
• Add explicit display names for metric results. by @Liraim in #1430
• default ref tests by @mike0sv in #1427
• Support value names in all metrics. by @Liraim in #1431
• new dummmy metrics by @mike0sv in #1432
• ValueStats render by @Liraim in #1433
• add run by @mike0sv in #1437
• Feature/ml vis by @mike0sv in #1434
• Text Evals render and DataSummaryPreset by @Liraim in #1435
• Replace RocAuc by label render. by @Liraim in #1439
• Add RegressionQuality render and RegressionPreset. by @Liraim in #1436
• Add ClassificationQuality render and ClassificationPreset. by @Liraim in #1438
• Tests summary in new reports. by @Liraim in #1442
• Feature/add run by @mike0sv in #1444
• fix descriptor columns by @mike0sv in #1440
• openai_errors_handle by @svetleo-evidently in #1443
• Support None / NaN in UniqueValuesCount metric by @Liraim in #1446
• Fix information about descriptors in snapshots. by @Liraim in #1448
• Support ByLabelValue in field iterators. by @Liraim in #1450
• FIPS compliant by @DueViktor in #1411
• Support V2 metrics in Distribution. by @Liraim in #1452
• default reference tests by @mike0sv in #1445
• add alias as display name by @mike0sv in #1453
• Support presets from new reports in old snapshots. by @Liraim in #1454
• fix prompts by @mike0sv in #1455
• UI: add histigram panel plot type by @DimaAmega in #1447

New Contributors

• @DueViktor made their first contribution in #1411

Full Changelog: v0.5.1...v0.6.0

v0.5.1

What's Changed

• fix empty strings in datagen by @mike0sv in #1385
• UI: go to report from dashboard plot by @mike0sv in #1383
• UI(feature): [Dashboard] vertical line at selected point by @DimaAmega in #1387
• move managers by @mike0sv in #1328
• UI: add dot on clicked point on dashoard by @DimaAmega in #1388
• fix CI by @DimaAmega in #1393
• add customdata for distribution by @mike0sv in #1392
• UI: refactor use widget wrapper by @DimaAmega in #1395

Full Changelog: v0.5.0...v0.5.1

v0.5.0

What's Changed

• No teams by @svetleo-evidently in #1375
• move projects from teams to org by @svetleo-evidently in #1376
• Dataset to project postmigration by @svetleo-evidently in #1379
• add project read permission for org viewer by @svetleo-evidently in #1377
• Docs: change TextOverviewPreset to TextEvals by @SkafteNicki in #1374
• No team_id in docs by @emeli-dral in #1381
• feat: add IsValidSQL() by @vectorvp in #1372

New Contributors

• @SkafteNicki made their first contribution in #1374
• @vectorvp made their first contribution in #1372

Full Changelog: v0.4.40...v0.5.0

v0.4.40

What's Changed

• add list users permission by @DimaAmega in #1362
• Move pipes import to support py3.13 by @mike0sv in #1361
• remove exp datagen by @DimaAmega in #1366
• Move datasets to project by @svetleo-evidently in #1365
• Docs: small fixes by @elenasamuylova in #1368

Full Changelog: v0.4.39...v0.4.40

v0.4.39

What's Changed

• UI: refactor playwright run by @DimaAmega in #1331
• run-snapshot-async by @svetleo-evidently in #1330
• Add ItemMatch + ItemNoMatch Descriptors by @jon-bown in #1338
• UI(tests): increase timeout to 4m by @DimaAmega in #1344
• Feature/dataset generator by @mike0sv in #1340
• Remove pip-audit by @Liraim in #1345
• Add JSONSchemaMatch feature and descriptor by @trey-capps in #1342
• IsValidJSON() descriptor by @gagan-bhullar-tech in #1325
• ExactMatch descriptor by @gagan-bhullar-tech in #1326
• Add WordMatch + WordNoMatch descriptor by @jon-bown in #1334
• use new wrapper/prompt api by @mike0sv in #1346
• Feat/add contains link descriptor by @Sifr-un in #1333
• Fix embeddings test presets error by @Liraim in #1347
• Add missing type aliases in how_to_make_custom_metric_and_test example by @Liraim in #1349
• Remove TextOverviewPresets references from examples and docs by @Liraim in #1348
• Fix llm example. by @Liraim in #1350
• Update Mypy rules and version. by @Liraim in #1343
• OpenAI error message by @svetleo-evidently in #1354
• added JSONMatch Descriptor by @ramachaitanya0 in #1337
• Add IsValidPython descriptor by @trey-capps in #1351
• Fix PyTorch-NumPy compatibility in build workflows by @Liraim in #1356
• UI: dark mode by @DimaAmega in #1355
• Fix typos by @strickvl in #1358
• fix(dashboard): filter by date test panels by @DimaAmega in #1359
• feat: Add BERTScore feature descriptor and feature by @projectultra in #1335

New Contributors

• @jon-bown made their first contribution in #1338
• @trey-capps made their first contribution in #1342
• @gagan-bhullar-tech made their first contribution in #1325
• @Sifr-un made their first contribution in #1333
• @ramachaitanya0 made their first contribution in #1337
• @projectultra made their first contribution in #1335

Full Changelog: v0.4.38...v0.4.39