Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ClassificationQualityByClassRenderer #1371

Open
sara-vallejo opened this issue Nov 21, 2024 · 0 comments
Open

ClassificationQualityByClassRenderer #1371

sara-vallejo opened this issue Nov 21, 2024 · 0 comments

Comments

@sara-vallejo
Copy link

I am using the ClassificationQualityByClass metric for my classificaiton ML model. In the reference data I have 7 labels, however, in the current data there are only example for 3 of them. When I run a report with this data and metric, the tables for current and reference only show the metrics for the 3 labels that appear on the "current" data, but not for all 7 labels in the reference data.

I checked the renderer class for this metric, and I can see that for the reference plot, the names being used for x-axis are the ones from the current_metrics frame, instead of the reference_matrix_frame. Is this done on purpose? If not, I think a quick fix that would return the metrics for all labels in the reference data is using

ref_names = ref_metrics_frame.columns.tolist()
x = list(map(str,ref_names))

for the reference plot (line 169 in evidently/metrics/classification_performance/quality_by_class_metrics.py).

Otherwise, is there any way to overwrite original renderer plots?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant