Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add WandB integration and new metrics #177

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

ArgoHA
Copy link
Contributor

@ArgoHA ArgoHA commented Feb 26, 2025

Adding Weights and biases integration and metrics: F1-score, Precision, Recall, TPs, FPs, FNs, box IoU. New metrics are calculated with a fixed threshold.

  • In runtime.yaml added configs for WandB
  • Wandb Logs mAP and new metrics, LR, training loss and system info (GPU usage, vRAM, CPU usege...)
  • WandB is not required, if user has it installed - it will be used.
  • New class to calculate all new metrics.

d-fine_wandb

I was training D-FINE on 4 datasets, results are great, but I missed comfortable things like WandB and F1-score, hence this PR. People should pay less attention to mAPs when working on a real world tasks, as mAP is calculated with different conf thresholds, but on prod we always fix conf threshold, so it's good to know real world metrics like F1-score.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant