Dino Version

[sushi31415926]

hello!
I wonder if there is additional version of dino (for example ViT-S/14) that can be used as backbone in this model

[Parskatt]

There is not. I could train one if there is interest. Matching takes most of the time though.

[sushi31415926]

thanks for the fast response!
I wonder if a smaller backbone will decreased significantly the performance of the model.

[Parskatt]

Probably there is a bit of a decrease, but the main benefit from dinov2 is how its trained, not the size of the model. Ive previously tried using vit-L with weights pretrained on classification, and gotten poor results.