Attention layers in the Unet Model

[rafikoham]

Hello Everyone,
So I'm doing an Image segmentation with the Unet Model and I've drawned the net with torchvision and found out that there's attention layers, can someone tell me why ? , because I didn't know that there were Attention layers in the Unet model, unless if it's an Attention Unet !

Thanks everyone !

[cagey-squirrel]

This attention layer is just the identity function by default so you can ignore it.
By setting attention='scse' in your model you can change this layer to be scSE attention layer and this is done only in decoder.