advice for training STN

[james0591]

You could read the paper A Multi-Object Rectified Attention Network for Scene Text Recognition at https://paperswithcode.com/paper/a-multi-object-rectified-attention-network.
The author introduces a training method called curriculum training. First, he trains the crnn. Second, he trains the STN. Finally, he trains the STN and crnn at the same time.