Unable to reproduce the performance

[chingyaoc]

Hi, Hope you are doing well!

I attempt to reproduce the performance of DBI+Mixup on task 1, 2, 4, and 5. However, the mutual information scores I got are 0.016, 0.346859, 0.05064056682, 0.0867317994, respectively. It seems that the performance of task 4 and 5 is lower than the number reported here. I did not modify any code. Would you mind provide some hints to reproduce the results?

Thanks!

[parthnatekar]

Hi, the scores reported are the best scores obtained on each task - you can play around with hyperparameters and choose whether or not to use data augmentation, max-pooling, etc. to improve results.