Clarification of ImageNet dataset used

[MiguelCosta94]

Hi,

I am trying to evaluate the mcunet-320kB implemented in TFLite using your eval_tflite.py script. I followed the steps provided in this Git issue ( #11 ), but I am still getting a very low accuracy of 0.08%. I downloaded the 2012 version of the ImageNet dataset from this link https://image-net.org/data/ILSVRC/2012/ILSVRC2012_img_val.tar and have prepared the repo using this script https://github.com/pytorch/examples/blob/main/imagenet/extract_ILSVRC.sh . I am doing something wrong?

[tonylins]

Hi, could you please check if you can reproduce the ImageNet accuracy number of pre-trained torchvision models with the official PyTorch evaluation script? Thanks!

[tonylins]

We followed the procedures here to process the dataset: https://github.com/pytorch/examples/tree/main/imagenet

[MiguelCosta94]

I was already able to reproduce the results from the paper. They are now very close to the reported accuracy +-2%. Thank you so much.