Running mlperf inference benchmarks on systems without internet connectivity

[anandhu-eng]

---

Migrated from mlcommons/mlperf-automations_archived#38
Originally created by @arjunsuresh on Wed, 29 Mar 2023 10:45:06 GMT

---

Some edge systems may not be connected to internet and we need a way to run mlperf inference benchmarks on them using CM.

[anandhu-eng]

---

Migrated from mlcommons/mlperf-automations_archived#38 (comment)
Originally created by @gfursin on Sat, 27 Jan 2024 15:37:27 GMT

---

I believe many of our CM automation recipes can plug in models and data sets locally, right?

[anandhu-eng]

---

Migrated from mlcommons/mlperf-automations_archived#38 (comment)
Originally created by @arjunsuresh on Sun, 28 Jan 2024 21:58:39 GMT

---

yes Grigori. But this issue is for running MLPerf inference on systems without internet and there even pip install will fail. So, we probably need to do the preparation on a host machine and then do the final run on the target. Nvidia does this for their Jetson Orin submission and not having internet improves the power efficiency :)