-
Notifications
You must be signed in to change notification settings - Fork 8
README
GitHub Action edited this page May 12, 2024
·
1 revision
This directory contains scripts to generate the benchmark tables in the Wiki
The Wiki including the raw benchmark data as well as the formatted tables can be cloned via:
git clone https://github.com/tum-ei-eda/muriscv-nn.wiki.git
-
Clone Wiki repository (see above)
-
Generate Benchmark Data
- Locally (See
Integration/MLonMCU/mlonmcu_benchmarks.sh
) - Via GitHub Actions (See
.github/workflows/benchmark_test.yml
)
- Process generated CSV report(s)
python3 create_wiki.py paper_data/*/out.csv --split
- Upload generated CSV and Markdown files to wiki repo
cp Benchmarks-*.md muriscv-nn.wiki/
cp Benchmarks-*.csv muriscv-nn.wiki/
cd muriscv-nn.wiki/
git add --all
git commit -m "Add new files"
git push origin master
TODO
2024-11-26
- TFLM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
- TVM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
2024-11-21
- TFLM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
- TVM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Os Spike (RV32) (spike_rv32)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
Spike (RV32, Embedded) (spike_rv32_min)
Spike (RV64) (spike_rv64)
2024-11-19
- TFLM
- GCC
- Os Spike (RV32) (spike_rv32)
- LLVM
- Os Spike (RV32) (spike_rv32)
- TVM
- GCC
- Os Spike (RV32) (spike_rv32)
- LLVM
- Os Spike (RV32) (spike_rv32)
Spike (RV64) (spike_rv64)
Spike (RV64) (spike_rv64)
Spike (RV64) (spike_rv64)
Spike (RV64) (spike_rv64)
2024-11-18
- TFLM
- GCC
- Os Spike (RV32) (spike_rv32)
- LLVM
- Os Spike (RV32) (spike_rv32)
- TVM
- GCC
- Os Spike (RV32) (spike_rv32)
- LLVM
- Os Spike (RV32) (spike_rv32)
Spike (RV64) (spike_rv64)
Spike (RV64) (spike_rv64)
Spike (RV64) (spike_rv64)
Spike (RV64) (spike_rv64)
2024-07-12
- TFLM
- GCC
- Os Spike (RV64) (spike_rv64)
- LLVM
- Os Spike (RV64) (spike_rv64)
- TVM
- GCC
- Os Spike (RV64) (spike_rv64)
- LLVM
- Os Spike (RV64) (spike_rv64)
2024-03-02
2024-11-26
- TFLM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-11-21
- TFLM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- O3 Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-11-19
- TFLM
- GCC
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-11-18
- TFLM
- GCC
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os Spike (RV32) (spike_rv32)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-07-12
- TFLM
- GCC
- Os Spike (RV64) (spike_rv64)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os Spike (RV64) (spike_rv64)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- Os Spike (RV64) (spike_rv64)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os Spike (RV64) (spike_rv64)
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-06-29
- TFLM
- GCC
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-03-02
- TFLM
- GCC
- O3 SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- O3 SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- O3 SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- O3 SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- Os SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-02-26
- TFLM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-02-23
- TFLM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-02-22
- TFLM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-02-20
- TFLM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2024-02-11
- TFLM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- LLVM
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
2023-12-22
- TFLM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)
- TVM
- GCC
- s SpikeRV32
- Audio Wake Words (aww)
- Image Classification (resnet)
- Anomaly Detection (toycar)
- Visual Wake Words (vww)