Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update performance.md to 0.26.0_20240913_release. #43

Merged
merged 3 commits into from
Oct 10, 2024
Merged

Update performance.md to 0.26.0_20240913_release. #43

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
bdea7e8
Update performance.md to 0.26.0_20240913_release.
Sep 18, 2024
fc895b2
Merge branch 'master' into 0.26.0_dev
MrWhoami Oct 10, 2024
491034e
Merge branch 'master' into 0.26.0_dev
MrWhoami Oct 10, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
109 changes: 54 additions & 55 deletions docs/toolchain/appendix/performance.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,74 +21,73 @@

| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
| -------------------- | ------- | -------------- | -------------- | ---------------- |
| Inception v3 | 224x224 | 84.9 | 11.6 ms | No |
| Inception v4 | 299x299 | 21.11 | 47.3 ms | No |
| Mobilenet v1 | 224x224 | 432 | 2.31 ms | No |
| Mobilenet v2 | 224x224 | 682 | 1.46 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 314.9 | 3.17 ms | No |
| Resnet50 v1.5 | 224x224 | 54.8 | 18.2 ms | No |
| OpenPose | 256x256 | 5.11 | 195 ms | No |
| SRCNN | 384x384 | 134 | 7.48 ms | No |
| Tiny YOLOv3 | 416x416 | 155 | 6.45 ms | No |
| YOLOv3 | 416x416 | 10.24 | 97.7 ms | No |
| YOLOv5s | 640x640 | 25.7 | 38.9 ms | No |
| Centernet res101 | 512x512 | 2.86 | 350 ms | No |
| Lite-HRNet | 256x192 | 27.55 | 36.3 ms | No |
| CenterNet | 512x512 | 2.88 | 347.6 ms | No |
| Inception v3 | 224x224 | 84.99 | 11.76 ms | No |
| Inception v4 | 299x299 | 21.11 | 47.36 ms | No |
| Mobilenet v1 | 224x224 | 432.6 | 2.311 ms | No |
| Mobilenet v2 | 224x224 | 683.1 | 1.463 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 314.9 | 3.175 ms | No |
| Resnet50 v1.5 | 224x224 | 54.89 | 18.21 ms | No |
| OpenPose | 256x256 | 5.111 | 195.6 ms | No |
| SRCNN | 384x384 | 133.8 | 7.468 ms | No |
| Tiny YOLOv3 | 416x416 | 155.2 | 6.441 ms | No |
| YOLOv3 | 416x416 | 10.23 | 97.72 ms | No |
| YOLOv5s | 640x640 | 25.36 | 39.41 ms | No |
| Centernet res101 | 512x512 | 2.876 | 347.6 ms | No |
| Lite-HRNet | 256x192 | 27.40 | 36.49 ms | No |

*Performance simulation result on NPU KDP530:*

| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
| -------------------- | ------- | -------------- | -------------- | ---------------- |
| Inception v3 | 224x224 | 60.5 | 16.5 ms | No |
| Inception v4 | 299x299 | 14.45 | 69.2 ms | No |
| Mobilenet v1 | 224x224 | 277.6 | 3.6 ms | No |
| Mobilenet v2 | 224x224 | 336.7 | 2.97 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 200.7 | 4.98 ms | No |
| Resnet50 v1.5 | 224x224 | 36.1 | 27.6 ms | No |
| OpenPose | 256x256 | 3.62 | 277 ms | No |
| SRCNN | 384x384 | 61.5 | 16.2 ms | No |
| Tiny YOLOv3 | 416x416 | 72.6 | 13.8 ms | No |
| YOLOv3 | 416x416 | 6.0 | 167 ms | No |
| YOLOv5s | 640x640 | 18 | 55.6 ms | No |
| Centernet res101 | 512x512 | 2.29 | 437 ms | No |
| Unet | 384x384 | 0.859 | 1162 ms | No |
| Lite-HRNet | 256x192 | 52.69 | 18.9 ms | No |
| CenterNet | 512x512 | 2.27 | 440.9 ms | No |
| Inception v3 | 224x224 | 62.0 | 16.1 ms | No |
| Inception v4 | 299x299 | 14.56 | 68.7 ms | No |
| Mobilenet v1 | 224x224 | 284.7 | 3.51 ms | No |
| Mobilenet v2 | 224x224 | 342.3 | 2.92 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 202.6 | 4.94 ms | No |
| Resnet50 v1.5 | 224x224 | 36.79 | 27.18 ms | No |
| OpenPose | 256x256 | 3.621 | 276.1 ms | No |
| SRCNN | 384x384 | 61.52 | 16.25 ms | No |
| Tiny YOLOv3 | 416x416 | 72.59 | 13.77 ms | No |
| YOLOv3 | 416x416 | 5.983 | 167.1 ms | No |
| YOLOv5s | 640x640 | 17.99 | 55.56 ms | No |
| Centernet res101 | 512x512 | 2.287 | 437.2 ms | No |
| Unet | 384x384 | 0.875 | 1142 ms | No |
| Lite-HRNet | 256x192 | 52.49 | 19.04 ms | No |
| CenterNet | 512x512 | 2.287 | 437.2 ms | No |

*Performance simulation result on NPU KDP630:*

| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
| -------------------- | ------- | -------------- | -------------- | ---------------- |
| Inception v3 | 224x224 | 44.86 | 22.29 ms | No |
| Inception v4 | 299x299 | 12.66 | 78.98 ms | No |
| Mobilenet v1 | 224x224 | 207.40 | 4.82 ms | No |
| Mobilenet v2 | 224x224 | 212.85 | 4.69 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 125.60 | 7.96 ms | No |
| Resnet50 v1.5 | 224x224 | 21.27 | 47.00 ms | No |
| OpenPose | 256x256 | 4.03 | 248.1 ms | No |
| Inception v3 | 224x224 | 47.95 | 20.85 ms | No |
| Inception v4 | 299x299 | 12.47 | 80.16 ms | No |
| Mobilenet v1 | 224x224 | 219.6 | 4.55 ms | No |
| Mobilenet v2 | 224x224 | 218.9 | 4.568 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 130.0 | 7.69 ms | No |
| Resnet50 v1.5 | 224x224 | 22.91 | 43.63 ms | No |
| OpenPose | 256x256 | 4.035 | 247.8 ms | No |
| SRCNN | 384x384 | 62.84 | 15.91 ms | No |
| Tiny YOLOv3 | 416x416 | 97.63 | 10.24 ms | No |
| YOLOv3 | 416x416 | 4.92 | 203.0 ms | No |
| YOLOv5s | 640x640 | 16.59 | 60.24 ms | No |
| Unet | 384x384 | 1.72 | 581.4 ms | No |
| Lite-HRNet | 256x192 | 17.38 | 57.52 ms | No |
| Tiny YOLOv3 | 416x416 | 100.3 | 9.964 ms | No |
| YOLOv3 | 416x416 | 5.143 | 194.4 ms | No |
| YOLOv5s | 640x640 | 16.82 | 59.43 ms | No |
| Unet | 384x384 | 1.802 | 554.6 ms | No |
| Lite-HRNet | 256x192 | 17.41 | 57.40 ms | No |

*Performance simulation result on NPU KDP730:*

| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
| -------------------- | ------- | -------------- | -------------- | ---------------- |
| Inception v3 | 224x224 | 158.67 | 6.30 ms | No |
| Inception v4 | 299x299 | 39.93 | 25.04 ms | No |
| Mobilenet v1 | 224x224 | 706.27 | 1.42 ms | No |
| Mobilenet v2 | 224x224 | 1076.2 | 0.93 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 440.18 | 2.27 ms | No |
| Resnet50 v1.5 | 224x224 | 87.74 | 11.40 ms | No |
| OpenPose | 256x256 | 10.30 | 97.11 ms | No |
| SRCNN | 384x384 | 164.4 | 6.08 ms | No |
| Tiny YOLOv3 | 416x416 | 196.3 | 5.093 ms | No |
| YOLOv3 | 416x416 | 16.20 | 61.69 ms | No |
| YOLOv5s | 640x640 | 50.67 | 19.73 ms | No |
| Unet | 384x384 | 3.77 | 265.0 ms | No |
| Lite-HRNet | 256x192 | 206.4 | 4.845 ms | No |
| CenterNet | 512x512 | 5.98 | 167.1 ms | No |
| Inception v3 | 224x224 | 127.1 | 7.861 ms | No |
| Inception v4 | 299x299 | 37.86 | 26.41 ms | No |
| Mobilenet v1 | 224x224 | 609.4 | 1.640 ms | No |
| Mobilenet v2 | 224x224 | 811.1 | 1.232 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 393.9 | 2.538 ms | No |
| Resnet50 v1.5 | 224x224 | 79.03 | 12.65 ms | No |
| OpenPose | 256x256 | 10.45 | 95.62 ms | No |
| SRCNN | 384x384 | 159.0 | 6.289 ms | No |
| Tiny YOLOv3 | 416x416 | 199.4 | 5.013 ms | No |
| YOLOv3 | 416x416 | 16.70 | 59.85 ms | No |
| YOLOv5s | 640x640 | 50.79 | 19.68 ms | No |
| Unet | 384x384 | 3.867 | 258.5 ms | No |
| Lite-HRNet | 256x192 | 201.0 | 4.974 ms | No |
| CenterNet | 512x512 | 6.529 | 153.1 ms | No |
Loading