host memory usages in load stage were much smaller than model size, so we measure actual size in forward stage.
calculate host/device memory usage:
bash run.sh cpu 1 128
calculate FLOPs:
python hf_flops_cpu.py 1 128 model_name
-
Notifications
You must be signed in to change notification settings - Fork 0
pockers21/scripts
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published