python run_llama_int8_0307.py -m Llama-2-7b-hf --quantized-model-path "./saved_results_w8a8/best_model.pt" --benchmark --int8 --num-iter 1 --num-warmup 0 --profile --max-new-tokens 10 --corenums 64 --greedy --batch-size 1 --jit
-
Notifications
You must be signed in to change notification settings - Fork 0
gukejun1/profile_llame2_7b
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published