Skip to content

Commit

Permalink
update README memory requirements (#2342)
Browse files Browse the repository at this point in the history
  • Loading branch information
Satrat committed Jun 20, 2024
1 parent c4ec631 commit 0becc72
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/llama7b_sparse_quantized/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

This example uses SparseML and Compressed-Tensors to create a 2:4 sparse and quantized Llama2-7b model.
The model is calibrated and trained with the ultachat200k dataset.
At least 75GB of GPU memory is required to run this example.
At least 85GB of GPU memory is required to run this example.

Follow the steps below one by one in a code notebook, or run the full example script
as `python examples/llama7b_sparse_quantized/llama7b_sparse_w4a16.py`
Expand Down

0 comments on commit 0becc72

Please sign in to comment.