Skip to content

Commit

Permalink
Tiny fix for an import in Llama generator script (#1286)
Browse files Browse the repository at this point in the history
  • Loading branch information
alexsamardzic authored Nov 20, 2024
1 parent b7930ac commit 2e338a8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion torchao/_models/llama/generate.py
Original file line number Diff line number Diff line change
Expand Up @@ -216,11 +216,11 @@ def main(
fpx_weight_only,
uintx_weight_only,
autoquant,
unwrap_tensor_subclass,
float8_weight_only,
float8_dynamic_activation_float8_weight,
)
from torchao.quantization.granularity import PerTensor, PerRow
from torchao.utils import unwrap_tensor_subclass
if "spinquant" in quantization:
from torchao.prototype.spinquant import apply_spinquant
apply_spinquant(model)
Expand Down

0 comments on commit 2e338a8

Please sign in to comment.