Skip to content

AutoRound(device="0,1,2,3") and --devices 0,1,2,3 could handle calibration and quantization for large model #765

@wenhuach21

Description

@wenhuach21

1 device_map support auto
2 merge device_map and device

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions