[Roadmap] SparseML Roadmap Q1 2024

[mgoin]

Short-term Work

Issues or PRs that the NM team are planning to tackle for this quarter:

• SparseGPT one-shot pruning for Transformers

  • Support for text generation LLMs AutoModelForCausalLM Introduce a wrapper to create SparseAutoModelForCausalLM.from_pretrained #2010
  • General model support AutoModel Add AutoModel support for SparseAutoModel #2003

• Saving compressed models

  • Export sparse models w/ sparsity_config to Transformers
  • Export weight-quantized models w/ quant_config to Transformers
  • Export W8A8-quantized models w/ quant_config to Transformers

Long-term Tracked Feature Requests/Issues

[mgoin]

Q1 is done!