Popular repositories Loading

1. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Forked from microsoft/Megatron-DeepSpeed

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 1

2. expr expr Public

   Forked from expr-lang/expr

   Expression language for Go

   Go

3. QDrop QDrop Public

   Forked from wimh966/QDrop

   The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization

   Python

4. outlier_suppression outlier_suppression Public

   Forked from wimh966/outlier_suppression

   The official PyTorch implementation of the NeurIPS2022 paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models

   Python

5. Pai-Megatron-Patch Pai-Megatron-Patch Public

   Forked from alibaba/Pai-Megatron-Patch

   The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

   Python