Skip to content

Pull requests: microsoft/DeepSpeed

New pull request New
139 Open 2,659 Closed
139 Open 2,659 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix memory leak for pipelined optimizer swapper
#5700 opened Jun 27, 2024 by mauryaavinash95 Loading…
3
Add Windows scripts (deepspeed, ds_report).
#5699 opened Jun 27, 2024 by costin-eseanu Loading…
2
sequence parallel with communication overlap
#5691 opened Jun 21, 2024 by inkcherry Loading…
Switch from torch.cuda.amp.custom_fwd to torch.amp.custom_fwd(device=...)
#5684 opened Jun 18, 2024 by loadams • Draft
Switch what versions of python are supported
#5676 opened Jun 17, 2024 by loadams • Draft
Update xpu-max1100.yml with new config and add some tests
#5668 opened Jun 17, 2024 by Liangliang-Ma Loading…
6
Add and Remove ZeRO 3 Hooks
#5658 opened Jun 13, 2024 by jomayeri Loading…
4
Unpin transformers version
#5650 opened Jun 12, 2024 by loadams Loading…
reduce all-to-all communication volume when both expert and non-expert are tensor-parallel
#5626 opened Jun 7, 2024 by taozhiwei Loading…
13
Hybrid Offloading for ZeRO3
#5625 opened Jun 7, 2024 by tohtana • Draft
fix: quantization with DeepSpeed HE
#5624 opened Jun 6, 2024 by Atry Loading…
1
2
Add support for Phi-3 small to FastGen
#5614 opened Jun 4, 2024 by adk9 • Draft
[INF] Enable torch compile for inference
#5612 opened Jun 4, 2024 by oelayan7 Loading…
11
Upgrade HPU image to v1.16.2.
#5610 opened Jun 4, 2024 by vshekhawat-hlab Loading…
6
[CPU] Allow deepspeed.comm.inference_all_reduce in torch.compile graph
#5604 opened Jun 3, 2024 by delock Loading…
2
state_dict_factory: llama checkpoint - support SWIGLU
#5601 opened Jun 2, 2024 by nelyahu Loading…
2
FastGen H100 MoE support: Add PyTorch multi-gemm MOE implementation
#5586 opened May 29, 2024 by HeyangQin Loading…
7
Update profiler.py
#5584 opened May 29, 2024 by gameofdimension Loading…
reduce cpu host overhead when using moe
#5578 opened May 29, 2024 by ranzhejiang Loading…
7
Reuse KV cache of prefixes
#5572 opened May 27, 2024 by tohtana • Draft
3
Add support for Microsoft Phi-3 model to DeepSpeed-FastGen
#5559 opened May 21, 2024 by adk9 Loading…
Add chatglm2 & chatglm3 autotp
#5540 opened May 16, 2024 by Yejing-Lai Loading…
6
Fix deadlock in PipeEngine._exec_recv_grads
#5518 opened May 10, 2024 by i4never Loading…
3
inference: remove unused _validate_args function
#5505 opened May 8, 2024 by nelyahu Loading…
5
Z3: optimizations for grad norm calculation and gradient clipping
#5504 opened May 7, 2024 by nelyahu Loading…
7
ProTip! Type g i on any issue or pull request to go back to the issue listing page.