Skip to content

Pull requests: pytorch/torchtune

New pull request New
57 Open 1,385 Closed
57 Open 1,385 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

added tie_word_embeddings to llama3_2 models CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2331 opened Feb 3, 2025 by jingzhaoou Loading…
1 of 12 tasks
9
TP + FSDP distributed training (full finetuning) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2330 opened Feb 2, 2025 by acisseJZhong Loading…
2 of 13 tasks
2
[WIP] Add distributed inference for llama3.2 vision CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2328 opened Feb 1, 2025 by acisseJZhong Loading…
13 tasks
3
try fix a bug for symbolic check CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2327 opened Feb 1, 2025 by ywq880611 Loading…
2 of 13 tasks
3
[Very WiP] R1-Style distributed GRPO CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2326 opened Feb 1, 2025 by RedTachyon • Draft
1 of 13 tasks
2
Refactor validate missing for LoRA + deprecate param utility CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2321 opened Jan 31, 2025 by RdoubleA Loading…
7 of 13 tasks
2
[WIP] 2D parallelism for training CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2318 opened Jan 29, 2025 by joecummings • Draft
3
Text-to-Image Dataset and Flux Transform CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2311 opened Jan 29, 2025 by calvinpelletier Loading…
5 tasks done
1
Flux Model CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2302 opened Jan 27, 2025 by calvinpelletier Loading…
7 tasks done
17
Multinode support in torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2301 opened Jan 27, 2025 by joecummings Loading…
64
Custom DPO losses support CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2292 opened Jan 22, 2025 by krammnic Loading…
3 of 13 tasks
8
Add masking strategies to message transforms CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2284 opened Jan 20, 2025 by supreethmanyam Loading…
7 of 13 tasks
13
Full DPO Distributed CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2275 opened Jan 17, 2025 by sam-pi Loading…
9 tasks done
75
[EZ] Pass seed to data sampler. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2266 opened Jan 14, 2025 by EugenHotaj Loading…
4 of 13 tasks
13
Update QuantizationRecipe to use checkpointer.save_checkpoint CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2257 opened Jan 13, 2025 by Ankur-singh Loading…
5 of 13 tasks
13
Adds validation loss to LoRA fine tune single device CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2238 opened Jan 8, 2025 by MaxFrax Loading…
5 of 13 tasks
29
[WIP] Add 2D Parallelism (FSDP + Tensor Parallel) LoRA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2204 opened Dec 24, 2024 by matthew-hippocratic Loading…
7 tasks done
9
[RFC] Online and offline adaptive batching in torchtune. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2199 opened Dec 22, 2024 by krammnic Loading…
3
Add Phi4 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2197 opened Dec 21, 2024 by krammnic Loading…
6 of 13 tasks
75
Integrate new released Falcon3 Family base models
#2171 opened Dec 18, 2024 by abdalgader-a Loading…
7
Add example recipes for CPU and XPU CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2160 opened Dec 16, 2024 by zxd1997066 • Draft
3 of 13 tasks
4
[RFC] Image Generation Dataset CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#2140 opened Dec 10, 2024 by calvinpelletier Loading…
23
[RFC] Step-based checkpointing in torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#2105 opened Dec 3, 2024 by joecummings Loading…
5
Check for attr self._writer in case of import errors on TensorboardLogger CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2092 opened Nov 28, 2024 by joecummings • Draft
13 tasks
1
Implement activation offloading and opt_in_bwd in knowledge_distillation recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2088 opened Nov 27, 2024 by AnuravModak Loading…
5
ProTip! What’s not been updated in a month: updated:<2025-01-04.