Skip to content

Pull requests: pytorch/torchtitan

New pull request New
291 Open 2,051 Closed
291 Open 2,051 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(hf_datasets): shuffle HuggingFaceTextDataset on re-loop and replay on resume ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3023 opened Apr 18, 2026 by CrepuscularIRIS Loading…
1
3
[Do Not Merge] DUMMY PR: Find Device Name for MI325 runner ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3021 opened Apr 18, 2026 by akashveramd Collaborator • Draft
@akashveramd
[GraphTrainer][AutoDev] Remove compile_with_inductor annotation from qwen3 FlexAttention ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3019 opened Apr 17, 2026 by SherlockNoMad Contributor • Draft
3 of 4 tasks
[GraphTrainer][AutoDev] Remove unused standalone GraphTrainerConfig dataclass ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3018 opened Apr 17, 2026 by SherlockNoMad Contributor • Draft
3 of 4 tasks
Gate H100.8 CI workflows behind ciflow/h100.8 label ciflow/h100.8 Trigger H100.8 CI ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3016 opened Apr 17, 2026 by SherlockNoMad Contributor Loading…
3 tasks
4
[GraphTrainer] Introduce CPU offload pass for activation memory savings ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3015 opened Apr 17, 2026 by mlazos Loading…
2
[graph_trainer] Add MANIFESTO.md ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3014 opened Apr 17, 2026 by SherlockNoMad Contributor Loading…
1
fix: normalize n_tokens_seen by cp_degree when context parallelism is… ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3009 opened Apr 17, 2026 by TryingtobeingNikhil Loading…
1
9
Fix: reproducible training resume across epoch boundaries for map and streaming datasets ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3008 opened Apr 17, 2026 by slimfrkha Contributor Loading…
7
[HybridEP] Enable HybridEP with graph_trainer AOT compilation ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3007 opened Apr 17, 2026 by syed-ahmed Contributor Loading…
1 task
2
[ignore-for-now][llm_trainer] Add experiment for LLM-driven model optimization ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3006 opened Apr 17, 2026 by bobrenjc93 Contributor • Draft
[rl] [not ready for review] Generator refactor ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3001 opened Apr 16, 2026 by joecummings Member • Draft
pp auxloss ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3000 opened Apr 16, 2026 by pianpwk Contributor • Draft
Fix DTensor attr handling in make_fx tracer ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2998 opened Apr 16, 2026 by tugsbayasgalan Contributor Loading…
2
[graph_trainer] Copy forward metadata to backward subgraphs ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2995 opened Apr 16, 2026 by tugsbayasgalan Contributor Loading…
Fix batch invariant mode: using NCCL tree based all-reduce ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2994 opened Apr 16, 2026 by wwwjn Contributor Loading…
8
spmd types draft ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2988 opened Apr 15, 2026 by pianpwk Contributor • Draft
[NOT READY FOR REVIEW][Full DTensor] Config-based Full DTensor for Llama3 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2987 opened Apr 15, 2026 by fegin Contributor • Draft
[NOT READY FOR REVIEW][Module] Remove LocalMapInnerAttention, use static LocalMapSpec ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2986 opened Apr 15, 2026 by fegin Contributor Loading…
[rl] Trainer refactor ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2985 opened Apr 15, 2026 by joecummings Member Loading…
47
Refactor Loss with Scale to fix PP last stage gradients ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2984 opened Apr 15, 2026 by wwwjn Contributor Loading…
1
Increase timeout for features test to 60 minutes. ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2982 opened Apr 15, 2026 by akashveramd Collaborator Loading…
@akashveramd
4
re-enable compile tests ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2978 opened Apr 15, 2026 by acisseJZhong Contributor Loading…
1
[demo] verify fully_shard([norm, head]) and fully_shard([tok_embedding, norm, head]) works with chunked loss ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2976 opened Apr 15, 2026 by weifengpy Contributor • Draft
Collect peak memory directly in integration tests ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2974 opened Apr 15, 2026 by tugsbayasgalan Contributor Loading…
1
ProTip! Filter pull requests by the default branch with base:main.