-
Notifications
You must be signed in to change notification settings - Fork 182
Pull requests: pytorch/torchtitan
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Init weights only if not loading a checkpoint
CLA Signed
This label is managed by the Meta Open Source bot.
[Multimodal model] Add the decoder of the multimodal model
CLA Signed
This label is managed by the Meta Open Source bot.
#626
opened Oct 18, 2024 by
fduwjj
Loading…
[DO NOT REVIEW] gaps to enable FDSP2 cpu offloading
CLA Signed
This label is managed by the Meta Open Source bot.
#622
opened Oct 16, 2024 by
weifengpy
Loading…
[Not for land] Settings to make Llama3-8B on 8 GPUs faster
CLA Signed
This label is managed by the Meta Open Source bot.
[not for land] TE experiments, take 2
CLA Signed
This label is managed by the Meta Open Source bot.
#614
opened Oct 14, 2024 by
vkuzo
Loading…
[DO NOT REVIEW] --experimental.fsdp_sharding_on_largest_dim
CLA Signed
This label is managed by the Meta Open Source bot.
#607
opened Oct 9, 2024 by
weifengpy
Loading…
ensure reproducible determinsitc numerics
CLA Signed
This label is managed by the Meta Open Source bot.
#597
opened Oct 2, 2024 by
weifengpy
Loading…
fix mixed precision for This label is managed by the Meta Open Source bot.
replicate
/ pure DDP
CLA Signed
#591
opened Sep 29, 2024 by
152334H
Loading…
[not for land yet] hack max and abs out of ops eligible for AC
CLA Signed
This label is managed by the Meta Open Source bot.
#580
opened Sep 17, 2024 by
vkuzo
Loading…
add pp validation for schedule
CLA Signed
This label is managed by the Meta Open Source bot.
#568
opened Sep 5, 2024 by
H-Huang
Loading…
Moved logits This label is managed by the Meta Open Source bot.
.float()
to loss and compiled it if compiling
CLA Signed
#551
opened Aug 21, 2024 by
awgu
Loading…
[DO NOT REVIEW] Runtime estimation with FakeTensor + TorchDispatchMode
CLA Signed
This label is managed by the Meta Open Source bot.
#536
opened Aug 20, 2024 by
weifengpy
Loading…
[Not for land] Added changes for GPT-2 perf
CLA Signed
This label is managed by the Meta Open Source bot.
[Not for land] Added GPT-2-like config
CLA Signed
This label is managed by the Meta Open Source bot.
[torchtitan][debug] integrated CommDebugMode into TorchTitan
CLA Signed
This label is managed by the Meta Open Source bot.
#480
opened Jul 24, 2024 by
sinhaanshul
Loading…
[not for land] TE experiments
CLA Signed
This label is managed by the Meta Open Source bot.
#477
opened Jul 23, 2024 by
vkuzo
Loading…
[POC] Adam-mini without explicit collectives
CLA Signed
This label is managed by the Meta Open Source bot.
Updates to support new sdpa function
CLA Signed
This label is managed by the Meta Open Source bot.
#458
opened Jul 13, 2024 by
jainapurva
•
Draft
Fix parsing of pp split points from toml file
CLA Signed
This label is managed by the Meta Open Source bot.
release_blocking
Issues that are blocking the milestone / release completion
Previous Next
ProTip!
Follow long discussions with comments:>50.