-
Notifications
You must be signed in to change notification settings - Fork 156
Pull requests: pytorch/torchtitan
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[PP] Fix PP meta init
CLA Signed
This label is managed by the Meta Open Source bot.
#582
opened Sep 18, 2024 by
wconstab
Loading…
[not for land yet] hack max and abs out of ops eligible for AC
CLA Signed
This label is managed by the Meta Open Source bot.
#580
opened Sep 17, 2024 by
vkuzo
Loading…
add utils.set_determinism for reproducibility
CLA Signed
This label is managed by the Meta Open Source bot.
#576
opened Sep 13, 2024 by
lessw2020
Loading…
add pp validation for schedule
CLA Signed
This label is managed by the Meta Open Source bot.
#568
opened Sep 5, 2024 by
H-Huang
Loading…
Moved logits This label is managed by the Meta Open Source bot.
.float()
to loss and compiled it if compiling
CLA Signed
#551
opened Aug 21, 2024 by
awgu
Loading…
[DO NOT REVIEW] Runtime estimation with FakeTensor + TorchDispatchMode
CLA Signed
This label is managed by the Meta Open Source bot.
#536
opened Aug 20, 2024 by
weifengpy
Loading…
[Not for land] Added changes for GPT-2 perf
CLA Signed
This label is managed by the Meta Open Source bot.
[Not for land] Added GPT-2-like config
CLA Signed
This label is managed by the Meta Open Source bot.
[torchtitan][debug] integrated CommDebugMode into TorchTitan
CLA Signed
This label is managed by the Meta Open Source bot.
#480
opened Jul 24, 2024 by
sinhaanshul
Loading…
[not for land] TE experiments
CLA Signed
This label is managed by the Meta Open Source bot.
#477
opened Jul 23, 2024 by
vkuzo
Loading…
[POC] Adam-mini without explicit collectives
CLA Signed
This label is managed by the Meta Open Source bot.
Updates to support new sdpa function
CLA Signed
This label is managed by the Meta Open Source bot.
#458
opened Jul 13, 2024 by
jainapurva
•
Draft
Fix parsing of pp split points from toml file
CLA Signed
This label is managed by the Meta Open Source bot.
#450
opened Jul 10, 2024 by
wconstab
Loading…
[DO NOT MERGE][example] fold batch and sequence dimensions to accelerate Sequence Parallel
CLA Signed
This label is managed by the Meta Open Source bot.
#437
opened Jul 4, 2024 by
tianyu-l
Loading…
Add load from HF ckpts to FSDP model fails.
CLA Signed
This label is managed by the Meta Open Source bot.
#427
opened Jun 25, 2024 by
MinghaoYan
•
Draft
WIP change to run a zero-bubble like schedule
CLA Signed
This label is managed by the Meta Open Source bot.
#416
opened Jun 21, 2024 by
wconstab
Loading…
[POC] Showed more memory efficient FSDP wrapping
CLA Signed
This label is managed by the Meta Open Source bot.
Add PP tracer + DP test
CLA Signed
This label is managed by the Meta Open Source bot.
#379
opened Jun 1, 2024 by
kwen2501
Loading…
IBM experimental dataloaders
CLA Signed
This label is managed by the Meta Open Source bot.
#376
opened May 31, 2024 by
daviswer
Loading…
Previous Next
ProTip!
Mix and match filters to narrow down what you’re looking for.