lightning/docs/source-pytorch/advanced
Luca Antiga 87565cbca0
FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440)
* Minimal transformer examples

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add tests for compile after fsdp2/tp

* Add README's

* Add docs

* Rename folder, add cross-reference

* Fix link

* Newline after code-block directive

* Update section name

* Fix reference

* Half standalone tests batch size

* Fix integration tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-26 15:29:40 +01:00
..
model_parallel Add Studio badge to tensor parallel docs (#19913) 2024-05-28 09:04:55 -04:00
compile.rst FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440) 2024-11-26 15:29:40 +01:00
ddp_optimizations.rst Update the DDP optimizations page (#18344) 2023-08-19 06:27:53 -04:00
finetuning.rst
model_init.rst Add dedicated docs page for init-module (#18416) 2023-08-28 11:28:38 -04:00
model_parallel.rst docs: update references to ext. integrations (#19248) 2024-01-09 13:12:53 +01:00
post_training_quantization.rst bump python 3.9+ (#20413) 2024-11-25 09:20:17 +01:00
pretrained.rst
pruning_quantization.rst Review APIs experimental status (#17012) 2023-03-09 16:56:49 +00:00
speed.rst Compile guide for Trainer (#19531) 2024-02-28 09:15:33 -05:00
strategy_registry.rst Review APIs experimental status (#17012) 2023-03-09 16:56:49 +00:00
training_tricks.rst Consistent imports in docs for core APIs (#18869) 2023-10-27 14:41:29 -04:00
transfer_learning.rst Count number of modules in train/eval mode in ModelSummary (#20159) 2024-08-04 15:28:26 -04:00
warnings.rst Utility to disable all instances of `PossibleUserWarning` (#18744) 2023-10-10 06:53:32 -04:00