lightning/examples
Luca Antiga 87565cbca0
FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440)
* Minimal transformer examples

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add tests for compile after fsdp2/tp

* Add README's

* Add docs

* Rename folder, add cross-reference

* Fix link

* Newline after code-block directive

* Update section name

* Fix reference

* Half standalone tests batch size

* Fix integration tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-26 15:29:40 +01:00
..
fabric FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440) 2024-11-26 15:29:40 +01:00
pytorch FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440) 2024-11-26 15:29:40 +01:00
README.md fix(docs): remove dead link from readme (#20170) 2024-08-06 11:05:00 -04:00
run_fabric_examples.sh copyright Lightning AI team (#16647) 2023-02-06 15:26:51 +01:00
run_pl_examples.sh Refactor PL examples to `examples/pytorch/` (#16925) 2023-03-07 11:24:46 -05:00

README.md

Examples

Note that some examples may rely on new features that are only available in the development branch and may be incompatible with any releases. If you see any errors, you might want to consider switching to a version tag you would like to run examples with. For example, if you're using pytorch-lightning==1.6.4 in your environment and seeing issues, run examples of the tag 1.6.4.


Lightning Fabric Examples

We show how to accelerate your PyTorch code with Lightning Fabric with minimal code changes. You stay in full control of the training loop.


Lightning Trainer Examples

In this folder, we have 2 simple examples that showcase the power of the Lightning Trainer.