2022-04-19 18:15:47 +00:00
Welcome to ⚡ PyTorch Lightning
===============================
.. twocolumns ::
:left:
.. image :: https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/mov.gif
:alt: Animation showing how to convert a standard training loop to a Lightning loop
:right:
PyTorch Lightning is the deep learning framework for professional AI researchers and machine learning engineers who need maximal flexibility without sacrificing performance at scale.
Lightning evolves with you as your projects go from idea to paper/production.
2019-11-28 17:48:55 +00:00
2022-03-28 12:35:59 +00:00
.. raw :: html
<div class="row" style='font-size: 14px'>
<div class='col-md-6'>
</div>
<div class='col-md-6'>
2022-04-19 18:15:47 +00:00
.. join_slack ::
:align: center
:margin: 0
2022-03-28 12:35:59 +00:00
.. raw :: html
</div>
</div>
2022-04-19 18:15:47 +00:00
2022-03-28 12:35:59 +00:00
.. raw :: html
<hr class="docutils" style="margin: 50px 0 50px 0">
Install Lightning
-----------------
.. raw :: html
2022-04-19 18:15:47 +00:00
<div class="row" style='font-size: 16px'>
2022-03-28 12:35:59 +00:00
<div class='col-md-6'>
2022-04-19 18:15:47 +00:00
Pip users
2022-03-28 12:35:59 +00:00
.. code-block :: bash
pip install pytorch-lightning
.. raw :: html
</div>
<div class='col-md-6'>
2022-04-19 18:15:47 +00:00
Conda users
2022-03-28 12:35:59 +00:00
.. code-block :: bash
conda install pytorch-lightning -c conda-forge
.. raw :: html
</div>
</div>
Or read the `advanced install guide <starter/installation.html> `_
2022-12-17 07:27:21 +00:00
We are fully compatible with any stable PyTorch version v1.10 and above.
2022-03-28 12:35:59 +00:00
.. raw :: html
<hr class="docutils" style="margin: 50px 0 50px 0">
2022-04-19 18:15:47 +00:00
Get Started
-----------
2022-03-07 08:46:22 +00:00
.. raw :: html
<div class="tutorials-callout-container">
<div class="row">
.. Add callout items below this line
.. customcalloutitem ::
2022-04-19 18:15:47 +00:00
:description: Learn the 7 key steps of a typical Lightning workflow.
:header: Lightning in 15 minutes
2022-03-07 08:46:22 +00:00
:button_link: starter/introduction.html
2022-03-28 12:35:59 +00:00
2022-03-07 08:46:22 +00:00
.. customcalloutitem ::
2022-04-19 18:15:47 +00:00
:description: Learn how to benchmark PyTorch Lightning.
:header: Benchmarking
:button_link: benchmarking/benchmarks.html
2022-03-28 12:35:59 +00:00
2022-04-19 18:15:47 +00:00
.. raw :: html
2022-03-28 12:35:59 +00:00
2022-04-19 18:15:47 +00:00
</div>
</div>
2022-03-28 12:35:59 +00:00
2022-04-19 18:15:47 +00:00
.. End of callout item section
.. raw :: html
<hr class="docutils" style="margin: 50px 0 50px 0">
Current Lightning Users
-----------------------
.. raw :: html
<div class="tutorials-callout-container">
<div class="row">
.. Add callout items below this line
.. customcalloutitem ::
:description: Learn Lightning in small bites at 4 levels of expertise: Introductory, intermediate, advanced and expert.
:header: Level Up!
:button_link: expertise_levels.html
2022-03-28 12:35:59 +00:00
.. customcalloutitem ::
2022-04-19 18:15:47 +00:00
:description: Detailed description of API each package. Assumes you already have basic Lightning knowledge.
2022-03-28 12:35:59 +00:00
:header: API Reference
:button_link: api_references.html
2022-04-19 18:15:47 +00:00
.. customcalloutitem ::
:description: From NLP, Computer vision to RL and meta learning - see how to use Lightning in ALL research areas.
:header: Hands-on Examples
:button_link: tutorials.html
2022-03-28 12:35:59 +00:00
.. customcalloutitem ::
2022-07-15 15:07:40 +00:00
:description: Learn how to do everything from hyper-parameters sweeps to cloud training to Pruning and Quantization with Lightning.
2022-04-19 18:15:47 +00:00
:header: Common Workflows
2022-03-28 12:35:59 +00:00
:button_link: common_usecases.html
.. customcalloutitem ::
2022-04-19 18:15:47 +00:00
:description: Convert your current code to Lightning
:header: Convert code to PyTorch Lightning
:button_link: starter/converting.html
2022-03-28 12:35:59 +00:00
2022-03-07 08:46:22 +00:00
.. raw :: html
</div>
</div>
.. End of callout item section
2020-10-07 19:26:21 +00:00
2021-09-16 14:14:37 +00:00
.. raw :: html
<div style="display:none">
2019-12-07 05:23:48 +00:00
.. toctree ::
2020-01-17 11:03:31 +00:00
:maxdepth: 1
2019-12-07 05:23:48 +00:00
:name: start
2022-04-19 18:15:47 +00:00
:caption: Get Started
2019-12-07 05:23:48 +00:00
2022-03-03 10:19:05 +00:00
starter/introduction
2022-04-27 17:08:13 +00:00
starter/installation
2022-04-19 18:15:47 +00:00
2020-08-30 15:01:16 +00:00
.. toctree ::
2022-04-19 18:15:47 +00:00
:maxdepth: 2
:name: levels
:caption: Level Up
2020-08-30 15:01:16 +00:00
2022-04-19 18:15:47 +00:00
levels/core_skills
levels/intermediate
levels/advanced
levels/expert
2020-10-12 15:13:26 +00:00
2020-08-30 13:31:36 +00:00
.. toctree ::
:maxdepth: 2
:name: pl_docs
2022-04-19 18:15:47 +00:00
:caption: Core API
2020-08-30 13:31:36 +00:00
2021-01-26 20:07:07 +00:00
common/lightning_module
common/trainer
2023-01-04 17:25:36 +00:00
fabric/fabric
2020-08-30 13:31:36 +00:00
2021-12-10 09:47:44 +00:00
.. toctree ::
:maxdepth: 2
2022-04-19 18:15:47 +00:00
:name: api
:caption: API Reference
2021-12-10 09:47:44 +00:00
2022-04-19 18:15:47 +00:00
api_references
2021-12-10 09:47:44 +00:00
2022-01-06 13:42:44 +00:00
.. toctree ::
:maxdepth: 1
2022-04-19 18:15:47 +00:00
:name: Common Workflows
:caption: Common Workflows
2022-01-06 13:42:44 +00:00
2022-04-19 18:15:47 +00:00
Avoid overfitting <common/evaluation>
model/build_model.rst
2022-11-09 15:36:47 +00:00
cli/lightning_cli
2022-04-19 18:15:47 +00:00
common/progress_bar
deploy/production
advanced/training_tricks
tuning/profiler
Manage experiments <visualize/logging_intermediate>
2022-04-27 17:08:13 +00:00
Organize existing PyTorch into Lightning <starter/converting>
2022-04-19 18:15:47 +00:00
clouds/cluster
2022-04-21 12:03:21 +00:00
Save and load model progress <common/checkpointing>
2022-04-19 18:15:47 +00:00
Save memory with half-precision <common/precision>
2022-04-27 17:08:13 +00:00
advanced/model_parallel
clouds/cloud_training
2022-04-19 18:15:47 +00:00
Train on single or multiple GPUs <accelerators/gpu>
Train on single or multiple HPUs <accelerators/hpu>
Train on single or multiple IPUs <accelerators/ipu>
Train on single or multiple TPUs <accelerators/tpu>
2022-06-24 12:15:48 +00:00
Train on MPS <accelerators/mps>
2022-04-27 17:08:13 +00:00
Use a pretrained model <advanced/pretrained>
2022-11-21 20:30:58 +00:00
Inject Custom Data Iterables <data/custom_data_iterables>
2022-04-19 18:15:47 +00:00
model/own_your_loop
2022-01-06 13:42:44 +00:00
2021-08-03 11:47:20 +00:00
.. toctree ::
:maxdepth: 1
2022-04-19 18:15:47 +00:00
:name: Glossary
:caption: Glossary
Accelerators <extensions/accelerator>
Callback <extensions/callbacks>
Checkpointing <common/checkpointing>
Cluster <clouds/cluster>
Cloud checkpoint <common/checkpointing_advanced>
Console Logging <common/console_logs>
Debugging <debug/debugging>
Early stopping <common/early_stopping>
Experiment manager (Logger) <visualize/experiment_managers>
Fault tolerant training <clouds/fault_tolerant_training>
2022-04-27 17:08:13 +00:00
Finetuning <advanced/finetuning>
2022-04-19 18:15:47 +00:00
Flash <https://lightning-flash.readthedocs.io/en/stable/>
Grid AI <clouds/cloud_training>
GPU <accelerators/gpu>
Half precision <common/precision>
HPU <accelerators/hpu>
Inference <deploy/production_intermediate>
IPU <accelerators/ipu>
Lightning CLI <cli/lightning_cli>
2023-01-10 19:11:03 +00:00
Lightning Fabric <fabric/fabric>
2022-04-19 18:15:47 +00:00
LightningDataModule <data/datamodule>
LightningModule <common/lightning_module>
Lightning Transformers <https://pytorch-lightning.readthedocs.io/en/stable/ecosystem/transformers.html>
Log <visualize/loggers>
Loops <extensions/loops>
TPU <accelerators/tpu>
Metrics <https://torchmetrics.readthedocs.io/en/stable/>
Model <model/build_model.rst>
Model Parallel <advanced/model_parallel>
Plugins <extensions/plugins>
Progress bar <common/progress_bar>
Production <deploy/production_advanced>
Predict <deploy/production_basic>
2022-04-27 17:08:13 +00:00
Pretrained models <advanced/pretrained>
2022-04-19 18:15:47 +00:00
Profiler <tuning/profiler>
Pruning and Quantization <advanced/pruning_quantization>
Remote filesystem and FSSPEC <common/remote_fs>
2022-05-04 16:05:18 +00:00
Strategy <extensions/strategy>
2022-04-19 18:15:47 +00:00
Strategy registry <advanced/strategy_registry>
Style guide <starter/style_guide>
Sweep <clouds/run_intermediate>
SWA <advanced/training_tricks>
SLURM <clouds/cluster_advanced>
Transfer learning <advanced/transfer_learning>
Trainer <common/trainer>
Torch distributed <clouds/cluster_intermediate_2>
2021-08-03 11:47:20 +00:00
2020-10-11 17:12:19 +00:00
.. toctree ::
:maxdepth: 1
2022-04-19 18:15:47 +00:00
:name: Hands-on Examples
:caption: Hands-on Examples
2021-09-16 14:14:37 +00:00
:glob:
2020-10-11 17:12:19 +00:00
2022-04-19 18:15:47 +00:00
notebooks/**/*
2020-10-11 17:12:19 +00:00
PyTorch Lightning 101 class <https://www.youtube.com/playlist?list=PLaMu-SDt_RB5NUm67hU2pdE75j6KaIOv2>
From PyTorch to PyTorch Lightning [Blog] <https://towardsdatascience.com/from-pytorch-to-pytorch-lightning-a-gentle-introduction-b371b7caaf09>
From PyTorch to PyTorch Lightning [Video] <https://www.youtube.com/watch?v=QHww1JH7IDU>
2020-10-07 19:26:21 +00:00
2019-11-28 17:48:55 +00:00
.. toctree ::
:maxdepth: 1
2021-07-01 15:19:09 +00:00
:name: Community
2019-12-07 05:23:48 +00:00
:caption: Community
2019-11-28 17:48:55 +00:00
2021-01-26 20:07:07 +00:00
generated/CODE_OF_CONDUCT.md
generated/CONTRIBUTING.md
generated/BECOMING_A_CORE_CONTRIBUTOR.md
2021-08-18 22:10:27 +00:00
governance
2022-09-15 13:16:14 +00:00
versioning
2021-01-26 20:07:07 +00:00
generated/CHANGELOG.md
2019-11-28 17:48:55 +00:00
2021-09-16 14:14:37 +00:00
.. raw :: html
</div>
2022-11-03 14:55:30 +00:00
.. PyTorch-Lightning documentation master file, created by
sphinx-quickstart on Fri Nov 15 07:48:22 2019.
You can adapt this file completely to your liking, but it should at least
contain the root `toctree` directive.