diff --git a/.github/BECOMING_A_CORE_CONTRIBUTOR.md b/.github/BECOMING_A_CORE_CONTRIBUTOR.md index 51d326d9eb..3042c318cb 100644 --- a/.github/BECOMING_A_CORE_CONTRIBUTOR.md +++ b/.github/BECOMING_A_CORE_CONTRIBUTOR.md @@ -58,7 +58,7 @@ There's also [GitHub discussions](https://github.com/Lightning-AI/lightning/disc ## Applying There are no precise targets for becoming a core contributor. In the past, community members have become core after fitting the previous expectations consistently. -We are on the lookout for new people to join, however, if you feel like you meet the expectations already and we haven't reached out to you yet, feel free to ping us privately on [![Discord](https://img.shields.io/discord/1077906959069626439?style=plastic)](https://discord.gg/VptPCZkGNa)!. +We are on the lookout for new people to join, however, if you feel like you meet the expectations already and we haven't reached out to you yet, feel free to ping us privately on [Discord](https://discord.gg/XbUZ3xbdQk). ## Employment diff --git a/docs/source-pytorch/common/index.rst b/docs/source-pytorch/common/index.rst index a5535a95b0..0d09ecebe5 100644 --- a/docs/source-pytorch/common/index.rst +++ b/docs/source-pytorch/common/index.rst @@ -176,8 +176,8 @@ How-to Guides .. displayitem:: :header: Track and Visualize Experiments :description: Learn to track and visualize experiments - :col_css: col-md-14 - :button_link: visualize/logging_intermediate.html + :col_css: col-md-4 + :button_link: ../visualize/logging_intermediate.html :height: 180 .. displayitem:: diff --git a/docs/source-pytorch/community/index.rst b/docs/source-pytorch/community/index.rst index 0bc87c04a5..95f30a6bdf 100644 --- a/docs/source-pytorch/community/index.rst +++ b/docs/source-pytorch/community/index.rst @@ -59,7 +59,7 @@ Community :header: Past PyTorch Lightning versions :description: Docs and upgrade guide for past versions :col_css: col-md-12 - :button_link: past_versions.html + :button_link: ../past_versions.html :height: 100 .. displayitem:: diff --git a/docs/source-pytorch/data/data.rst b/docs/source-pytorch/data/data.rst index 92e136a8b5..6a0f2916b9 100644 --- a/docs/source-pytorch/data/data.rst +++ b/docs/source-pytorch/data/data.rst @@ -32,14 +32,6 @@ Complex data uses :height: 150 :tag: basic -.. displayitem:: - :header: Streaming datasets - :description: Using iterable-style datasets with Lightning - :col_css: col-md-4 - :button_link: streaming.html - :height: 150 - :tag: intermediate - .. displayitem:: :header: Faster DataLoaders :description: How alternative dataloader projects can be used with Lightning diff --git a/docs/source-pytorch/expertise_levels.rst b/docs/source-pytorch/expertise_levels.rst index bc96e4d3b8..3f98c8e2ce 100644 --- a/docs/source-pytorch/expertise_levels.rst +++ b/docs/source-pytorch/expertise_levels.rst @@ -92,7 +92,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 9: Modularize your projects + :header: Level 8: Modularize your projects :description: Create DataModules to enable dataset reusability. :col_css: col-md-6 :button_link: levels/intermediate_level_9.html @@ -100,7 +100,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 10: Understand your model + :header: Level 9: Understand your model :description: Use advanced visuals to find the best performing model. :col_css: col-md-6 :button_link: levels/intermediate_level_10.html @@ -108,7 +108,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 11: Explore SOTA scaling techniques + :header: Level 10: Explore SOTA scaling techniques :description: Explore SOTA techniques to help convergence, stability and scalability. :col_css: col-md-6 :button_link: levels/intermediate_level_11.html @@ -116,7 +116,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 12: Deploy your models + :header: Level 11: Deploy your models :description: Learn how to deploy your models with optimizations like ONNX and torchscript. :col_css: col-md-6 :button_link: levels/intermediate_level_12.html @@ -124,7 +124,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 13: Optimize training speed + :header: Level 12: Optimize training speed :description: Use advanced profilers to mixed precision to train bigger models, faster. :col_css: col-md-6 :button_link: levels/intermediate_level_13.html @@ -132,7 +132,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 14: Run on on-prem clusters + :header: Level 13: Run on on-prem clusters :description: Run on a custom on-prem cluster or SLURM cluster. :col_css: col-md-6 :button_link: levels/intermediate_level_14.html @@ -158,7 +158,7 @@ Configure all aspects of Lightning for advanced usecases. .. Add callout items below this line .. displayitem:: - :header: Level 15: Customize configs to run in production + :header: Level 14: Customize configs to run in production :description: Enable composable YAMLs :col_css: col-md-6 :button_link: levels/advanced_level_15.html @@ -166,7 +166,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 16: Customize the trainer + :header: Level 15: Customize the trainer :description: Inject custom code into the trainer and modify the progress bar. :col_css: col-md-6 :button_link: levels/advanced_level_16.html @@ -174,7 +174,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 17: Own the training loop + :header: Level 16: Own the training loop :description: Learn all the ways of owning your raw PyTorch loops with Lighting. :col_css: col-md-6 :button_link: levels/advanced_level_17.html @@ -182,7 +182,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 18: Enable advanced checkpointing + :header: Level 17: Enable advanced checkpointing :description: Enable composable or cloud based checkpoints. :col_css: col-md-6 :button_link: levels/advanced_level_18.html @@ -190,7 +190,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 19: Explore IPUs + :header: Level 18: Explore IPUs :description: Explore Intelligence Processing Unit (IPU) for model scaling. :col_css: col-md-6 :button_link: levels/advanced_level_19.html @@ -198,7 +198,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 20: Explore HPUs + :header: Level 19: Explore HPUs :description: Explore Havana Gaudi Processing Unit (HPU) for model scaling. :col_css: col-md-6 :button_link: levels/advanced_level_20.html @@ -206,7 +206,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 21: Master TPUs + :header: Level 20: Master TPUs :description: Master TPUs and run on cloud TPUs. :col_css: col-md-6 :button_link: levels/advanced_level_21.html @@ -214,7 +214,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 22: Reach 1 trillion parameters on GPUs + :header: Level 21: Reach 1 trillion parameters on GPUs :description: Scale to 1 trillion params on GPUs. :col_css: col-md-6 :button_link: levels/advanced_level_22.html @@ -240,7 +240,7 @@ Customize and extend Lightning for things like custom hardware or distributed st .. Add callout items below this line .. displayitem:: - :header: Level 23: Extend the Lightning CLI + :header: Level 22: Extend the Lightning CLI :description: Extend the functionality of the Lightning CLI. :col_css: col-md-6 :button_link: levels/expert_level_23.html @@ -248,7 +248,7 @@ Customize and extend Lightning for things like custom hardware or distributed st :tag: expert .. displayitem:: - :header: Level 24: Integrate a custom cluster + :header: Level 23: Integrate a custom cluster :description: Integrate a custom cluster into Lightning. :col_css: col-md-6 :button_link: levels/expert_level_24.html @@ -256,7 +256,7 @@ Customize and extend Lightning for things like custom hardware or distributed st :tag: expert .. displayitem:: - :header: Level 26: Make your own profiler + :header: Level 24: Make your own profiler :description: Make your own profiler. :col_css: col-md-6 :button_link: tuning/profiler_expert.html @@ -264,7 +264,7 @@ Customize and extend Lightning for things like custom hardware or distributed st :tag: expert .. displayitem:: - :header: Level 27: Add a new accelerator or Strategy + :header: Level 25: Add a new accelerator or Strategy :description: Integrate a new accelerator or distributed strategy. :col_css: col-md-6 :button_link: levels/expert_level_27.html diff --git a/docs/source-pytorch/levels/advanced.rst b/docs/source-pytorch/levels/advanced.rst index df4bca0e5a..f04f562b7c 100644 --- a/docs/source-pytorch/levels/advanced.rst +++ b/docs/source-pytorch/levels/advanced.rst @@ -14,7 +14,7 @@ Configure all aspects of Lightning for advanced usecases. .. Add callout items below this line .. displayitem:: - :header: Level 15: Customize configs to run in production + :header: Level 14: Customize configs to run in production :description: Enable composable YAMLs :col_css: col-md-6 :button_link: advanced_level_15.html @@ -22,7 +22,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 16: Customize the trainer + :header: Level 15: Customize the trainer :description: Inject custom code into the trainer and modify the progress bar. :col_css: col-md-6 :button_link: advanced_level_16.html @@ -30,7 +30,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 17: Own the training loop + :header: Level 16: Own the training loop :description: Learn all the ways of owning your raw PyTorch loops with Lighting. :col_css: col-md-6 :button_link: advanced_level_17.html @@ -38,7 +38,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 18: Enable advanced checkpointing + :header: Level 17: Enable advanced checkpointing :description: Enable composable or cloud based checkpoints. :col_css: col-md-6 :button_link: advanced_level_18.html @@ -46,7 +46,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 19: Explore IPUs + :header: Level 18: Explore IPUs :description: Explore Intelligence Processing Unit (IPU) for model scaling. :col_css: col-md-6 :button_link: advanced_level_19.html @@ -54,7 +54,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 20: Explore HPUs + :header: Level 19: Explore HPUs :description: Explore Habana Gaudi Processing Unit (HPU) for model scaling. :col_css: col-md-6 :button_link: advanced_level_20.html @@ -62,7 +62,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 21: Master TPUs + :header: Level 20: Master TPUs :description: Master TPUs and run on cloud TPUs. :col_css: col-md-6 :button_link: advanced_level_21.html @@ -70,7 +70,7 @@ Configure all aspects of Lightning for advanced usecases. :tag: advanced .. displayitem:: - :header: Level 22: Reach 1 trillion parameters on GPUs + :header: Level 21: Reach 1 trillion parameters on GPUs :description: Scale to 1 trillion params on GPUs. :col_css: col-md-6 :button_link: advanced_level_22.html diff --git a/docs/source-pytorch/levels/advanced_level_15.rst b/docs/source-pytorch/levels/advanced_level_15.rst index 761dbd328e..fbbb4ef72c 100644 --- a/docs/source-pytorch/levels/advanced_level_15.rst +++ b/docs/source-pytorch/levels/advanced_level_15.rst @@ -1,7 +1,7 @@ :orphan: ################################################ -Level 15: Customize configs to run in production +Level 14: Customize configs to run in production ################################################ This level goes over advanced YAML use for running models in production. diff --git a/docs/source-pytorch/levels/advanced_level_16.rst b/docs/source-pytorch/levels/advanced_level_16.rst index fd41df1205..2e70c4b5c0 100644 --- a/docs/source-pytorch/levels/advanced_level_16.rst +++ b/docs/source-pytorch/levels/advanced_level_16.rst @@ -1,10 +1,10 @@ :orphan: ############################### -Level 16: Customize the trainer +Level 15: Customize the trainer ############################### -In this level, you'll learn to modify the Trainer behavior. +In this level you'll learn to modify the behavior of the Trainer. ---- diff --git a/docs/source-pytorch/levels/advanced_level_17.rst b/docs/source-pytorch/levels/advanced_level_17.rst index f18b5ad101..cc375dd888 100644 --- a/docs/source-pytorch/levels/advanced_level_17.rst +++ b/docs/source-pytorch/levels/advanced_level_17.rst @@ -1,10 +1,10 @@ :orphan: ############################### -Level 17: Own the training loop +Level 16: Own the training loop ############################### -Learn all the ways of owning your raw PyTorch loops with Lighting. +Learn all the ways of owning your raw PyTorch loops with Lightning. ---- @@ -23,6 +23,14 @@ Learn all the ways of owning your raw PyTorch loops with Lighting. :height: 150 :tag: advanced +.. displayitem:: + :header: Use Lightning Fabric + :description: Write your own training loops using lightning Fabric. + :col_css: col-md-4 + :button_link: https://lightning.ai/docs/fabric/stable/ + :height: 150 + :tag: advanced + .. raw:: html diff --git a/docs/source-pytorch/levels/advanced_level_18.rst b/docs/source-pytorch/levels/advanced_level_18.rst index a7d7966743..b34861d46f 100644 --- a/docs/source-pytorch/levels/advanced_level_18.rst +++ b/docs/source-pytorch/levels/advanced_level_18.rst @@ -1,10 +1,10 @@ :orphan: ####################################### -Level 18: Enable advanced checkpointing +Level 17: Enable advanced checkpointing ####################################### -This level shows you how to enable composable and/or cloud based checkpoints. +This level shows you how to enable composable and/or cloud-based checkpoints. ---- diff --git a/docs/source-pytorch/levels/advanced_level_19.rst b/docs/source-pytorch/levels/advanced_level_19.rst index c7b66974f1..4265b039b5 100644 --- a/docs/source-pytorch/levels/advanced_level_19.rst +++ b/docs/source-pytorch/levels/advanced_level_19.rst @@ -1,7 +1,7 @@ :orphan: ###################### -Level 19: Explore IPUs +Level 18: Explore IPUs ###################### Explore Intelligence Processing Unit (IPU) for model scaling. diff --git a/docs/source-pytorch/levels/advanced_level_21.rst b/docs/source-pytorch/levels/advanced_level_21.rst index 5252a1cd9c..92358c04eb 100644 --- a/docs/source-pytorch/levels/advanced_level_21.rst +++ b/docs/source-pytorch/levels/advanced_level_21.rst @@ -1,7 +1,7 @@ :orphan: ##################### -Level 21: Master TPUs +Level 20: Master TPUs ##################### Master cloud TPU training with profiling and scaling techniques. diff --git a/docs/source-pytorch/levels/advanced_level_22.rst b/docs/source-pytorch/levels/advanced_level_22.rst index a90a482622..1e4dc39bcf 100644 --- a/docs/source-pytorch/levels/advanced_level_22.rst +++ b/docs/source-pytorch/levels/advanced_level_22.rst @@ -1,7 +1,7 @@ :orphan: ############################################# -Level 22: Reach 1 trillion parameters on GPUs +Level 21: Reach 1 trillion parameters on GPUs ############################################# Scale to 1 trillion+ parameters with multiple distributed strategies. diff --git a/docs/source-pytorch/levels/expert.rst b/docs/source-pytorch/levels/expert.rst index a1c2baa545..c73414201e 100644 --- a/docs/source-pytorch/levels/expert.rst +++ b/docs/source-pytorch/levels/expert.rst @@ -14,7 +14,7 @@ Customize and extend Lightning for things like custom hardware or distributed st .. Add callout items below this line .. displayitem:: - :header: Level 23: Extend the Lightning CLI + :header: Level 22: Extend the Lightning CLI :description: Extend the functionality of the Lightning CLI. :col_css: col-md-6 :button_link: expert_level_23.html @@ -22,7 +22,7 @@ Customize and extend Lightning for things like custom hardware or distributed st :tag: expert .. displayitem:: - :header: Level 24: Integrate a custom cluster + :header: Level 23: Integrate a custom cluster :description: Integrate a custom cluster into Lightning. :col_css: col-md-6 :button_link: expert_level_24.html @@ -30,7 +30,7 @@ Customize and extend Lightning for things like custom hardware or distributed st :tag: expert .. displayitem:: - :header: Level 26: Make your own profiler + :header: Level 24: Make your own profiler :description: Make your own profiler. :col_css: col-md-6 :button_link: ../tuning/profiler_expert.html @@ -38,7 +38,7 @@ Customize and extend Lightning for things like custom hardware or distributed st :tag: expert .. displayitem:: - :header: Level 27: Add a new accelerator or Strategy + :header: Level 25: Add a new accelerator or Strategy :description: Integrate a new accelerator or distributed strategy. :col_css: col-md-6 :button_link: expert_level_27.html diff --git a/docs/source-pytorch/levels/expert_level_23.rst b/docs/source-pytorch/levels/expert_level_23.rst index 9b143a0a8e..5d1ba67e96 100644 --- a/docs/source-pytorch/levels/expert_level_23.rst +++ b/docs/source-pytorch/levels/expert_level_23.rst @@ -1,7 +1,7 @@ :orphan: ################################## -Level 23: Extend the Lightning CLI +Level 22: Extend the Lightning CLI ################################## Extend the functionality of the Lightning CLI. diff --git a/docs/source-pytorch/levels/expert_level_24.rst b/docs/source-pytorch/levels/expert_level_24.rst index c602781a2a..54c544ee9d 100644 --- a/docs/source-pytorch/levels/expert_level_24.rst +++ b/docs/source-pytorch/levels/expert_level_24.rst @@ -1,7 +1,7 @@ :orphan: #################################### -Level 24: Integrate a custom cluster +Level 23: Integrate a custom cluster #################################### Extend the functionality of the Lightning CLI. diff --git a/docs/source-pytorch/levels/expert_level_27.rst b/docs/source-pytorch/levels/expert_level_27.rst index c2d682b18d..9b06b10195 100644 --- a/docs/source-pytorch/levels/expert_level_27.rst +++ b/docs/source-pytorch/levels/expert_level_27.rst @@ -1,7 +1,7 @@ :orphan: ########################################### -Level 27: Add a new accelerator or Strategy +Level 25: Add a new accelerator or Strategy ########################################### Integrate a new accelerator or distributed strategy. diff --git a/docs/source-pytorch/levels/intermediate.rst b/docs/source-pytorch/levels/intermediate.rst index 8d2fdf1755..f7beb29788 100644 --- a/docs/source-pytorch/levels/intermediate.rst +++ b/docs/source-pytorch/levels/intermediate.rst @@ -24,7 +24,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 9: Modularize your projects + :header: Level 8: Modularize your projects :description: Create DataModules to enable dataset reusability. :col_css: col-md-6 :button_link: intermediate_level_9.html @@ -32,7 +32,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 10: Understand your model + :header: Level 9: Understand your model :description: Use advanced visuals to find the best performing model. :col_css: col-md-6 :button_link: intermediate_level_10.html @@ -40,7 +40,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 11: Explore SOTA scaling techniques + :header: Level 10: Explore SOTA scaling techniques :description: Explore SOTA techniques to help convergence, stability and scalability. :col_css: col-md-6 :button_link: intermediate_level_11.html @@ -48,7 +48,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 12: Deploy your models + :header: Level 11: Deploy your models :description: Learn how to deploy your models with optimizations like ONNX and torchscript. :col_css: col-md-6 :button_link: intermediate_level_12.html @@ -56,7 +56,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 13: Optimize training speed + :header: Level 12: Optimize training speed :description: Use advanced profilers to mixed precision to train bigger models, faster. :col_css: col-md-6 :button_link: intermediate_level_13.html @@ -64,7 +64,7 @@ Learn to scale up your models and enable collaborative model development at acad :tag: intermediate .. displayitem:: - :header: Level 14: Run on on-prem clusters + :header: Level 13: Run on on-prem clusters :description: Run on a custom on-prem cluster or SLURM cluster. :col_css: col-md-6 :button_link: intermediate_level_14.html diff --git a/docs/source-pytorch/levels/intermediate_level_10.rst b/docs/source-pytorch/levels/intermediate_level_10.rst index d7f5dc512d..1c9b646936 100644 --- a/docs/source-pytorch/levels/intermediate_level_10.rst +++ b/docs/source-pytorch/levels/intermediate_level_10.rst @@ -1,7 +1,7 @@ :orphan: ############################### -Level 10: Understand your model +Level 9: Understand your model ############################### Find the best model using advanced visualizations for deeper insights. diff --git a/docs/source-pytorch/levels/intermediate_level_11.rst b/docs/source-pytorch/levels/intermediate_level_11.rst index 4c7ed0639d..77dbbf9c91 100644 --- a/docs/source-pytorch/levels/intermediate_level_11.rst +++ b/docs/source-pytorch/levels/intermediate_level_11.rst @@ -1,7 +1,7 @@ :orphan: ######################################### -Level 11: Explore SOTA scaling techniques +Level 10: Explore SOTA scaling techniques ######################################### In this level you'll explore SOTA techniques to help convergence, stability and scalability. diff --git a/docs/source-pytorch/levels/intermediate_level_12.rst b/docs/source-pytorch/levels/intermediate_level_12.rst index fe1c076b2d..b92935529a 100644 --- a/docs/source-pytorch/levels/intermediate_level_12.rst +++ b/docs/source-pytorch/levels/intermediate_level_12.rst @@ -1,7 +1,7 @@ :orphan: ############################ -Level 12: Deploy your models +Level 11: Deploy your models ############################ In this level you'll learn a few options for deploying models into production. diff --git a/docs/source-pytorch/levels/intermediate_level_13.rst b/docs/source-pytorch/levels/intermediate_level_13.rst index 38ac7aa182..345e6d6579 100644 --- a/docs/source-pytorch/levels/intermediate_level_13.rst +++ b/docs/source-pytorch/levels/intermediate_level_13.rst @@ -1,7 +1,7 @@ :orphan: ################################# -Level 13: Optimize training speed +Level 12: Optimize training speed ################################# In this level you'll use advanced profilers and mixed precision techniques to train bigger models faster. diff --git a/docs/source-pytorch/levels/intermediate_level_14.rst b/docs/source-pytorch/levels/intermediate_level_14.rst index a779edeed5..b73cce233f 100644 --- a/docs/source-pytorch/levels/intermediate_level_14.rst +++ b/docs/source-pytorch/levels/intermediate_level_14.rst @@ -1,10 +1,10 @@ :orphan: ################################# -Level 14: Run on on-prem clusters +Level 13: Run on on-prem clusters ################################# -In this level you'll learn to run on onprem clusters. +In this level you'll learn to run on on-prem clusters. ---- diff --git a/docs/source-pytorch/levels/intermediate_level_9.rst b/docs/source-pytorch/levels/intermediate_level_9.rst index 8c537d777e..b09db07285 100644 --- a/docs/source-pytorch/levels/intermediate_level_9.rst +++ b/docs/source-pytorch/levels/intermediate_level_9.rst @@ -1,7 +1,7 @@ :orphan: ################################# -Level 9: Modularize your projects +Level 8: Modularize your projects ################################# This module teaches you how to setup complex projects that can be controlled via the CLI.