Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,455 Commits 55 Branches 212 Tags 373 MiB
Commit Graph

1954 Commits

Author SHA1 Message Date
Tribhuvan Mishra 12af7711cf
Update index.rst (#18502) 2023-09-12 09:15:04 +02:00
Jirka Borovec 7b43e950a2
docs: switch PyTorch to lai template (#18450) 
* docs: switch Pytorch to lai template
* rtfd
 2023-09-11 18:43:42 +02:00
Jirka Borovec bda974281d
docs: switch Fabric to lai template (#18449) 
* docs: switch Fabric to lai template
* imports
 2023-09-11 18:43:07 +02:00
Adrian Wälchli 4dfc09c2fe
Change auto-device selection for Jupyter notebook environments (#18291) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-09-08 11:49:31 -04:00
Jirka Borovec 565046f337
docs: welcome Fabric like Trainer (#18429) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-09-08 10:33:44 -04:00
Justin Goheen a0133863a3
Update `docs/source-pytorch/common/lightning_module.rst` (#18451) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-09-08 04:44:24 -04:00
Carlos Mocholí 756e481969
Support the TransformerEngine precision plugin with the Trainer (#18459) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-09-07 19:21:00 +02:00
Alex Morehead 095d9cf279
docs: Fix typos and wording in cluster_advanced.rst (#18465) 2023-09-03 09:06:33 -04:00
Quinten Roets d5440a0b3f
Configurable metric formatting for RichProgressBar (#18373) 2023-08-29 17:00:31 +02:00
Jirka Borovec 5f5d99eae6
Relax app dependencies for `lightning` | breaking imports from `L` (#18386) 
* make App conditional import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci: min req.

* data + store

* typo

* module_available

* extra

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* envs

* doctest

* more

* docs

* **

* rm

* -f

* Apply suggestions from code review

* docs

* Revert "docs"

This reverts commit 20e8e6be98.

* Apply suggestions from code review

* warnings

* breaking

* ...

* fixing source

* fixing examples

* fixing tests

* fixing docs

* fixing source

* fix mock

* fix trainer

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-28 11:28:58 -04:00
Adrian Wälchli d3ee410100
Add dedicated docs page for init-module (#18416) 2023-08-28 11:28:38 -04:00
Jirka Borovec 8218097833
docs: updating logos (#18375) 2023-08-28 16:49:28 +02:00
Adrian Wälchli 04c0675bd0
Update titles in FSDP docs (#18389) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-08-25 10:38:01 -04:00
Maxim Borodin 9d7a2848b7
Fix typo in `BasePredictionWriter` documentation (#18381) 2023-08-24 12:34:50 +02:00
Quinten Roets 8680dc55b3
Make delimiter in rich progress bar configurable (#18372) 2023-08-24 09:55:00 +02:00
Adrian Wälchli f4825e5778
Extend FSDP guide with checkpointing (#18374) 2023-08-23 20:23:16 +02:00
Jirka Borovec 547e7aa393
docs: 1/3 enable Sphinx nitpicky [fabric] (#18069) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-23 10:31:20 +02:00
Jirka Borovec 3f73231d5c
ci/docs: enable not fetch assets (#18333) 2023-08-21 20:22:21 +02:00
Adrian Wälchli 2eb62141f6
Update the DDP optimizations page (#18344) 2023-08-19 06:27:53 -04:00
Adrian Wälchli 2ca1571065
Fix upgrade guide regarding removed `Trainer.reset_*_dataloaders()` (#18341) 2023-08-18 18:24:11 +02:00
Adrian Wälchli 6df43685ee
Revamp model parallel docs (FSDP) (3/n) (#18326) 2023-08-17 15:30:58 -04:00
Jirka Borovec cf8f8ab383
docs: fix dead links for App (#18332) 2023-08-17 17:48:45 +02:00
Jirka Borovec 8ade7d08ea
docs: fix dead links for Trainer (#18331) 2023-08-17 12:51:25 +02:00
Adrian Wälchli 36a203ba58
Revamp model parallel docs (2/n) (#18325) 2023-08-16 13:22:14 -04:00
Adrian Wälchli 725159ed60
Revamp model parallel docs (1/n) (#18314) 2023-08-16 08:06:50 -04:00
Jirka Borovec c98fb36b11
update ci for legacy upload (#18316) 
* update ci for legacy upload

* docs
 2023-08-15 17:32:39 -04:00
Adrian Wälchli 03ca31c3d3
Avoid updating the device for XLA FSDP in `Fabric.setup()` [TPU] (#18276) 2023-08-11 22:00:23 -04:00
Adrian Wälchli 7fe8756917
[TPU] Proper half-precision implementation for XLA (#18213) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-11 11:37:41 -04:00
Carlos Mocholí c83774a109
Update docs about double precision with complex numbers (#18269) 2023-08-10 10:36:55 +02:00
Adrian Wälchli 888466b144
Support true 16-bit precision with FSDP in Trainer (#18219) 2023-08-10 04:15:35 -04:00
Jirka Borovec efa7b2f9ef
docformatter: config with black (#18064) 
* docformatter: config with black

* additional_dependencies: [tomli]

* 119

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-09 10:44:20 -04:00
Jirka Borovec 8f29bb561b
bump sphinx to 5.3 (#18204) 2023-08-08 15:32:34 +02:00
Adrian Wälchli c5cb532694
True half-precision support in Trainer (#18193) 
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-08-02 07:56:22 -04:00
Adrian Wälchli 3fd24f9591
Remove outdated warning about loading full-state checkpoints in FSDP (#18208) 2023-08-01 20:06:30 +02:00
Adrian Wälchli 04e2d800af
Fix pip install instructions in LightningCLI docs (#18201) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-07-31 16:15:58 -04:00
Adrian Wälchli 1db471305d
Avoid setting the multiprocessing context when importing lightning (#18177) 
* avoid import at top module

* tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove comment

* update docs

* changelog

* mypy

* trigger app tests

* can't import lightning on py 3.8

* Update .github/workflows/ci-tests-app.yml

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-07-31 18:05:21 +02:00
Adrian Wälchli 1e0fa1836e
Update migration guide for renamed progress bar base class (#18178) 2023-07-31 09:36:46 -04:00
Luca Antiga a7bbbcea9a
Remove cluster commands from CLI (#18151) 
* Remove cluster commands from CLI

* Update docs

* Remove index entry

* Revert accidental conversion to static assets

* Remove reference to deleted file

* Fix highlights

* Fix highlights

* Remove file

* Update CHANGELOG

* Fix dead link

* Increase upper bound on state size to reduce flakiness
 2023-07-28 00:16:21 +02:00
Adrian Wälchli 6552d29a12
Document limitations of multi-GPU in Jupyter notebooks (#18132) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-24 15:22:16 -04:00
Adrian Wälchli 2af425328a
Add FSDP to the docs glossary (#18121) 2023-07-20 09:07:37 +02:00
Adrian Wälchli 6ab6ab8193
Fabric FSDP documentation guide (#18109) 2023-07-19 18:39:07 +02:00
Carlos Mocholí 071f85842e
Support NVIDIA's Transformer Engine as a precision plugin (#17597) 2023-07-19 18:21:58 +02:00
Carlos Mocholí d653e4e088
Relax the assumption that the root module is FSDP wrapped (#18054) 2023-07-19 15:34:03 +02:00
Adrian Wälchli dab373de54
Support loading a raw PyTorch state-dict checkpoint in Fabric (#18049) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-18 14:06:17 -04:00
Jirka Borovec 6b52b84ef8
docs: fallback for restoring right scroll menu (#18108) 2023-07-18 14:06:18 +02:00
Adrian Wälchli d79eaae334
Update deepspeed model-parallel docs (#18091) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-17 12:02:54 -04:00
Adrian Wälchli b8d4a70db7
Make introduction example run on devices (#18097) 2023-07-17 17:19:16 +02:00
Carlos Mocholí c60f67e736
Support sets for policies in FSDP (#18084) 2023-07-15 17:39:28 +02:00
Carlos Mocholí 2f657ae46e
Support custom policies for activation checkpointing with FSDP (#18045) 2023-07-14 20:00:52 +02:00
Carlos Mocholí 340eecd846
Add `Trainer.init_module` and `LightningModule.configure_model` (#18004) 2023-07-14 19:15:05 +02:00
Carlos Mocholí ad74f8623f
Don't reapply activation checkpointing (#18006) 2023-07-10 13:24:09 +00:00
Minh-Long Luu (刘明龙) c8656f1a27
docs: `fabric_methods.rst` using deprecated parameters (#18015) 2023-07-07 11:32:09 +02:00
Adrian Wälchli 036bd74e47
Disable video controls in Fabric teaser animations (#17984) 2023-07-04 13:27:54 +02:00
Jirka Borovec 00a0f2e8f4
docs: fetch external sources (#17941) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-03 20:16:45 +02:00
Callum Hay 7278fa5007
docs: add example note for gradient accumulation in manual optimization mode (#17975) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-03 10:16:04 -04:00
edenlightning 049f6c576a
docs index update (#17780) 
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2023-06-21 16:04:06 +00:00
Jirka Borovec 6b0ec10ab0
docs: include external pages (#17826) 
* pull docs

* local

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ...

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* replace

* strategies

* 1.0.0

* skip

* links

* more

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-06-21 17:32:20 +02:00
Carlos Mocholí 58d2387e0c
Add `Fabric.save(filter=...)` (#17845) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-06-20 18:18:59 +00:00
Adrian Wälchli 1204006637
Document tensor shape requirements in `all_gather` (#17816) 2023-06-15 17:30:02 +02:00
Jirka Borovec 76515140d8
docs: bump sphinx ver. (#17824) 
* docs: bump sphinx ver.

* myst-parser

* myst-parser

* myst-parser

* 6.2
 2023-06-15 09:37:04 -04:00
Adrian Wälchli 9ff7d7120b
Add `rank_zero_first` utility (#17784) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-06-12 10:32:32 +00:00
one-matrix 2af57c702a
Custom DeepSpeed config format error with offload_optimizer (#17790) 
Co-authored-by: francis <xiao.wei@synyi.com>
 2023-06-08 22:25:17 +02:00
Adrian Wälchli 3cfacc7d3e
Document non-strict loading of checkpoints in Fabric (#17765) 2023-06-07 22:24:21 +00:00
Adrian Wälchli 24a3115995
Support empty weight initialization in `Fabric.init_module()` (#17627) 2023-06-07 18:33:53 +00:00
Adrian Wälchli 88cd100369
Address feedback for `Fabric.init_module()` (1/4) (#17721) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-05-31 14:05:29 +00:00
Bas Krahmer a37f5a546c
omitted mention of QuantizationAwareTraining callback (#17646) 
Co-authored-by: bas <bas.krahmer@talentflyxpert.com>
 2023-05-17 17:23:46 +00:00
edenlightning e470997af9
docs: fix links in fabric (#17611) 2023-05-11 22:56:11 +02:00
edenlightning c94f1563c4
Fix docs levels and broken links (without rename) (#17545) 
* Fix docs levels and broken links

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update advanced_level_17.rst

* Delete oryx-build-commands.txt

* Update BECOMING_A_CORE_CONTRIBUTOR.md

* Update expert_level_24.rst

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-05-09 15:04:36 -04:00
Carlos Mocholí 54e8095a78
Split `init_module` into `init` + `sharded_model` (#17488) 2023-05-05 15:54:52 +02:00
Nicki Skafte Detlefsen ba14069388
Docs on `sanity_checking` property (#17579) 2023-05-05 15:31:02 +02:00
Nicki Skafte Detlefsen 21a7aa2735
Docs: Remove old link (#17514) 
docs
 2023-05-05 09:28:20 +02:00
Mauricio Villegas ecc0f78e55
Some fixes in the CLI docs (#17575) 2023-05-05 08:21:14 +02:00
Mauricio Villegas fa509af012
Added `SaveConfigCallback.save_config` (#17475) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-05-04 19:46:19 +02:00
Nicki Skafte Detlefsen 2b05e2f113
Fix problems in trainer docs (#17561) 2023-05-04 16:18:30 +02:00
Jakub Kaczmarzyk ebbd1169d8
add note in LightningCLI docs that `--optimizer` must be given for `--lr_scheduler` to work (#17552) 2023-05-04 13:35:05 +02:00
Jirka Borovec e0f335809d
Adding tests for legacy checkpoints - 1.8.x (#17374) 
* Adding tests for legacy checkpoints

* 2.0

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix simple

* utils

* import

* pl

* num_features=24

* num_features=24

* length=6000

* other

* rm

* dru run

* rm

* prune

* import

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-05-04 12:33:46 +02:00
Carlos Mocholí 6ec9a6bd9e
[TPU] Rename classes to use XLA instead of TPU (#17383) 2023-04-28 12:36:22 -04:00
Jirka Borovec db9f095b0b
Replace IPU with external implementation (#17075) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-27 16:09:51 +00:00
Adrian Wälchli 614dcdf502
True half-precision support in Fabric (#17287) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-04-27 12:37:33 +00:00
pre-commit-ci[bot] 91cb4b9b87
[pre-commit.ci] pre-commit suggestions (#17271) 
* [pre-commit.ci] pre-commit suggestions

updates:
- [github.com/PyCQA/docformatter: v1.4 → v1.6.0](https://github.com/PyCQA/docformatter/compare/v1.4...v1.6.0)
- [github.com/psf/black: 22.12.0 → 23.3.0](https://github.com/psf/black/compare/22.12.0...23.3.0)
- [github.com/charliermarsh/ruff-pre-commit: v0.0.237 → v0.0.260](https://github.com/charliermarsh/ruff-pre-commit/compare/v0.0.237...v0.0.260)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* apply

* fixing

* docs/lines

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2023-04-26 21:37:41 +02:00
Adrian Wälchli 4d17b5fe77
Improved model initialization API for Fabric (#17462) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-04-26 11:25:33 -04:00
Adrian Wälchli d48ec08d76
Update gradient clipping docs in Fabric (#17470) 2023-04-25 20:20:05 +00:00
Jirka Borovec a5c43d3b2b
docs: fix past versions location (#17432) 2023-04-24 14:07:22 +00:00
Adrian Wälchli 20303e4736
Add Fabric.launch to Fabric methods section (#17437) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-24 10:28:52 +02:00
Adrian Wälchli 92b379e90a
Document access to Fabric attributes inside LightningModule (#17440) 2023-04-22 09:10:06 +02:00
Carlos Mocholí 16377339cb
Remove reference to outdated Kaggle tutorial (#17390) 2023-04-17 19:12:44 +02:00
Carlos Mocholí 13905a3464
Support all `CombinedLoader` modes during evaluation (#17163) 2023-04-16 20:01:52 +02:00
Carlos Mocholí 97a61868fb
Sync module states during non-fit (#17370) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-04-15 02:35:51 +00:00
Carlos Mocholí 1aa23267ab
Various Fabric documentation updates (#17236) 2023-04-11 23:05:57 +00:00
Carlos Mocholí 0489f2efed
[TPU] v4 support (#17227) 2023-04-11 22:24:11 +00:00
Adrian Wälchli 0c02c44c6d
Simplified setup of optimizers in FSDP (#17309) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-11 20:13:41 +00:00
Jirka Borovec 86dbe38913
fix missing tutorials (#17311) 2023-04-11 15:18:18 -04:00
Carlos Mocholí ca27a147db
Update CODEOWNERS (#17322) 2023-04-11 08:45:24 -04:00
Adrian Wälchli ef7da5c445
Minimal Transformer Example (#17282) 2023-04-06 18:32:23 +00:00
Adrian Wälchli 8482e675a5
Fix broken links in README (#17292) 
* update links

* one more
 2023-04-06 13:50:24 -04:00
edenlightning c2d9ec4e1b
Update docs index (#17246) 
* update docs

* update docs index

* Delete version.info

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update glossary

* typo

* restructure

* rm newline

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-05 12:06:40 -04:00
Jirka Borovec 5c5ce60e55
fixing master (#17268) 
* fixing master

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-03 15:23:32 -04:00
edenlightning d5ca30aaf1
Add link to benchmarks docs (#17239) 
* Update benchmarks.rst

* small fix
 2023-04-02 19:54:59 +02:00
Eden Afek 65eb3e7c45 revert docs 2023-03-30 20:14:54 -04:00
Eden Afek 14cf89c788 revert docs 2023-03-30 20:13:42 -04:00
Eden Afek e84e135de8 revert docs 2023-03-30 20:13:07 -04:00
Eden Afek d8cae765c4 Update 2 2023-03-30 18:59:41 -04:00
Eden Afek 3232097fa2 Update 2 2023-03-30 18:57:11 -04:00
Eden Afek b73fb292e2 Update docs structure 2023-03-30 18:46:25 -04:00
Yuxuan Lu 0360a6b42f
Document how to use TensorBoardLogger with fsspec (#16320) 2023-03-27 08:26:42 +00:00
Iain Carmichael 3458258905
Fix `*_batch_end` typos (#17188) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-25 07:21:19 +01:00
Gerson Kroiz 7ec9a97b94
fix typo in docs migration 1_6_regular (#17186) 2023-03-24 20:00:40 -04:00
Yi Heng Lim 27c1faaf8d
Update Custom Callback Docs (#17161) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-03-24 12:42:15 +00:00
Jirka Borovec e7ef8db57e
Replace HPU with external implementation (#17067) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-24 13:30:53 +01:00
Maurice Deserno 572f99b857
Updated conda install commands in docs. (#17162) 2023-03-24 09:57:10 +01:00
Jirka Borovec 32a6d2ff62
docs: update links to 1.6 1.5 1.4 (#17181) 2023-03-24 01:45:31 -04:00
bafangchaoshi a705b21de1
Support BaguaStrategy with external implementation (#17029) 
* Support BaguaStrategy with external implementation

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add an introduction of BaguaStrategy

* update the introduction of BaguaStrategy

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

* link

* Fix document formatting issues

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update lightning-bagua version

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update lightning-bagua version

* Apply suggestions from code review

---------

Co-authored-by: Yafen Fang <fangyaf@spaceml1.ethz.ch>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2023-03-21 12:31:53 -07:00
Kshiteej K 04a2f3309d
update for neptune 1.0 (#16761) 
Co-authored-by: Sabine <sabine.nyholm@neptune.ai>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-21 19:00:07 +00:00
Lightning Forever c886317c0c
Restructure Fabric docs (2/n) (#17126) 
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-03-20 18:11:26 -04:00
Jirka Borovec a77e33666b
docs: migration guide to the latest [2/n] (#17103) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-20 16:27:10 +00:00
Jirka Borovec 69615f3195
docs order contributors alphabetically (#17102) 2023-03-20 16:24:35 +00:00
Jirka Borovec 5b5f4100cd
docs: build docs for specific tags (#17055) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-03-20 16:24:06 +00:00
Carlos Mocholí e5eab4e0a3
Reference the compatibility matrix (#17091) 2023-03-17 14:51:39 +01:00
Carlos Mocholí 1835cc0bb2
Reference trainer properties in docs (#16969) 2023-03-17 07:28:43 -04:00
Soroush Saryazdi 8074219f02
Typo fix in upgrade from 1.9.x to 2.0 docs: `use_distributed_sample`-> `use_distributed_sampler` (#17113) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-17 07:16:07 -04:00
Carlos Mocholí 4d9b845e01
Update docs for alternative dataset projects (#17096) 2023-03-17 12:00:02 +01:00
Adam J. Stewart b26e5f6e97
Typo fix: on_training_epoch_end -> on_train_epoch_end (#17110) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-17 10:01:00 +00:00
Lightning Forever 88c0d4d81b
Restructure Fabric docs (#17111) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-17 09:42:58 +01:00
Jirka Borovec 5661988253
rtfd: building on PRs only (#17086) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-15 21:04:10 +01:00
Jirka Borovec 2f087ae30e
docs: update broken links & latest/stable (#16994) 
* docs: update links to PL latest

* also stable

* last

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* fixing

* .

* fabric

* fixing

* .

---------

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-15 20:19:41 +01:00
Jirka Borovec ad1c994d96
docs: fix link in guide (#17090) 2023-03-15 13:18:43 +00:00
Adrian Wälchli 01834c8529
Exclude some examples from docs navigation (#17081) 
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2023-03-15 12:55:34 +00:00
Jirka Borovec f25dfbe2b5
update links to Discord (#17087) 
* update links to Discord

* link

* Apply suggestions from code review

Co-authored-by: Luca Antiga <luca.antiga@gmail.com>

* slack

* Update docs/source-app/levels/expert/index.rst

* Apply suggestions from code review

---------

Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-03-15 13:33:40 +01:00
Jirka Borovec 2f39bb656e
docs: migration guide to the `latest` [1/n] (#17034) 
* docs: migration guide - structure

* update

* try

* ...

* 1.9

* 1.8

* 1.7

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* cleaning 1.9

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* crosslink

* ...

* placeholder

* 1.6

* placeholders

* 1.5

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* 1.4

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-15 13:32:44 +01:00
Adrian Wälchli 550fa5fec0
Organize app examples (#17045) 
* move

* init files

* reset change

* missed

* more

* relative path

* e2e tests

* update checkgroup

* reference

* update app_*
 2023-03-14 14:48:17 -04:00
Aniket Maurya 5d58736f08
Rename PL installation to `pip install lightning` (#17074) 
* rename PL installation

* update

* Apply suggestions from code review

* Update docs/source-pytorch/starter/installation.rst

Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>

* Update docs/source-pytorch/starter/installation.rst

---------

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
 2023-03-14 14:47:56 -04:00
Carlos Mocholí 281efc682f
Update data docs (#16839) 
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
 2023-03-14 18:44:49 +01:00
Carlos Mocholí 9cd131c2a6
Add `CombinedLoader` to the API reference (#17062) 
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
 2023-03-14 15:52:05 +01:00
Carlos Mocholí bab80f2e1f
Remove outdated Trainer animation (#17060) 2023-03-14 15:51:07 +01:00
Tianshu Wang f3a20d0a50
Rename `ProgressBarBase` to `ProgressBar` (#17058) 2023-03-14 13:22:47 +00:00
Atharva Phatak ea708da55a
Add `is_wrapped` utility function for Fabric (#16953) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
 2023-03-14 13:03:38 +00:00
Carlos Mocholí f1f8050e0e
Remove outdated trainer argument videos (#17071) 2023-03-14 12:44:07 +01:00
Jirka Borovec a8c4d1f552
docs: adding hivemind (#17038) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-03-13 18:17:37 +00:00
Adrian Wälchli 22230c97b1
Add link to past versions in the docs header (#17063) 
add past versions link
 2023-03-13 18:51:01 +01:00
Carlos Mocholí 8e35384557
Remove outdated LightningModule animation (#17057) 2023-03-13 13:33:14 -04:00
Wouter Zwerink 61fe3d5c9d
Revert "import neptune instead of import neptune.new" (#16898) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-13 14:50:30 +00:00
Carlos Mocholí 05084e52cc
Simplify the Trainer core logic (#17017) 2023-03-13 13:43:57 +00:00
Adrian Wälchli a49fd02417
Update introduction video (#17059) 2023-03-13 09:42:29 -04:00
Jirka Borovec 7d16a9e370
docs: update version matrix (#17041) 2023-03-12 23:17:04 +01:00
Adrian Wälchli 6fcccea3fa
Add cute teaser animations to Fabric docs (#17021) 2023-03-10 12:16:07 -05:00
Adrian Wälchli 7c80fe6990
Update links to latest PL docs (#17031) 2023-03-10 14:21:15 +00:00
Jirka Borovec bb69e2c916
rtfd: try to collapse docs (#17020) 2023-03-09 20:05:50 -05:00
Jirka Borovec bb960b841c
rtfd: try another redirect (#17018) 2023-03-09 21:25:39 +01:00
Jirka Borovec 7f44dba7ed
RTFD: building docs for with redirect (#16993) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-09 13:05:30 -05:00
Jirka Borovec 9b168dcf9b
docs: listing past versions (#17014) 
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-09 17:52:20 +00:00
Carlos Mocholí f7b89cd233
Review APIs experimental status (#17012) 2023-03-09 16:56:49 +00:00
Adrian Wälchli 66966b405e
Update Fabric docs with installation instructions (#16996) 2023-03-09 13:28:06 +01:00
Carlos Mocholí 3328b047fb
Inline the `ModelIO` interface (#16999) 2023-03-08 18:28:28 +01:00
Carlos Mocholí c294158823
Add compatibility matrix (#16998) 2023-03-08 18:03:03 +01:00
Aniket Maurya da572d7cca
Refactor PL examples to `examples/pytorch/` (#16925) 
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
 2023-03-07 11:24:46 -05:00
Adrian Wälchli 1e42783973
Miscellaneous updates in Fabric docs (#16980) 2023-03-07 15:43:47 +00:00
Ruslan Mukhametshin 863f575caa
Update documentation about configuration files structure (#16956) 2023-03-07 13:31:11 +01:00
Adrian Wälchli 0e84f01b09
Document how to use multiple models and optimizers in Fabric (#16952) 2023-03-07 13:19:43 +01:00
Adrian Wälchli 7749525cbd
Document SLURM interactive mode (#16955) 2023-03-06 20:58:46 +00:00
Adrian Wälchli 54147e0745
Update Fabric docs navigation (#16957) 2023-03-06 16:13:51 +01:00
Adrian Wälchli 5870714224
Switch theme for Fabric (#16961) 2023-03-06 15:50:46 +01:00
Adrian Wälchli f2caa01bb3
Document gradient clipping in Fabric (#16943) 2023-03-05 17:03:57 +00:00
Jirka Borovec ac4180fc2f
docs: add link to lightning-colossalai (#16945) 2023-03-05 10:43:17 +00:00
Jirka Borovec 0e8ac7e1c9
docs: move fabric on its own (#16742) 
* docs: move fabric to Lai

* update imports

* links

* drop link to Trainer

* own docs

* ci

* trigger

* prune cross-links

* cleaning

* cleaning

* template

* imports

* template

* path

* links

* tensorboardX

* plugins

* label

* drop fixme

* drop copy nb + examples

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

* try again

* rev

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-01 12:36:14 +01:00
Jirka Borovec ac815ec8a1
docs: typo in habana docs (#16910) 2023-03-01 09:22:43 +01:00
Wouter Zwerink dfa35dac99
Require neptune 1.0 (#16888) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-02-28 12:13:42 +01:00
Jirka Borovec f697fff5db
docs: rename source-app (#16863) 
* docs: rename source-app

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci

* group check

* trigger

* param

* fix

* cleaning

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-02-28 10:04:43 +01:00
Jirka Borovec 52a39c03f8
docs: update `pytorch_lightning` imports (#16864) 
* update docs imports

* ci

* fabric

* trigger

* links

* .

* docstring

* chlog

* cleaning
 2023-02-27 15:14:23 -05:00
Adrian Wälchli a54f37391f
Explain `configure_sharded_model` in ColossalAI docs (#16872) 2023-02-27 20:45:15 +01:00
Adrian Wälchli 07b89c87ee
Merge DDPStrategy and DDPSpawnStrategy in PL (#16809) 2023-02-27 14:43:23 -05:00
Adrian Wälchli e48613207a
Promote `Fabric.launch()` as the default experience in Fabric docs (#16878) 2023-02-27 08:19:54 -05:00
Darren Tuit cdf21a1305
Fix imports for lightning cli examples (#16871) 2023-02-26 00:09:34 +01:00
Aditya Kane df6e37da1c
Update torch_xla installation instructions in tpu_basic.rst (#16865) 2023-02-26 00:07:40 +01:00
Carlos Mocholí 0130273eb5
Trainer: auto default (#16847) 2023-02-23 18:42:17 +01:00
Carlos Mocholí d486f94dd2
Fabric: auto default (#16842) 2023-02-23 13:45:27 +00:00
Justus Schock 598c2476cd
Remove implicit frontend testing from `testing.run_app_in_cloud` (#16741) 
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
 2023-02-22 14:48:10 +00:00
Carlos Mocholí 914effa04c
Rename `replace_sampler_ddp|replace_sampler` to `use_distributed_sampler` (#16829) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-02-22 14:07:02 +01:00
Carlos Mocholí b30a43f783
Move the `CombinedLoader` to an utility file (#16819) 2023-02-20 18:06:35 +01:00
Adrian Wälchli 65e66814f8
Remove the `*_step_end` hooks (#16791) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-02-20 13:04:40 +00:00
Carlos Mocholí 781768d2b2
Remove `Trainer(multiple_trainloader_mode)` in favor of `CombinedLoader(mode)` (#16800) 2023-02-20 13:32:06 +01:00
Adrian Wälchli 81b7c30291
Make DDP subprocess the default launcher for multi-device (#16780) 2023-02-20 11:20:50 +00:00
Mauricio Villegas 3a0519143a
Fix bug in lightning_cli_advanced_3.rst (#16792) 2023-02-20 12:12:17 +01:00
Sebastian Raschka a4f4b5372a
Add missing docs quote (#16797) 
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
 2023-02-20 11:09:55 +01:00
Justus Schock 0fee28409b
Introduce new precision layout in PL (#16783) 2023-02-17 17:58:14 +01:00
Justus Schock ac5fa03385
Introduce new precision layout in fabric (#16767) 2023-02-17 10:41:18 +00:00
Adrian Wälchli 91e692c767
Rename the TPUSpawnStrategy to XLAStrategy (#16781) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-02-17 02:06:24 +00:00
Adrian Wälchli ad698f049b
Update Colossal AI docs and integration (#16778) 2023-02-16 16:14:24 +00:00
Justus Schock 47c69cd8eb
Remove DP (#16748) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-02-16 05:12:08 +00:00
Lightning Forever 41dd0d1f85
Remove the QuantizationAwareTraining callback (#16750) 2023-02-15 17:29:49 -05:00
Adrian Wälchli 83f4c83582
Replace ColossalAIStrategy with external implementation (#16757) 2023-02-15 15:11:52 +00:00
Adrian Wälchli c4074419b5
Remove the BaguaStrategy (#16746) 
* remove bagua

* remove

* remove docker file entry
 2023-02-14 08:58:58 -05:00
Adrian Wälchli 39020887d2
Remove Trainer's `track_grad_norm` argument (#16745) 2023-02-14 12:38:17 +00:00
Adrian Wälchli 99cb2cd056
Remove argparse utils (#16708) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-02-13 20:44:30 +00:00
Adrian Wälchli 67c09e3092
Separate the Gradient Accumulation Scheduler from Trainer (#16729) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-02-13 20:15:38 +00:00
Jirka Borovec 0be025e8b7
rename docs/source-app & adjust docs links for lightning (#16676) 
* update CI

* config / import

* lightning_app imports

* source/ dir

* html

* ci: dirs

* pr

* req dir

* on push

* rename

* drop

* cleaning
 2023-02-13 10:59:02 +01:00
Carlos Mocholí 457cd76d1a
Remove the unused `utilities.finite_checks` (#16682) 2023-02-09 21:11:05 +01:00
Adrian Wälchli 18106a8f95
Split train- and val progress into separate bars (#16695) 2023-02-09 19:43:50 +00:00
Adrian Wälchli 83296cc6cf
Update Fabric introduction (#16672) 
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
 2023-02-09 18:06:29 +00:00
Carlos Mocholí bf51844917
Remove memory-retaining epoch-end hooks (#16520) 2023-02-06 17:00:36 +00:00
Adrian Wälchli cd0eedb082
Set `find_unused_parameters=False` as the default (#16611) 2023-02-06 16:51:21 +01:00