Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,183 Commits 60 Branches 217 Tags 359 MiB
Commit Graph

1901 Commits

Author SHA1 Message Date
Victor Prins 07461a1def
Fix broken links on Lightning App docs (#18904) 
fix broken links on App docs
 2023-11-08 14:08:52 -05:00
Jirka Borovec 6628d8a73a
docs: switch todo to comment (#18893) 2023-11-06 11:50:38 +01:00
Jirka Borovec ed7cc27d57
docs: ignore tutorial's link "what-is-a-gpu" (#18937) 2023-11-03 18:59:42 -04:00
thomas chaton f5f4d0a264
Improve map, optimize and StreamingDataset (#18912) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
 2023-11-03 11:28:55 +00:00
Jirka Borovec e9dcf4840e
ci/docs: fix copy integration sub-docs (#18921) 2023-11-02 17:45:00 +01:00
Carlos Mocholí ad93f64d35
Bitsandbytes docs improvements (#18903) 2023-11-02 15:50:54 +01:00
Jirka Borovec 1e68c50141
ci: restrict build docs on PR (#18923) 
* ci: restrict build docs on PR

* linkcheck_timeout
 2023-11-02 09:03:03 -04:00
Adrian Wälchli e0ba4d46e1
Fix spelling errors (#18773) 
fix spelling errors
 2023-10-30 17:14:52 -04:00
Adrian Wälchli 079544a902
Rename PrecisionPlugin -> Precision (#18840) 2023-10-30 16:53:13 -04:00
Carlos Mocholí 800b87eb46
Add throughput utilities to Fabric and the Trainer (#18848) 2023-10-30 17:10:29 +01:00
Adrian Wälchli f6a36cf220
Consistent imports in docs for core APIs (#18869) 
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2023-10-27 14:41:29 -04:00
Sebastian Raschka af44205541
Fixes in evaluation_basic.rst (#18843) 2023-10-27 06:36:30 -04:00
Carlos Mocholí 182c30b129
Update Habana integration to 1.2 (#18877) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-10-26 19:08:50 -04:00
Sebastian Raschka 1ac49b1d0e
docs: update debugging_basic.rst with `trainer` var (#18856) 2023-10-25 02:45:59 +02:00
Sebastian Raschka 1a9e7eac46
Add example for loading a LightningModule if it has additional init arguments (#18838) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-10-23 19:21:32 -04:00
PL Ghost 23064294c4
docs: update ref to latest tutorials & fix CI trigger (#18787) 
Co-authored-by: Borda <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-10-13 17:50:01 +02:00
Adrian Wälchli e02bb391af
Utility to disable all instances of `PossibleUserWarning` (#18744) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-10-10 06:53:32 -04:00
Jirka Borovec 0777aab31e
ci/rtfd: building both fast docs on PR (#18738) 2023-10-07 11:57:50 +02:00
Adrian Wälchli 379ed8c66e
Update migration guide for 2.1 (#18729) 2023-10-06 16:20:19 -04:00
Adrian Wälchli 74d402095e
docs: Fix display of navigation tiles in Fabric docs (#18733) 2023-10-06 14:36:01 +02:00
Adrian Wälchli 5d819c91fb
Remove `fsdp_overlap_step_with_backward` in favor of native solution (#18726) 2023-10-06 08:11:41 -04:00
Adrian Wälchli 09a0fb26d2
Set an upper limit on CPU threads in distributed training (#18677) 2023-10-04 19:57:37 -04:00
Adrian Wälchli d31ef1f7d3
Drop support for PyTorch 1.11 (#18691) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-10-04 20:30:44 +02:00
pre-commit-ci[bot] c0ec0decec
[pre-commit.ci] pre-commit suggestions (#18697) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-10-03 22:07:21 +02:00
Jirka Borovec 45237c7df9
docs: include external pages 2/2 (#17890) 2023-10-03 19:02:47 +00:00
Jirka Borovec 3c702b6a99
ci: patch all install with 20min timeout (#18696) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-10-03 20:40:43 +02:00
Jirka Borovec 4b7c8422cb
docs: prune ignored links (#18694) 2023-10-03 05:34:16 -04:00
Adrian Wälchli eb0f655438
Add recommendation for matmul precision in docs (#18689) 2023-10-02 14:23:19 -04:00
Carlos Mocholí d1f8b0f766
Bitsandbytes docs improvements (#18681) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-09-30 16:19:11 +02:00
Carlos Mocholí 5120ad20f2
Bitsandbytes precision plugin (#18655) 
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
 2023-09-29 19:17:18 +02:00
Jirka Borovec e3a6ac2436
intro granularity for docs build (#18675) 2023-09-29 15:10:45 +02:00
Adrian Wälchli 996e7684a1
Update `persistent_workers` recommendation when using spawn launcher (#18649) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-09-29 08:39:33 -04:00
Jirka Borovec ed2c80f517
docs: switch HTTPerror to custom runtime error (#18666) 
* docs: switch HTTPerror to custom runtime error

* habana
 2023-09-28 15:26:06 -04:00
Adrian Wälchli c631726b5c
Set the generator seed in `random_split` usages in the examples (#18651) 2023-09-27 14:09:05 +02:00
Jirka Borovec 830a62a722
ruff: replace isort with ruff +TPU (#17684) 
* ruff: replace isort with ruff

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing & imports

* lines in warning test

* docs

* fix enum import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing

* import

* fix lines

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* type ClusterEnvironment

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-26 11:54:55 -04:00
Jirka Borovec 358336268f
enable codespell for docs & fixing +TPU (#18629) 
* precommit/codespell

* run

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* disable

* more fixing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

* more fixing

* json

* note

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-26 11:54:44 -04:00
Adrian Wälchli f83ad093e5
Utility function to check shared filesystem (#18586) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-09-25 15:49:52 -04:00
Jirka Borovec d579cfed57
precommit: unify formatting with prettier (#18605) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-25 14:34:41 +02:00
Jirka Borovec 80f131c668
rtfd: fix building with stable/latest (#18615) 2023-09-23 07:40:22 +02:00
Jirka Borovec f1df76ce84
ci/docs: fetch assets only for deployment, omit PR (#18609) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-22 12:51:44 +02:00
Jirka Borovec 3fbf1540b0
docs: 3/3 enable Sphinx nitpicky [app] (#18603) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-21 22:44:59 +02:00
Adrian Wälchli 57f5268eb3
Improve the suggested `num_workers` warning (#18591) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-09-21 09:38:25 -04:00
Jirka Borovec d13ad1e4af
docs: 2/3 enable Sphinx nitpicky [pytorch] part 2/n (#18602) 2023-09-21 12:42:06 +02:00
Jirka Borovec b4b21e0152
docs: 2/3 enable Sphinx nitpicky [pytorch] part 1/n (#18484) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-20 19:09:34 +02:00
Adrian Wälchli 8094855137
Avoid passing process group to enable FSDP's hybrid-shard (#18583) 2023-09-19 13:46:24 -04:00
Adrian Wälchli c1ee22a687
Optimize import paths for optional dependencies (#18561) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-09-15 17:04:19 -04:00
Justin Goheen 50537151a5
Add LightningTransformer demo for PyTorch Lightning in `lightning.pytorch.demos.transformer` (#18452) 2023-09-12 11:04:18 -04:00
Tribhuvan Mishra 12af7711cf
Update index.rst (#18502) 2023-09-12 09:15:04 +02:00
Jirka Borovec 7b43e950a2
docs: switch PyTorch to lai template (#18450) 
* docs: switch Pytorch to lai template
* rtfd
 2023-09-11 18:43:42 +02:00
Jirka Borovec bda974281d
docs: switch Fabric to lai template (#18449) 
* docs: switch Fabric to lai template
* imports
 2023-09-11 18:43:07 +02:00
Adrian Wälchli 4dfc09c2fe
Change auto-device selection for Jupyter notebook environments (#18291) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-09-08 11:49:31 -04:00
Jirka Borovec 565046f337
docs: welcome Fabric like Trainer (#18429) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-09-08 10:33:44 -04:00
Justin Goheen a0133863a3
Update `docs/source-pytorch/common/lightning_module.rst` (#18451) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-09-08 04:44:24 -04:00
Carlos Mocholí 756e481969
Support the TransformerEngine precision plugin with the Trainer (#18459) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-09-07 19:21:00 +02:00
Alex Morehead 095d9cf279
docs: Fix typos and wording in cluster_advanced.rst (#18465) 2023-09-03 09:06:33 -04:00
Quinten Roets d5440a0b3f
Configurable metric formatting for RichProgressBar (#18373) 2023-08-29 17:00:31 +02:00
Jirka Borovec 5f5d99eae6
Relax app dependencies for `lightning` | breaking imports from `L` (#18386) 
* make App conditional import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci: min req.

* data + store

* typo

* module_available

* extra

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* envs

* doctest

* more

* docs

* **

* rm

* -f

* Apply suggestions from code review

* docs

* Revert "docs"

This reverts commit 20e8e6be98.

* Apply suggestions from code review

* warnings

* breaking

* ...

* fixing source

* fixing examples

* fixing tests

* fixing docs

* fixing source

* fix mock

* fix trainer

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-28 11:28:58 -04:00
Adrian Wälchli d3ee410100
Add dedicated docs page for init-module (#18416) 2023-08-28 11:28:38 -04:00
Jirka Borovec 8218097833
docs: updating logos (#18375) 2023-08-28 16:49:28 +02:00
Adrian Wälchli 04c0675bd0
Update titles in FSDP docs (#18389) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-08-25 10:38:01 -04:00
Maxim Borodin 9d7a2848b7
Fix typo in `BasePredictionWriter` documentation (#18381) 2023-08-24 12:34:50 +02:00
Quinten Roets 8680dc55b3
Make delimiter in rich progress bar configurable (#18372) 2023-08-24 09:55:00 +02:00
Adrian Wälchli f4825e5778
Extend FSDP guide with checkpointing (#18374) 2023-08-23 20:23:16 +02:00
Jirka Borovec 547e7aa393
docs: 1/3 enable Sphinx nitpicky [fabric] (#18069) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-23 10:31:20 +02:00
Jirka Borovec 3f73231d5c
ci/docs: enable not fetch assets (#18333) 2023-08-21 20:22:21 +02:00
Adrian Wälchli 2eb62141f6
Update the DDP optimizations page (#18344) 2023-08-19 06:27:53 -04:00
Adrian Wälchli 2ca1571065
Fix upgrade guide regarding removed `Trainer.reset_*_dataloaders()` (#18341) 2023-08-18 18:24:11 +02:00
Adrian Wälchli 6df43685ee
Revamp model parallel docs (FSDP) (3/n) (#18326) 2023-08-17 15:30:58 -04:00
Jirka Borovec cf8f8ab383
docs: fix dead links for App (#18332) 2023-08-17 17:48:45 +02:00
Jirka Borovec 8ade7d08ea
docs: fix dead links for Trainer (#18331) 2023-08-17 12:51:25 +02:00
Adrian Wälchli 36a203ba58
Revamp model parallel docs (2/n) (#18325) 2023-08-16 13:22:14 -04:00
Adrian Wälchli 725159ed60
Revamp model parallel docs (1/n) (#18314) 2023-08-16 08:06:50 -04:00
Jirka Borovec c98fb36b11
update ci for legacy upload (#18316) 
* update ci for legacy upload

* docs
 2023-08-15 17:32:39 -04:00
Adrian Wälchli 03ca31c3d3
Avoid updating the device for XLA FSDP in `Fabric.setup()` [TPU] (#18276) 2023-08-11 22:00:23 -04:00
Adrian Wälchli 7fe8756917
[TPU] Proper half-precision implementation for XLA (#18213) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-11 11:37:41 -04:00
Carlos Mocholí c83774a109
Update docs about double precision with complex numbers (#18269) 2023-08-10 10:36:55 +02:00
Adrian Wälchli 888466b144
Support true 16-bit precision with FSDP in Trainer (#18219) 2023-08-10 04:15:35 -04:00
Jirka Borovec efa7b2f9ef
docformatter: config with black (#18064) 
* docformatter: config with black

* additional_dependencies: [tomli]

* 119

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-09 10:44:20 -04:00
Jirka Borovec 8f29bb561b
bump sphinx to 5.3 (#18204) 2023-08-08 15:32:34 +02:00
Adrian Wälchli c5cb532694
True half-precision support in Trainer (#18193) 
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-08-02 07:56:22 -04:00
Adrian Wälchli 3fd24f9591
Remove outdated warning about loading full-state checkpoints in FSDP (#18208) 2023-08-01 20:06:30 +02:00
Adrian Wälchli 04e2d800af
Fix pip install instructions in LightningCLI docs (#18201) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-07-31 16:15:58 -04:00
Adrian Wälchli 1db471305d
Avoid setting the multiprocessing context when importing lightning (#18177) 
* avoid import at top module

* tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove comment

* update docs

* changelog

* mypy

* trigger app tests

* can't import lightning on py 3.8

* Update .github/workflows/ci-tests-app.yml

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-07-31 18:05:21 +02:00
Adrian Wälchli 1e0fa1836e
Update migration guide for renamed progress bar base class (#18178) 2023-07-31 09:36:46 -04:00
Luca Antiga a7bbbcea9a
Remove cluster commands from CLI (#18151) 
* Remove cluster commands from CLI

* Update docs

* Remove index entry

* Revert accidental conversion to static assets

* Remove reference to deleted file

* Fix highlights

* Fix highlights

* Remove file

* Update CHANGELOG

* Fix dead link

* Increase upper bound on state size to reduce flakiness
 2023-07-28 00:16:21 +02:00
Adrian Wälchli 6552d29a12
Document limitations of multi-GPU in Jupyter notebooks (#18132) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-24 15:22:16 -04:00
Adrian Wälchli 2af425328a
Add FSDP to the docs glossary (#18121) 2023-07-20 09:07:37 +02:00
Adrian Wälchli 6ab6ab8193
Fabric FSDP documentation guide (#18109) 2023-07-19 18:39:07 +02:00
Carlos Mocholí 071f85842e
Support NVIDIA's Transformer Engine as a precision plugin (#17597) 2023-07-19 18:21:58 +02:00
Carlos Mocholí d653e4e088
Relax the assumption that the root module is FSDP wrapped (#18054) 2023-07-19 15:34:03 +02:00
Adrian Wälchli dab373de54
Support loading a raw PyTorch state-dict checkpoint in Fabric (#18049) 
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-18 14:06:17 -04:00
Jirka Borovec 6b52b84ef8
docs: fallback for restoring right scroll menu (#18108) 2023-07-18 14:06:18 +02:00
Adrian Wälchli d79eaae334
Update deepspeed model-parallel docs (#18091) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-07-17 12:02:54 -04:00
Adrian Wälchli b8d4a70db7
Make introduction example run on devices (#18097) 2023-07-17 17:19:16 +02:00
Carlos Mocholí c60f67e736
Support sets for policies in FSDP (#18084) 2023-07-15 17:39:28 +02:00
Carlos Mocholí 2f657ae46e
Support custom policies for activation checkpointing with FSDP (#18045) 2023-07-14 20:00:52 +02:00
Carlos Mocholí 340eecd846
Add `Trainer.init_module` and `LightningModule.configure_model` (#18004) 2023-07-14 19:15:05 +02:00
Carlos Mocholí ad74f8623f
Don't reapply activation checkpointing (#18006) 2023-07-10 13:24:09 +00:00
Minh-Long Luu (刘明龙) c8656f1a27
docs: `fabric_methods.rst` using deprecated parameters (#18015) 2023-07-07 11:32:09 +02:00
Adrian Wälchli 036bd74e47
Disable video controls in Fabric teaser animations (#17984) 2023-07-04 13:27:54 +02:00