8c9b688f2b
Update docs with new Lightning Lite usage 1/n ( #15600 )
2022-11-11 16:43:25 +00:00
164e5a7b3e
Remove the docs for passing strategy args to accelerator ( #15636 )
2022-11-11 05:46:10 -05:00
6ba00af1e0
Drop PyTorch 1.9 support ( #15347 )
...
* Drop 1.9
* Everything else
* READMEs
* Missed some
* IPU skips
* Remove exception type
* Add back
2022-11-10 08:59:13 -05:00
e97df1afae
Update myst-parser requirement from <0.17,>=0.15 to ==0.18.1 in /requirements ( #14417 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-09 18:55:16 +00:00
acccc4d423
Fix LightningCLI docs after overhaul of the documentation ( #14976 )
...
* - Fix diverse issues introduced when the documentation was restructured.
- Change the docs to be focused on configure hyperparameters instead of reduction of bolierplate.
* Update docs/source-pytorch/cli/lightning_cli.rst
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* - Fix diverse issues introduced when the documentation was restructured.
- Change the docs to be focused on configure hyperparameters instead of reduction of bolierplate.
* Fixes based on review.
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Fix wrap width.
* Move save_hyperparameters and load_from_checkpoint to lightning_module page.
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-09 10:36:47 -05:00
b04a7aab9c
Docs: Update tutorial to match PyTorchProfiler changes ( #15440 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-09 01:28:05 +01:00
35b66fd890
Fixed typo Havana -> Habana for HPUs ( #15589 )
...
Fixed typo Havana -> Habana
HPUs are accelerators built by Habana Labs.
2022-11-08 19:09:54 +01:00
1a8f2e8516
Support DDP with LRFinder ( #15304 )
...
* Support DDP for LRFinder
* Apply suggestions from code review
* rank 0 is the decision maker
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-08 17:55:15 +00:00
0886e6352e
Added a check to validate that wrapped FSDP models are used while initializing optimizers ( #15301 )
...
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-11-08 02:10:35 +00:00
04e1e925da
Update governance and codeowners
2022-11-07 11:12:24 -05:00
a557952fab
Move `krshrimali` to Alumni ( #15568 )
...
Move myself to Alumni
2022-11-07 09:13:00 -05:00
dcfaa065ab
Improve the checkpoint upgrade utility script ( #15333 )
2022-11-04 21:41:32 +00:00
848fe13795
Update governance docs ( #15479 )
2022-11-04 21:13:03 +05:30
501d40f0dd
Move to alumni ( #15522 )
...
Update governance.rst
2022-11-04 11:04:25 -04:00
adb970a50b
CI: resolving Docs ( #15508 )
...
* placeholder
* pytorch
* fix CI
* fix package name
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* use os theme for pytorch docs
* switch source-app to lai_sphinx_theme
* pull_request
* doc error fix
* another build error fix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* removed unused glossary.rst
* lit
* doc fixes
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix last warning
* try
* lit
* flake8
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: Yurij Mikhalevich <yurij@grid.ai>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-11-03 15:33:54 -04:00
9328da439b
docs updates 1/n ( #15473 )
...
* docs
* docs updates
* docs updates
* docs updates
* docs updates
* d
* d
* d
* d
* d
* d
* ??
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d1
* d
* d
* d
* d
* d
* d
* d
* d
* d
* d
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* new title
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* only select from parent
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* use OSS template
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* only select from parent
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update docs/README.md
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <williamfalcon@Williams-MacBook-Pro-2.local>
Co-authored-by: William Falcon <williamfalcon@Williams-MBP-2.lan>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-11-03 10:55:30 -04:00
5025c3ec16
Update governance ( #15478 )
2022-11-02 21:27:25 +00:00
d956a123bd
Update train_model_basic.rst ( #15352 )
2022-10-27 09:13:11 -04:00
0f9156374d
Mark internal Lite APIs as protected ( #15307 )
...
* mark internal lite apis as protected
* formatting
* docs update
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-10-26 12:51:50 +00:00
7b3de1215f
Remove examples and loggers from develop dependencies ( #15282 )
...
* Remove examples and loggers from develop dependencies
* remove more references
* Fix mypy
* Keep logger file for docs mocking
* Simpler fix
* Fix docs build
* Global testsetup
* Matching files
* Undo change
* loggers as info
* Clarify
* Update requirements/pytorch/loggers.info
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
2022-10-25 09:23:26 -04:00
1beef7620f
Update lightning_cli_advanced_2.rst ( #15257 )
...
Co-authored-by: Mauricio Villegas <mauricio_ville@yahoo.com>
2022-10-24 15:25:21 +00:00
26f632cb10
switch LAI deployment branch ( #15194 )
...
* switch LAI deployment branch
* update links
2022-10-19 16:07:05 -04:00
045c2f5715
Efficient gradient accumulation in LightningLite ( #14966 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-19 19:55:12 +00:00
85ce43d1a3
Add docs for distributed inference ( #15149 )
2022-10-18 18:39:17 +00:00
7b185c7fc9
Update 8-bit optimizer docs ( #15155 )
2022-10-17 22:23:56 +02:00
dd33528e00
[docs] Docs for ColossalaiStrategy ( #15093 )
2022-10-13 16:14:03 +00:00
672b5cbefe
Update obsolete URL in HPU docs ( #15112 )
2022-10-13 13:27:16 +02:00
b4b651c73a
Update docs regarding deprecation window ( #15089 )
2022-10-12 15:25:03 +02:00
0a5e75e8d1
Add `inference_mode` flag to Trainer ( #15034 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-10-12 12:22:01 +00:00
ad1e06f2d4
Update tuner docs ( #15087 )
2022-10-12 08:55:56 +00:00
1865300228
chore: add model as recommended parameter for validate() ( #15086 )
2022-10-12 10:46:03 +02:00
2fef6d9403
Add ColossalAI strategy ( #14224 )
...
Co-authored-by: HELSON <c2h214748@gmail.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-11 13:59:09 +02:00
3183079204
Remove deprecated callback hooks ( #14834 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-10-10 15:46:28 +00:00
ca3c4e7f07
Add tuner callback docs ( #15030 )
2022-10-08 18:21:27 +00:00
dfc7886b24
docs: replacement of method type_as in docs to Tensor.to ( #15027 )
2022-10-08 10:04:15 +00:00
7fed7a12c5
Add `LRFinder` callback ( #13802 )
...
* add BatchSizeFinderCallback callback
* enable fast_dev_run test
* keep tune and remove early_exit
* move exception to setup
* Apply suggestions from code review
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-10-05 13:15:38 +02:00
7ef87464dd
Refactor XLA and TPU checks across codebase ( #14550 )
2022-10-04 22:54:14 +00:00
e62521caf1
Update hpu mixed precision link ( #14974 )
...
Signed-off-by: Jerome <janand@habana.ai>
2022-10-03 09:05:17 +02:00
3daa4c9cc0
Remove deprecated on_init_start_end ( #14867 )
...
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
2022-09-30 15:11:38 +00:00
ff3c5b7b9d
Docs section for SLURM troubleshooting ( #14873 )
...
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-29 12:41:31 +00:00
d1a3a3ebf5
Add BatchSizeFinder callback ( #11089 )
...
* add BatchSizeFinderCallback callback
* temp rm from init
* skip with lr_finder tests
* restore loops and intergrate early exit
* enable fast_dev_run test
* add docs and tests
* keep tune and remove early_exit
* add more tests
* patch lr finder
* disable skip
* force_save and fix test
* mypy and circular import fix
* fix mypy
* fix
* updates
* rebase
* address reviews
* add more exceptions for unsupported functionalities
* move exception to setup
* chlog
* unit test
* address reviews
* Apply suggestions from code review
* update
* update
* mypy
* fix
* use it as a util func
* license
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* mypy
* mypy
* review
* fix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix
* updates
* updates
* fix import
* Protect callback attrs
* don't reset val dataloader
* update test
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-09-27 08:54:37 -04:00
4fc8275cc3
Remove the deprecated `trainer.call_hook` ( #14869 )
2022-09-26 15:56:44 +02:00
abb6049fa3
Update documentation for the basic skills tutorial level 2 on how to validate and test a model ( #14874 )
2022-09-24 10:34:06 +00:00
633d14e67a
fixed comet -> mlflow typo in visualize/experiment_managers docs ( #14843 )
...
fixed comet -> mlflow typo
Co-authored-by: Devin Conathan <devin.conathan@libertymutual.com>
2022-09-24 00:13:28 +02:00
dd2a1c5d29
Integrate Lite Precision into PL ( #14798 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-22 14:51:04 +00:00
3064c28ce1
Added args parameter to LightningCLI to ease running from within Python ( #14596 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-09-19 17:38:30 +00:00
a5b0f8bd5c
Fix TQDMProgressBar usage in logging.rst ( #14768 )
2022-09-19 01:07:19 +02:00
3c5e03e035
docs: Clarify versioning and API stability ( #14549 )
...
* mv releases to a standalone page
* Include release_policy in index
* Update policy
* mv releases to a standalone page
* Include release_policy in index
* Update policy
* Update title
* remove release_policy.rst
* Update versioning
* syntax
* simplify wording
* Include examples that don't follow X+2 rule
* syntax
* update
* consistency
* rm noninformative statement
* .
* Reduce redundancy in the deprecation process
* grammar?
* consistency
* Update docs/source-pytorch/versioning.rst
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-15 09:16:14 -04:00
c2378bd3b1
Add documentation for trainer.datamodule and dataloaders of a trainer object ( #14600 )
...
* Update trainer.rst
* Update datamodule.rst
2022-09-14 15:46:34 +00:00
313c338da1
Remove legacy examples from logging docs ( #14686 )
2022-09-13 13:47:51 -04:00
e5998e6bf2
Make the SLURM Preemption/Timeout Signal Configurable ( #14626 )
...
* Add parameter to change the preemption signal
* Make the signal connector use the custom signal from SLURMEnvironment
Signed-off-by: Max Ehrlich <max.ehr@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-12 19:24:35 +00:00
925edbca07
Remove the deprecated `weights_save_path` Trainer argument ( #14424 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-09-12 19:02:38 +00:00
4f3c47294e
Add troubleshooting section to MPS docs ( #14642 )
...
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-09-12 17:35:18 +00:00
7e9e441843
Use TorchVision's Multi-weight Support and Model Registration API on Lightning ( #14567 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-09-09 20:04:57 +00:00
d2459df2ff
Standalone Lite: Remaining Utilities ( #14492 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
2022-09-07 15:25:23 +00:00
7ada52e33c
Typo in major heading seen by newcomers ( #14501 )
...
* Typo in major heading seen by newcomers
Correct typo in one of the first major headings newcomers to Lightning see when they are considering migrating their code to use Lightning.
I know this is a trivial change in terms of the text change itself, but I really think it's valuable for one of the most important landing pages that users first investigating Lightning see - to have rock-solid, professional text without obvious typos. Here was a typo in the main heading itself. I suggest fixing it straightaway via this PR.
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-07 09:06:30 +00:00
44216fdd69
Integrate `lightning_utilities.core.imports` ( #14475 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-06 12:56:20 +00:00
8a4a3b6766
Mark the lite `DeviceDtypeModuleMixin` as protected ( #14548 )
2022-09-06 14:17:15 +02:00
8c6119fbce
Add auto wrapping support for `DDPFullyShardedStrategy` ( #14383 )
2022-09-05 19:07:26 +00:00
b19b15546b
Updated basic debugging ( #14488 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-02 14:23:29 +05:30
cce55b6cd3
Precise description of reload_dataloaders_every_n_epochs ( #14245 )
2022-09-01 10:06:28 -04:00
28e18881a9
Mark stage argument in hooks as required ( #14064 )
...
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2022-09-01 15:47:40 +02:00
10adcd5d12
Remove the unused pyDeprecate dependency ( #14472 )
...
* Remove the unused pyDeprecate dependency
* CHANGELOG
2022-09-01 03:30:18 +09:00
f3574176e2
Change `trainer.should_stop` to not stop in between an epoch and run until `min_steps/min_epochs` only ( #13890 )
2022-08-27 12:12:24 +00:00
250c06e406
Remove deprecated HPC model hooks ( #14315 )
...
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-26 20:59:32 +00:00
8950613552
save checkpoints and profiler output to the first logger ( #14325 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-26 17:23:54 +00:00
6d00f31f0c
Add auto wrapping for `DDPFullyShardedNativeStrategy` ( #14252 )
2022-08-26 09:01:48 +00:00
424e78d5b3
Add document to showcase scaleout on hpu ( #14357 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-25 14:15:01 +05:30
8ff2e01025
Update for M1 Mac installations ( #14350 )
...
* Update for M1 Mac installations
* Apply suggestions from code review
* Update PL installation
* Update based on feedback
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 13:31:18 -04:00
7a617ec90e
Add back support for logging in the gradient clipping hooks ( #14298 )
...
* Add back support for logging in the gradient clipping hooks
* Docs and CHANGELOG
* Fix tests
2022-08-22 09:19:53 -04:00
e949362a6b
Enable `on_before_batch_transfer` for `DPStrategy` and `IPUAccelerator` ( #14023 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-18 12:12:29 +00:00
48c23e5716
Use fsdp module to initialize precision scalar for fsdp native ( #14092 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
2022-08-13 07:52:06 +00:00
208512e6e9
Add docs for `fsdp_native` ( #14108 )
2022-08-12 09:14:07 +00:00
355fda3702
Add Promoted CLI to API Reference Section ( #14072 )
2022-08-08 10:16:53 +02:00
a4e4cab7a6
Deprecate `amp_level` from `Trainer` ( #13898 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-05 08:31:19 +00:00
b88b700745
Remove the deprecated DDP2 strategy ( #14026 )
2022-08-04 20:27:35 +00:00
e78bf2044b
Raise an error if batch transfer hooks are overridden with IPUAccelerator ( #13961 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-04 12:04:42 +00:00
b3203d93d0
Added support for HPU device stats monitor ( #13819 )
...
* Added support for HPU device stats monitor
Signed-off-by: Jerome <janand@habana.ai>
* Update changelog
Signed-off-by: Jerome <janand@habana.ai>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Apply suggestions from code review
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
* Update reference
Signed-off-by: Jerome <janand@habana.ai>
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* fix alignment
* add descriptions
* Update hpu_intermediate.rst
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-02 13:31:31 +05:30
7708ce22b2
Update GitHub links to PL repo ( #13849 )
...
* update lightning links in docs
* update links in chlog
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update src/pytorch_lightning/README.md
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update src/pytorch_lightning/README.md
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* update
* painful
* badges
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update badges
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-28 22:08:07 +02:00
4c7b9f0b11
Disallow batch sampler with multiple IPU devices ( #13854 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-07-27 15:20:43 +05:30
faf7ff57c0
Add support for async checkpointing ( #13658 )
2022-07-26 21:13:19 +05:30
a8d7b4476c
Fix PyTorch spelling errors ( #13774 )
...
* Fix PyTorch spelling errors
* more
2022-07-25 12:51:16 -04:00
11f8fa2ca6
Fix typos in Checkpointing doc ( #13827 )
...
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-07-25 09:32:49 -04:00
8d14554383
[Typo] update introduction.rst ( #13791 )
2022-07-23 16:38:36 +00:00
d24978baa3
Add ddp_notebook alias for ddp_fork ( #13744 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-07-23 09:06:35 -04:00
4f53e7132f
Promote the CLI out of utilities ( #13767 )
2022-07-23 12:07:29 +00:00
c3299d2c59
Add support for DDP fork ( #13405 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-07-22 16:05:35 +00:00
e451fa28d0
Fix main progress bar counter when `val_check_interval=int` and `check_val_every_n_epoch=None` ( #12832 )
2022-07-20 20:33:00 +00:00
cd206991b9
Fix typos initialize in docs ( #13557 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-20 19:29:31 +00:00
c75457da99
Rename GPUAccelerator to CUDAAccelerator
2022-07-19 13:06:30 -04:00
e196e196e2
Move s-rog (myself) from core to alumni ( #13694 )
...
Update governance.rst
2022-07-17 20:15:28 +02:00
5e26840f94
Introduce ServableModuleValidator Callback ( #13614 )
...
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* Update tests/tests_pytorch/serve/test_servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update tests/tests_pytorch/serve/test_servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update src/pytorch_lightning/serve/servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update src/pytorch_lightning/serve/servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update src/pytorch_lightning/serve/servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Typing improvements
* wip
* update doc
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update examples/pl_servable_module/production.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* update
* update
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-15 11:07:40 -04:00
c7ae985979
Add `lightning_app` docs ( #13656 )
...
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* update
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update latest docs
* remove image
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* ci
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* make
* Update .gitignore
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update .github/workflows/docs-deploy.yml
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* update
* update
* Update docs/source-app/_templates/theme_variables.jinja
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/api_reference/api_references.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/api_reference/api_references.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/api_reference/api_references.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/code_samples/convert_pl_to_app/train.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/communication_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/model_server_app/model_server_app_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/get_started/training_with_apps.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/get_started/training_with_apps.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/get_started/training_with_apps.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/hpo/hpo.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/communication_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/communication_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/dynamic_work_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_step_2.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_step_4.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/model_server_app/model_server.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* update
* Update docs/source-app/core_api/lightning_app/dynamic_work_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/app.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/app.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* update
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-07-15 08:45:50 -04:00
eec862ef2f
Revert "Update Lightning App docs ( #13537 )" ( #13655 )
...
This reverts commit cd31ba3f87
2022-07-14 09:45:46 -04:00
cd31ba3f87
Update Lightning App docs ( #13537 )
...
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* update
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update latest docs
* remove image
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* ci
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* make
* Update .gitignore
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update .github/workflows/docs-deploy.yml
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* update
* update
* Update docs/source-app/_templates/theme_variables.jinja
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/api_reference/api_references.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/api_reference/api_references.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/api_reference/api_references.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/code_samples/convert_pl_to_app/train.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/communication_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/model_server_app/model_server_app_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/get_started/training_with_apps.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/get_started/training_with_apps.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/get_started/training_with_apps.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/hpo/hpo.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/communication_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/communication_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/core_api/lightning_app/dynamic_work_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_step_2.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/github_repo_runner_step_4.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/model_server_app/model_server.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* update
* Update docs/source-app/core_api/lightning_app/dynamic_work_content.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/app.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update docs/source-app/examples/github_repo_runner/app.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* update
* update
* update
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-07-14 09:36:36 -04:00
7ba0270552
Remove deprecated `max_steps=None` ( #13591 )
...
* Remove max_steps=None
* Update changelog
* Update docs
* Unused import
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-14 12:28:38 +00:00
feb8e7d344
Remove deprecated `LightningModule.on_post_move_to_device` ( #13548 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-13 18:06:27 +00:00
e034cd31d3
Remove `add_to_queue` and `remove_from_queue` from LightningModule ( #13600 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-12 16:47:51 +02:00
24189c2e9f
Adds is last batch ( #13550 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-07-12 09:08:25 +00:00
61c28cb428
Remove deprecated `on_keyboard_interrupt` ( #13438 )
...
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-05 07:34:18 +00:00
663d4c9c28
Add BaseModelCheckpoint class to inherit from ( #13024 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-30 10:07:46 +00:00
fe69a0196e
Add flash[image] dependency in Active learning example ( #13442 )
2022-06-30 02:03:43 +00:00
ddbf95516b
Remove support for DDP2 strategy ( #12705 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-29 15:06:51 +00:00
54f2d44fb8
Remove unnecessary endpoint logic, rename `collaborative` to `hivemind` ( #13392 )
...
* Remove endpoint after collaborate app/dht CLI
* Fix references, change filename
* Add CHANGELOG.md
* Address review
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-28 08:41:08 -04:00
da2669bf9a
Clarify when and why LearningRateScheduler is called ( #13267 )
...
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-06-27 22:51:52 +00:00
d2e4e7e003
create meta package [RFC] ( #13327 )
...
* placeholder
* move setup_tools & abstract about
* adjust lightning-app
* notes
* lightning about
* lightning init
* CI check
* ci
* install
* adjust manifest & mv chlog
* manifest
* pkg
* mv __setup__
* parse_requirements
* lit
* ci - pytorch
* wrap func
* ci
* cd draft
* generate lit
* pkg
* utf-8
* root pkg
* req.
* ver
* mypy
* try check
* meta pkg
* meta pkg - vars
* meta pkg - pruning
* meta pkg - fixing
* fix PL for meta
* multi-line wrapper
* hack manifest
* ci
* fix docstr
* fixing
* ci & mypy
* links
2022-06-27 09:34:18 -04:00
f54abc506f
Merge pull request #13123 from Lightning-AI/mps_accelerator
...
MPS Accelerator
2022-06-24 08:15:48 -04:00
73e7a5d0c2
Rename `CollaborativeStrategy` to `HivemindStrategy` ( #13388 )
2022-06-23 15:44:48 +00:00
511f1a6515
Reroute profiler to profilers ( #12308 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-22 20:55:39 -04:00
33bd270845
Adds Sampler Wrappers for custom samplers in distributed environment ( #12959 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-06-22 12:17:53 +02:00
b08259d536
Add `XLAEnvironment` plugin ( #11330 )
...
* add xla environment class
* add api reference
* integrate
* use xenv
* remove properties
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-06-22 10:57:50 +02:00
0ae9627bf8
Deprecate CLI registries and update documentation ( #13221 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-21 17:12:04 +02:00
ad87d2cad0
Future 5/n: Move requirements ( #13306 )
...
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-21 17:11:33 +02:00
e21490b9bb
Update old PL links ( #13349 )
2022-06-21 16:38:04 +02:00
cd44512ab9
Added multi-optimizer tests with hpu ( #13217 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-21 09:07:31 +02:00
b58577fd4d
Future 3/n: docs adjustment ( #13299 )
...
* docs: rename source >> source-PL
* docs: fix typing
* readthedocs
* update paths & codeowners
* source-pytorch
* ci
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-15 10:54:53 -04:00
Adrian Wälchli