Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,909 Commits 59 Branches 217 Tags 356 MiB
Commit Graph

1282 Commits

Author SHA1 Message Date
Krishna Kalyan f509e40ae3
Deprecate `on_before_accelerator_backend_setup` callback hook (#11655) 
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
 2022-02-07 11:07:21 +00:00
ananthsub a64438c897
Centralize rank_zero_only utilities into their own module (#11747) 
* Centralize rank_zero_only utilities into their own module

Fixes #11746

* PossibleUserWarning

* Update test_warnings.py

* update imports

* more imports

* Update CHANGELOG.md

* Update mlflow.py

* Update cli.py

* Update api_references.rst

* Update meta.py

* add deprecation tests

* debug standalone

* fix standalone tests

* Update CHANGELOG.md
 2022-02-07 08:09:55 +00:00
wangraying 8c07d8bf90
Add `Trainer(strategy="bagua")` (#11146) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2022-02-04 17:02:09 +00:00
Rohit Gupta 4d72110b51
Deprecate `on_batch_start/on_batch_end` callback hooks (#11577) 2022-02-03 19:51:56 +00:00
Rohit Gupta 478c6085df
Update debugging doc (#11445) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-02-03 19:02:01 +00:00
Rohit Gupta 400201712f
added warning for distributedsampler in case of evaluation (#11479) 2022-02-03 18:42:13 +00:00
Rohit Gupta 67438fc2f1
Refine style guide (#11394) 2022-02-03 06:17:18 +00:00
Anton Schwaighofer f935319622
Allow a `CombinedLoader` as the training data in DDP (#11648) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2022-02-03 04:01:20 +00:00
Saurabh Varshneya d0e1f92c86
Update new-project.rst (#11593) 
A small typo in one of the code blocks. "self.encoded" should be replaced by "self.encoder"
 2022-02-03 03:34:27 +00:00
Carlos Mocholí 3d3172d3da
[CLI] Support shorthand for loggers (#11533) 2022-02-03 02:58:14 +00:00
Akash Kwatra d5aa7717aa
Remove experiment property from abstract class (#11603) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-02-03 01:51:34 +00:00
Rohit Gupta 3eee8f18cf
Sort simple profiler summary based on mean duration (#11671) 2022-02-02 20:44:42 +00:00
Manan Goel 1a25363617
Fixed wandb logger documentation (#11540) 2022-01-20 13:54:44 +00:00
Rohit Gupta a57cf2a0d3
Update Model Parallel doc (#11465) 2022-01-19 11:30:03 +00:00
Thomas Vetterli 0fbb419c68
Replacing latest tag with 0.4.0 for lightning-bolts links (#10440) 2022-01-18 16:47:48 +01:00
Rohit Gupta 596c1bc49a
Update profiler doc (2/n) (#11430) 
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
 2022-01-17 20:26:11 +00:00
Rohit Gupta 965cf4e1b1
Update speed docs (#11044) 
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
 2022-01-16 19:27:36 +00:00
Jirka Borovec f9c3619eeb
update tutorials (#11402) 2022-01-16 04:08:11 +00:00
Rohit Gupta 9771e7dff6
Update introduction docs (#11140) 2022-01-13 21:11:43 +00:00
Rohit Gupta 96a53382ac
Update utilities API references (#11450) 2022-01-13 13:22:58 +00:00
Rohit Gupta 00d1758bac
Update training tricks docs (#11169) 2022-01-12 16:26:03 +00:00
Rohit Gupta 3813a32fce
Refine debugging doc (#11390) 2022-01-12 15:18:21 +00:00
Rohit Gupta 2d0dd1c445
Refine remote fs doc (#11393) 2022-01-12 13:51:24 +00:00
Rohit Gupta 221091afc4
move profiler docs (#11431) 2022-01-12 05:56:16 +00:00
Rohit Gupta 82c8875f33
Add `LightningModule.lr_scheduler_step` (#10249) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2022-01-12 03:53:49 +00:00
John Gibson b05802502b
Add example of getting DataLoader from within LightningModule (#10903) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Roger Shieh <sh.rog@protonmail.ch>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-01-12 03:06:03 +01:00
Rohit Gupta 948cfd24de
Update evaluation docs (#11173) 
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-01-11 15:43:05 +05:30
Rohit Gupta 9092cf3a35
Update child modules docs (#11198) 2022-01-11 14:17:25 +05:30
Rohit Gupta 06b8f82b8a
Update API references in doc (#11357) 2022-01-07 15:56:17 +01:00
Kaushik B 5d2296e317
Move Conversational AI (Nemo) to Examples section (#11344) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-01-07 17:38:21 +05:30
Kaushik B 42a1c72660
Add Accelerators section to Lightning docs (#10755) 2022-01-06 19:12:44 +05:30
Carlos Mocholí 5693a94c32
Extend the deprecation of `Trainer(resume_from_checkpoint)` (#11334) 2022-01-06 13:18:37 +01:00
Rohit Gupta 21caff1f19
Add LightningLite to README (#11164) 2022-01-05 21:56:04 +01:00
CoRneLIUs 7b0272a0f4
Update definition of optimizer in introduction_guide.rst (#10822) 
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
 2022-01-05 18:48:04 +00:00
Rohit Gupta e570577b5d
Update optimization docs (#11174) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2022-01-05 23:42:18 +05:30
Rohit Gupta 8955081aaf
Update precision docs (#11010) 
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
 2022-01-05 14:58:04 +00:00
Kaushik B 5a89be6873
Update strategy registry docs (#11311) 2022-01-05 10:37:11 +00:00
Kaushik B 5a4df4ec7d
Update strategy import statements (#11238) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-01-03 15:54:46 +00:00
Adrian Wälchli c210e338ef
Update strategy import statements (#11231) 2021-12-23 08:26:28 +01:00
Carl Lemaire dedfde6859
Fix docs to fix #11081 (#11229) 2021-12-23 05:09:58 +01:00
Kaushik B 576a5d62a0
Introduce strategies directory for Training Strategies (#11226) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-22 20:23:30 +00:00
Jirka Borovec 52f308eb89
Include Lezwon in alumni (#11223) 2021-12-23 01:05:43 +09:00
Adrian Wälchli 17ad1a4c00
Rename `ParallelPlugin` to `ParallelStrategy` (#11123) 2021-12-22 01:09:17 +00:00
four4fish 4bfe5bda0f
Rename the DDPSpawnShardedPlugin to DDPSpawnShardeedStrategy (#11210) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-22 00:27:36 +00:00
Aki Nitta 28ce9105e4
Rename `SingleDevicePlugin` to `SingleDeviceStrategy` (#11181) 
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 23:56:14 +00:00
four4fish f98cd78e9e
Renamed the `DDPSpawnPlugin` to `DDPSpawnStrategy` (#11145) 2021-12-21 23:06:14 +00:00
four4fish 0c69c757d4
Rename the `DataParallelPlugin` to `DataParallelStrategy` (#11183) 2021-12-21 22:00:24 +00:00
Aki Nitta c3cd4d050f
Rename `SingleTPUPlugin` to `SingleTPUStrategy` (#11182) 2021-12-21 20:09:30 +00:00
four4fish 1c5a5c3dfe
Renamed the DDP2Plugin to DDP2Strategy (#11185) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 19:21:00 +00:00
four4fish caab69aabb
Renamed DDPShardPlugin to DDPShardStrategy (#11187) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 17:18:25 +00:00
Aki Nitta 9da78a94bd
Rename `TPUSpawnPlugin` to `TPUSpawnStrategy` (#11190) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 16:36:16 +00:00
Kaushik B 2e947a88e0
Rename IPUPlugin to IPUStrategy (#11193) 2021-12-21 15:55:41 +00:00
Kaushik B 283bdece0a
Rename DeepSpeedPlugin to DeepSpeedStrategy (#11194) 2021-12-21 15:18:01 +00:00
Kaushik B ba0c901395
Rename HorovodPlugin to HorovodStrategy (#11195) 2021-12-21 14:31:41 +01:00
four4fish b64dea9dc3
Rename `DDPPlugin` to `DDPStrategy` (#11142) 
* Raname DDPPlugin to DDPStrategy

* Change ddp_plugin to ddp_strategy

* update changelog

* rename occurences in docs

* rename more occurrences

* fix line too long

* more fixes

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 08:55:51 +00:00
Adrian Wälchli 29eb9cccf2
Rename the `TrainingTypePlugin` base to `Strategy` (#11120) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: four4fish <88516121+four4fish@users.noreply.github.com>
 2021-12-20 12:50:11 +00:00
Carlos Mocholí 46d6fbf11b
Add `Loop.replace` (#10324) 
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-12-16 17:41:38 +00:00
Rohit Gupta cc42aa9401
Improve checkpoint docs (#10916) 2021-12-16 16:21:59 +00:00
four4fish cec2d7946b
3/n Move accelerator into Strategy (#11022) 
* remove training_step() from accelerator

* remove test, val, predict step

* move

* wip

* accelerator references

* cpu training

* rename occurrences in tests

* update tests

* pull from adrian's commit

* fix changelog merge pro

* fix accelerator_connector and other updates

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix doc build and some mypy

* fix lite

* fix gpu setup environment

* support customized ttp and accelerator

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix tpu error check

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix precision_plugin initialization to recognisze cusomized plugin

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update bug_report_model.py

* Update accelerator_connector.py

* update changelog

* allow shorthand typing references to pl.Accelerator

* rename helper method and add docstring

* fix typing

* Update pytorch_lightning/trainer/connectors/accelerator_connector.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update tests/accelerators/test_accelerator_connector.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update tests/accelerators/test_cpu.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix pre commit complaint

* update typing to long ugly path

* spacing in flow diagram

* remove todo comments

* docformatter

* Update pytorch_lightning/plugins/training_type/training_type_plugin.py

* revert test changes

* improve custom plugin examples

* remove redundant call to ttp attribute

it is no longer a property

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-12-16 04:41:34 +00:00
Mauricio Villegas 9c44f250a9
Added variable interpolation and troubleshooting to LightningCLI doc (#11009) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-12-14 19:25:48 +01:00
Rohit Gupta 5b153e5072
Update data docs (#11042) 
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-14 15:26:46 +00:00
Rohit Gupta 5576fbc5f9
move optional section (#11011) 2021-12-10 09:47:44 +00:00
Danielle Pintz 01f5f99919
Deprecate callback hooks `on_init_start` and `on_init_end` (#10940) 2021-12-08 07:42:19 +00:00
Matthias Fey 42b5417e9b
Sharing Datasets Across Process Boundaries (#10951) 2021-12-07 13:17:15 +00:00
os1ma 99bb62ae64
Fix some missing code in step-by-step walk through (#10519) 
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-06 07:46:33 +00:00
Rohit Gupta b7331d80dc
Disable eval dataloaders replacement during overfitting (#10877) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-03 14:11:43 +01:00
Kaushik B 541b983b90
Fix deadlinks in docs (#10739) 
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
 2021-12-02 09:05:32 +00:00
Carlos Mocholí a7aed2af7a
[CLI] Add support for `ReduceLROnPlateau` (#10860) 2021-12-01 15:41:22 +00:00
Matteo Bortolon f7c15f256c
Correct SLURM wrong import (#10842) 2021-12-01 01:24:06 +00:00
Rohit Gupta f407a00cec
Update logging docs (#10734) 
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
 2021-11-30 21:10:26 +00:00
Ethan Harris af4325046d
Update notebooks submodule (#10827) 2021-11-30 11:54:43 +00:00
Rohit Gupta ce95891f6a
Update extensions doc (#10778) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-11-29 20:38:23 +00:00
Kaushik B 3f915aaaf9
Fix reference link to `s3fs` (#10737) 2021-11-28 17:25:03 +00:00
Kaushik B 4a341e5b24
Add remote filesystems to docs (#10752) 
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-11-28 16:46:52 +00:00
Carlos Mocholí 88930725dd
Add a custom `PossibleUserWarning` category (#10675) 2021-11-26 19:29:42 +00:00
Rohit Gupta f36b395c4e
Update `LightningDataModule` docs (#10678) 2021-11-24 11:31:03 +00:00
Rohit Gupta 823bfa6f8a
Update `LightningModule` docs (#10637) 2021-11-23 01:02:04 +05:30
shabie cd7b4342f6
remove import of datasets separately since unused (#10668) 2021-11-22 17:54:19 +00:00
Carlos Mocholí 48cb38ac5d
Fix docs filterwarnings snippet (#10671) 2021-11-22 14:52:21 +00:00
Kaushik B 1284ead317
Remove metrics references from docs (#10567) 2021-11-22 14:29:06 +00:00
Rohit Gupta eb13e1df89
update bug_report model links and notebook (#10665) 2021-11-22 11:19:46 +00:00
Adrian Wälchli 0f6d89422b
Control automatic resubmission on SLURM (#10601) 2021-11-18 17:48:53 +00:00
Kaushik B 4117028400
Don't collapse Lightning API section (#10545) 2021-11-16 11:04:54 +00:00
Kaushik B 40945a5176
Remove deprecated `stochastic_weight_avg` example from the docs (#10502) 2021-11-15 15:06:56 +00:00
Rohit Gupta fa0ed17f8a
remove deprecated train_loop (#10482) 
* remove deprecated train_loop

* chlog
 2021-11-12 12:42:25 +00:00
Ross Johnstone c2f25d42ab
Make `monitor` required arg of EarlyStopping callback (#10328) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-11-09 18:08:03 +00:00
Adrian Wälchli e61a98a3d0
Hyperparameters docs refresh (#10280) 
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-11-08 12:35:00 +00:00
Adrian Wälchli a270a79ed9
Rename "master" methods to "main" in ClusterEnvironment plugins (#10103) 
* rename occurrences of master port, master address, maser node, master process

* rename properties

* add property decorators

* occurrences in docs

* update changelog

* update changelog

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add lost method

* create deprecation

* add changelog

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix typo (but it was already there!!!)

* Apply suggestions from code review

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* add todo

* update more occurences

* add types

* add missing import

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
 2021-11-08 12:32:58 +00:00
Carlos Mocholí 037fd5e2d1
Update `Trainer(precision)` docs (#10368) 
* Update `Trainer(precision)` docs

* Update
 2021-11-05 18:53:05 +09:00
Alexandre Mayerowitz b3c0f121ca
Remove deprecated datamodule lifecycle properties (#10350) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-11-05 05:03:57 +00:00
Carlos Mocholí a501cd3b4b
Update Lite docs (#10347) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Roger Shieh <sh.rog@protonmail.ch>
 2021-11-05 03:50:06 +00:00
Sean Naren a255dcb421
Update bfloat16 docs (#10330) 2021-11-04 10:29:19 +00:00
puhuk 412f0a4d24
Remove deprecated dataloader arguments in Trainer methods (#10325) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-11-04 11:03:39 +01:00
Carlos Mocholí ba23d91320
Update recommendation on `dataloader_idx` (#10318) 2021-11-04 01:39:55 +01:00
Adrian Wälchli b3db1b6e9c
Update signature of `LightningModule.training_step_end` (#10094) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-11-03 13:38:08 +00:00
thomas chaton 9e844d9db6
Lite Docs and Example Improvements (#10303) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-11-02 16:13:01 +01:00
Adrian Wälchli 3cd65b592b
Lightning Lite Examples (#9987) 
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: four4fish <88516121+four4fish@users.noreply.github.com>
Co-authored-by: Nicki Skafte Detlefsen <skaftenicki@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Pietro Lesci <61748653+pietrolesci@users.noreply.github.com>
 2021-11-02 08:04:29 +00:00
four4fish d56e041635
Update init_ddp_connection's name and log (#10295) 2021-11-01 19:11:15 +00:00
Kaushik B 1127b28bbf
Update docs for devices flag (#10293) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-11-01 18:39:00 +00:00
Kaushik B 10edc6de6b
Add missing deprecation notes for deprecated Trainer flags (#10296) 2021-11-01 18:38:41 +00:00
I-iBot 6fd6283e07
update outdated links in examples (#10127) 
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-11-01 17:05:08 +00:00
Kaushik B 45c45dc7b0
Deprecate `ProgressBar` and rename it to `TQDMProgressBar` (#10134) 
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-11-01 11:42:21 +00:00
Rohit Gupta a1fe5ba0aa
attach model parallelism video inside docs (#10274) 2021-11-01 11:17:51 +00:00
Tobias Fischer 305a42c32e
Link to arxiv summary instead of pdf in pruning docs (#10282) 2021-11-01 14:02:11 +05:30
Adrian Wälchli d33429c1e2
Lightning Lite docs (#10176) 2021-10-30 10:25:52 +00:00
Adrian Wälchli b4f43b1695
Update docs for sync_dist logging option (#10186) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-10-29 20:44:23 +00:00
Nesqulck ff2d7e8115
Added advise for num_workers=0 in docs/speed (#10215) 2021-10-29 09:58:42 +01:00
Adrian Wälchli e50b945ccb
Update syntax errors in docs code snippets (#10036) 
Co-authored-by: tchaton <thomas@grid.ai>
 2021-10-29 08:31:57 +00:00
Carlos Mocholí 5262b63dff
Pass the scaler as an input to `NativeMixedPrecisionPlugin` (#10055) 
Co-authored-by: thomas chaton <thomas@grid.ai>
 2021-10-28 14:13:53 +00:00
Adam J. Stewart b8ac17624d
Docs: fix mistakes in New Project docs (#10137) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-28 12:31:02 +00:00
Kaushik B d1985ebf96
Add Plugins Registry to docs (#10181) 2021-10-28 16:44:08 +05:30
Carlos Mocholí dbe1662dc3
Replace `_TORCH_GREATER_EQUAL_DEV_1_10` with `_TORCH_GREATER_EQUAL_1_10` (#10157) 2021-10-27 13:38:39 +01:00
Adrian Wälchli 5ade197580
Update README page in pl_examples folder (#10114) 
Co-authored-by: tchaton <thomas@grid.ai>
 2021-10-26 17:38:56 +00:00
Charlie_Tang 84ce1d095c
add 'sanity_checking' to datamodule 'on_after_batch_transfer' docs (#10067) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-26 11:12:57 +00:00
Adrian Wälchli 21a5867dad
Rename `ClusterEnvironment.creates_processes` (#10106) 
Co-authored-by: tchaton <thomas@grid.ai>
 2021-10-25 23:15:41 +00:00
Adrian Wälchli f1623355bd
Add example table to loop docs (#10058) 
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-25 22:42:15 +00:00
jjenniferdai 6d79184ec5
Unify checkpoint load paths [redo #9693] (#10061) 2021-10-25 19:05:31 +00:00
Adrian Wälchli 225989363b
update links in callback examples pointing to bolts (#10117) 2021-10-25 10:27:14 +00:00
Kaushik B 9b21ecbdf5
Add warning section for `checkpoint_callback` in Trainer docs (#10041) 2021-10-25 09:16:44 +00:00
Kaushik B c3614f1c07
Fix: skip importing DistributedOptimizer for Windows (#10071) 2021-10-21 21:01:56 +00:00
Kaushik B aa1540410f
Add XLACheckpointIO (#9972) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-10-21 02:39:16 +05:30
Kaushik B 5b30a65952
Update API references (#10040) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-20 18:10:39 +00:00
Carlos Mocholí 6aeebf1bd3
Remove unnecessary dependency available checks (#10050) 2021-10-20 16:21:37 +00:00
Carlos Mocholí ef5a12212a
Isolate optimizer step logic to the `PrecisionPlugin` (#10029) 2021-10-20 15:43:08 +00:00
Kaushik B 56bc55db71
Update strategy flag in docs (#10000) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-10-20 21:02:53 +05:30
Kaushik B 4f19a4dabc
Update Trainer flag docs for strategy (#10042) 
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-20 21:02:21 +05:30
Carlos Mocholí ad8d6c83da
[CLI] Shorthand notation to instantiate datamodules (#10011) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-10-20 00:49:48 +00:00
Carlos Mocholí d45897d522
Rename `TPUHalfPrecisionPlugin` to `TPUBf16PrecisionPlugin` (#10026) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-10-19 21:09:37 +00:00
Carlos Mocholí e8beceb631
Add `TPUPrecisionPlugin` (#10020) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-10-19 17:48:57 +00:00
Rohit Gupta 0aa220b46b
Remove deprecated `distributed_backend` from `Trainer` (#10017) 
* rm distributed_backend from Trainer

* unused

* chlog

* internal distributed_backend

* Docstring

Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-10-19 13:54:37 +00:00
Danielle Pintz 203737bfce
Don't raise DeprecationWarning for `LoggerConnector.gpus_metrics` (#9959) 2021-10-18 22:51:09 +00:00
Adrian Wälchli 65150cdb42
Update docs for base Loop class with examples (#9993) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-18 15:37:23 +00:00
thomas chaton 86df7dcee7
Add KFold Loop example (#9965) 2021-10-18 16:27:12 +01:00
Adrian Wälchli 7a9151637c
loop customization docs (#9609) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
 2021-10-18 09:43:11 +00:00
Danielle Pintz 16213b1635
Deprecate `log_gpu_memory`, `gpu_metrics`, and util funcs in favor of `DeviceStatsMonitor` callback (#9921) 
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-14 22:45:44 +02:00
Oliver Borchert afbf703684
Single-process multi-node CPU training (#9603) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2021-10-14 22:21:41 +02:00
Danielle Pintz 940b910d27
[2/4] Add DeviceStatsMonitor callback (#9712) 
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
 2021-10-13 18:29:36 +00:00
Rohit Gupta 23e8b59ae7
Add `configure_gradient_clipping` hook in `LightningModule` (#9584) 
* init hook

* docs

* dep train args

* update tests

* doc

* doc

* .gitignore

* not dep

* add trainer args

* add & update tests

* fix tests

* pre-commit

* docs

* add docs

* add exception

* code review

* deepspeed

* update tests

* not

* try fix

* Apply suggestions from code review

* update deepspeed

* disable some tests

* disable some tests

* enable all tests
 2021-10-13 20:15:13 +05:30
ananthsub 28fc8d2016
Add `enable_model_summary` flag and deprecate `weights_summary` (#9699) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
 2021-10-13 17:20:54 +05:30
Rohit Gupta 0f8fd20443
Remove epoch from `trainer.logged_metrics` (#9904) 2021-10-13 11:30:27 +02:00
Przemyslaw K. Joniak dc27c72dc1
CombinedLoader example fix (#9906) 2021-10-12 19:48:06 +02:00
Rohit Gupta 7eff00317d
update docs (#9903) 2021-10-12 15:37:08 +05:30
Rohit Gupta db322f4bbb
Deprecate `checkpoint_callback` from the `Trainer` constructor in favour of `enable_checkpointing` (#9754) 
* enable_chekpointing

* update codebase

* chlog

* update tests

* fix warning

* Apply suggestions from code review

Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>

* Apply suggestions from code review

Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-10-12 07:55:07 +00:00
Sean Naren 66ce4436c6
[docs] Add Torch Distributed Run (#9890) 2021-10-11 12:15:46 +00:00
Boris Dayma 2db9ea3500
feat(wandb): support media logging (#9545) 2021-10-11 10:15:36 +01:00
Franz Rieger 2f313285b9
Correct function name (#9859) 2021-10-09 06:41:05 +00:00
Tobias 9317fbfc25
Make DDP and Horovod batch_size scaling examples explicit (#9813) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-05 09:12:26 +02:00
Adrian Wälchli 9e11d97af6
Merge pull request #9690 from PyTorchLightning/feature/codeowners-rohit 
add Rohit Gupta to default codeowners
 2021-09-30 09:13:48 -04:00
Carlos Mocholí 0ddd6a8c19
Remove `_NATIVE_AMP_AVAILABLE` checks (#9747) 2021-09-29 15:34:26 +02:00
Danielle Pintz b3a5c7f442
Add `enable_progress_bar` to Trainer constructor (#9664) 2021-09-24 22:53:31 -07:00