Commit Graph

4179 Commits

Author SHA1 Message Date
Kushashwa Ravi Shrimali 0973cc578e
Fix import error when `distributed` module not available (#12794)
* add distributed.is_available checks to avoid errors when not available

* Update CHANGELOG

* Update pytorch_lightning/strategies/ddp.py

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

* Update pytorch_lightning/strategies/ddp.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-04-20 17:28:39 +00:00
Kushashwa Ravi Shrimali 0eefdd4d48
Better error mesage and type checking for `gpus` arg and `devices` arg in `Trainer` (#12530)
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-04-20 17:19:41 +00:00
Rohit Gupta dc7a7faa65
general docs improvements (#12747) 2022-04-20 14:19:45 +00:00
William Falcon 908e05880d
docs refactor 3/n (#12795)
* updated titles + css

* updated titles + css

* levels structure

* levels structure

* levels structure

* adding level indexes

* finished intro guide layout

* finished intro guide layout

* general titles

* general titles

* added movie

* added movie

* finished 15 mins

* levels

* added core levels

* added core levels

* fixed api reference on the left

* gpu guides

* gpu guides

* gpu guides

* gpu guides

* precision

* hpu guide

* added ipu

* added ipu

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* intermediate

* intermediate

* fixed

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* ic

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* updated menu

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* twocolumns directive

* twocols

* twocols

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* updated titles + css

* levels structure

* adding level indexes

* finished intro guide layout

* general titles

* added movie

* finished 15 mins

* levels

* added core levels

* fixed api reference on the left

* gpu guides

* precision

* hpu guide

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* fixed margins

* added logger stuff

* ic

* added inconsolata

* updated menu

* added basic cloud docs

* ic

* added demos folder

* twocolumns directive

* registry

* cleaning up

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* deconflict

* deconflict

* deconflict

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add testsetup sections wherever needed; fix errors in building docs

* pre-commit fixes

* Fix duplicate label

* minor nit with pre-commit

* Fix labels

* More changes...

* require

* debug & cli

* prec & model & visu

* fix references

* fix references

* fix refs

* fix refs - model_parallel

* fix references

* prune testsetup with global

* refs in index

* Fix duplicate label errors

* Update orphan docs

* Update orphan docs

* Update orphan docs

* fix links

* Fix genindex and search index

* fix refs

* fix refs

* Fix index rst related issues

* fix refs

* inc to rst

* Fix links ref

* fix more references

* fix refs

* deconflict

* errors

* errors

* errors

* fix refs

* fix refs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix warnings

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* fix doc build

* Duplicate Label fix (docs) (#12800)

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* ignore typing in demo folder

* Ignore demos for mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: otaj <ota@grid.ai>
2022-04-19 14:15:47 -04:00
Minh Chien Vu af03f0a434
Remove the deprecated LightningDataModule.size, LightningDataModule.dims (#12780) 2022-04-18 21:49:05 +02:00
Danielle Pintz 0b22e51462
Remove deprecated `dataloader_idx` argument from `on_train_batch_start/end` callback hooks (#12769)
* remove dataloader_idx
* fix tests
* Update CHANGELOG.md

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-04-18 18:49:59 +02:00
twsl ae3226ced9
Add dataclass support to _extract_batch_size (#12573)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-04-15 14:13:33 +02:00
otaj b8d4b81221
Inspect correct function in wrap_init (#12716)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-04-15 13:58:28 +02:00
Adrian Wälchli c0e6fd6a3b
Fix version comparison for python version in `pl.utilities.imports` (#12754) 2022-04-14 22:33:21 +00:00
Kaushik B 77a02234e9
Support auto_select_gpus with accelerator and devices api (#12608)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-04-12 21:28:54 +00:00
puhuk 663216fe3e
Remove pytorch_lightning.core.memory.get_gpu_memory_map (#12644)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-12 15:55:56 +00:00
Ankita Sharma 313eee00ee
Remove deprecated `XLAStatsMonitor` (#12688)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2022-04-12 15:35:43 +00:00
Kaushik B 820b9e1d09
Update Rich github links (#12718) 2022-04-12 03:52:42 +02:00
Adrian Wälchli 4a48710506
Remove support for passing strategy name to plugins (#12700)
* remove more code

* update tests

* remove unsupported test

* remove unsupported test

* remove dead enum values

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add changelog

* fix pep

* add xfail test

* remove comment

* Remove support for passing strategy name to plugins

* remove unused import

* chlog

* improve comment

* update chlog

* fix merge error

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-04-12 03:51:48 +02:00
Adrian Wälchli b2fe6bda5b
Remove support for passing strategy strings to accelerator (#12696)
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
2022-04-11 22:52:28 +02:00
Ray Schireman 9d343ba137
Remove the deprecated `pl.callbacks.ProgressBar` (#12658)
Co-authored-by: Raymond G Schireman <raymond.schireman@uvm.edu>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-04-11 18:20:30 +00:00
Kaushik B 91c3d8ecb9
Raise `MisconfigurationException` when the accelerator is available but… (#12708) 2022-04-11 23:31:17 +05:30
puhuk a86ef06b3b
Remove deprecated get_memory_profile (#12659) 2022-04-11 18:00:33 +00:00
Jirka Borovec 3686778b89
fix import failer (#12676) 2022-04-11 15:10:33 +00:00
Adrian Wälchli f315e61029
Remove unused AcceleratorConnector argument (#12686)
* remove unused AcceleratorConnector argument

* update lite
2022-04-11 15:31:23 +01:00
Rohit Gupta f4883d6ead
Run main progress bar independent of val progress bar in `TQDMProgressBar` (#12563)
Co-authored-by: carmocca <carlossmocholi@gmail.com>
2022-04-11 13:38:49 +00:00
Mauricio Villegas 2f2a516de9
Update LightningCLI tests to reflect changes in jsonargparse 4.6.0 (#12704) 2022-04-11 14:00:48 +02:00
Adrian Wälchli 241d5e17e1
fix typing in BaguaStrategy (#12692) 2022-04-11 09:58:00 +02:00
Danielle Pintz cda5dc61ad
Deprecate `num_processes`,`gpus`, `tpu_cores`, and `ipus` from the Trainer constructor (#11040) 2022-04-10 17:10:05 +00:00
Ray Schireman 3f0f277d5b
Remove deprecated `GPUStatsMonitor` callback (#12554)
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Raymond G Schireman <raymond.schireman@uvm.edu>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-04-10 14:35:51 +00:00
Aniket Maurya 36842828b5
Remove deprecated LayerSummary and ModelSummary (#12593)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-04-10 08:13:10 +00:00
semaphore-egg c233731b7c
Fix a typo in warning message inside Trainer.reset_train_dataloader (#12645)
Co-authored-by: kd <li_jide_ok@126.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-04-09 11:48:32 +00:00
Tomasz Konopka fcea7208d1
remove deprecated `model_size` from LightningModule (#12641) 2022-04-09 12:26:13 +02:00
Danielle Pintz 7dafc2e9fd
Fix inconsistency when user specifies `weights_save_path` (#12372)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-04-09 00:37:30 +02:00
MohammedAlkhrashi f3e7e91f64
Rename loggers/base.py to loggers/logger.py and changed LightningLoggerBase to Logger (#12014)
* Deprecate: initial LightningLoggerBase to Logger, tests/loggers pass

* Refactor moved LightningLoggerBase to logger.py and removed base.py in loggers

* Recreated base.py for safer backwards compatibility

* Renamed test_base.py to test_logger.py and added test_base.py to test deprecation warning.

* Renamed tests/loggers/test_base.py to tests/loggers/test_logger.py

* Order __all__ list in loggers/__init__ alphabetically

* minor: change deprecation warning of loggers.logger.base

* fixed failing tests and formating

* Update the documentation

* move deprecation test to deprecated_api files

* backward compatibility and deprecations tests for all functionality in loggers/logger.py

* fix PEP8 issues.

* Update CHANGELOG.md

* Skip mypy on renamed file

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: carmocca <carlossmocholi@gmail.com>
2022-04-08 19:41:46 +00:00
Rohit Gupta a44b5dc0cb
Don't raise a warning when `nn.Module`s are not saved under hparams (#12669) 2022-04-08 19:40:19 +00:00
Max Mametkulov 5fea717027
Remove train_transforms in LightningDataModule (#12662)
Co-authored-by: manjirou <maxim.mametkulov@halbestunde.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
2022-04-08 18:20:44 +02:00
Rohit Gupta 02dc7751e9
Add `bfloat16` support to `DeepSpeedStrategy` (#12508)
Co-authored-by: carmocca <carlossmocholi@gmail.com>
2022-04-07 22:18:51 +00:00
puhuk 50294a7eb4
Remove deprecated automatic logging of gpu metrics (#12657)
Co-authored-by: carmocca <carlossmocholi@gmail.com>
2022-04-07 17:53:42 +00:00
Carlos Mocholí 124b529088
Add version header to CLI config files (#12532) 2022-04-07 17:52:51 +05:30
Adrian Wälchli 6aa8e26a4e
Update `rank_zero_only` decorator for LSF environments (#12587) 2022-04-07 10:46:55 +00:00
Adrian Wälchli 800580a131
Fix `LightningLite.run` signature for arbitrary arguments (#12629) 2022-04-07 07:32:09 +00:00
Carlos Mocholí 0a72efd210
Expose deprecated arguments from logger base interface (#12609) 2022-04-06 22:17:35 +05:30
karthikrangasai 998265adfb
Remove deprecated 'terminate_on_nan' argument from Trainer (#12553)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-04-06 20:22:12 +05:30
Rohit Gupta 2cf24a9e30
Fix rich main progress bar update (#12618) 2022-04-06 20:12:32 +05:30
Rohit Gupta ccb507a8c5
Mark `swa_lrs` argument in `StochasticWeightAveraging` callback as required (#12556) 2022-04-06 20:12:04 +05:30
Kushashwa Ravi Shrimali a2cdfc9e4f
Bump version of black to 22.3.0 (#12542)
* bump black version to 22.3.0
2022-04-04 06:01:08 +02:00
Aniket Maurya 2ee187ea13
Remove the deprecated `LightningModule.summarize` (#12559) 2022-04-03 01:44:11 +02:00
Yi Heng Lim 56a34851dd
Remove deprecated `prepare_data_per_node` in `Trainer` (#12536)
* remove deprecated prepare_data_per_node from Trainer
* remove deprecated test for prepare_data_per_node
* remove doc for deprecated prepare_data_per_node
* remove inconsistency test
* remove deprecated prepare_data_per_node
* remove doc mentioning Trainer(prepare_data_per_node)
* update changelog
* remove unused code

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2022-04-03 01:32:46 +02:00
Yi Wang 63f97e2925
Avoid calling average_parameters multiple times per optimizer step (#12452) 2022-04-01 22:34:25 -07:00
Rohit Gupta 3e808b8a70
Enable validation during overfitting (#12527)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-03-31 18:04:58 +00:00
Rohit Gupta 84c5b62b40
Remove deprecated `stochastic_weight_avg` argument from `Trainer` (#12535)
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: ananthsub <2382532+ananthsub@users.noreply.github.com>
2022-03-31 17:58:38 +02:00
Danielle Pintz 1acb0dcbf4
Remove deprecated `progress_bar_refresh_rate` from Trainer constructor (#12514)
* Remove progress_bar_refresh_rate from Trainer constructor
* changelog
2022-03-30 15:47:55 +00:00
Kaushik B 32e68c5e79
Support `strategy` argument being case insensitive (#12528) 2022-03-30 14:19:19 +00:00
Carlos Mocholí 3342c80853
Update version after the 1.6.0 release (#12512) 2022-03-30 08:10:59 +02:00