Commit Graph

5510 Commits

Author SHA1 Message Date
Burhanuddin Rangwala e133061cd3
Add doc strings for Neptune logger (#9111)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-27 08:45:52 +00:00
ananthsub 6da3a6185f
Fix typo in API evolution (#9160) 2021-08-27 08:21:16 +00:00
thomas chaton fcbfc6b8ab
add note (#9141) 2021-08-27 09:59:15 +02:00
four4fish b497fb80e5
Remove reference to DistributedDataParallel from parallel plugin teardown (#8943) 2021-08-26 17:51:05 -07:00
Daniel Stancl 53885afc2e
Fix mypy typing for `utilities.apply_func` (#8781)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-26 16:36:22 +00:00
Eric Wiener dfffb94b3c
Move predictions to CPU before accumulating (#9085)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-26 16:02:42 +01:00
Burhanuddin Rangwala b576201a3d
Added doc strings to wandb logger (#9109) 2021-08-26 16:01:42 +01:00
Adrian Wälchli b13749b4ec
add fault-tolerance for global random state in map-style datasets (#8950)
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-08-26 12:13:31 +00:00
Burhanuddin Rangwala 0752bcd0eb
Added doc strings for Comet logger (#9114) 2021-08-26 11:01:46 +00:00
Adrian Wälchli 8efdeb2c00
deprecate the TestTubeLogger (#9065)
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-08-26 10:28:14 +00:00
Kaushik B 5c2b7cadcd
Remove ci tpu test from github workflows (#8965)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2021-08-26 15:10:59 +05:30
Adrian Wälchli 02612e14ef
remove redundant iterator call to data fetcher in loops (#9117)
Co-authored-by: tchaton <thomas@grid.ai>
2021-08-26 11:36:29 +02:00
Adrian Wälchli 6592d0e454
generalize closure api in Lightning (#8642)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-08-26 08:36:21 +00:00
Adrian Wälchli 0abd6e94b5
[3 / 3] improvements to saving and loading callback state (#7161)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-08-26 10:02:49 +02:00
Yi Wang 366fb39d2e
Support post-localSGD in Lightning DDP plugin (#8967)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-26 08:24:49 +01:00
Santiago Castro 69f66fd6bb
Fix typing in hparams methods (#9116)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-08-26 07:54:13 +02:00
Burhanuddin Rangwala 9d62f24847
Add docstrings to Test Tube logger (#9110) 2021-08-25 12:15:00 -07:00
four4fish f01a9a6cd2
Remove `BasePlugin` (#9066)
* Remove BasePlugin

Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-25 19:10:28 +00:00
Sean Naren 12d076f747
[docs] Add Mixed Precision detailed docs (#9104) 2021-08-25 14:44:29 +00:00
Adrian Wälchli 5ff89a7074
Rename test file from log_dir to test_log_dir (#9105) 2021-08-25 12:48:06 +00:00
Sean Naren bac8b1be81
Add support for CPU AMP autocast (#9084) 2021-08-25 12:18:00 +00:00
Burhanuddin Rangwala bf8c1fd766
Add doc strings to tensorboard logger class (#9093) 2021-08-25 09:41:18 +00:00
Ethan Harris de57feff44
Fix `old_loader` attribute in name `_PatchDataLoader.__init__` (#9087) 2021-08-24 21:46:32 +00:00
Sean Naren e9f4bffe0a
Add validate logic for precision (#9080) 2021-08-24 20:00:09 +00:00
Sean Naren 1bab0a17a9
Fix torch bfloat import version (#9089) 2021-08-24 19:18:12 +00:00
thomas chaton f959b13ab9
3/n inter batch parallelism (#9052)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-24 18:45:54 +00:00
Adrian Wälchli b9443a07b9
[2 / 3] improvements to saving and loading callback state (#7187)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-08-24 17:35:19 +00:00
ananthsub 376734a1e2
Fix `accumulated_grad_batches` typehint (#9071)
* Fix `accumulated_grad_batches` typehint
2021-08-24 17:12:36 +00:00
Kaushik B 1a2468f530
[Blocking CI] Fix pep8 error about unused imports (#9090) 2021-08-24 21:26:32 +05:30
Nicki Skafte 81145ca990
Fig logging with log_gpu_memory='min_max' (#9013) 2021-08-24 15:00:59 +02:00
Jirka Borovec 33ffd67a7c
Disable coverage annotations in GitHub (#9077) 2021-08-24 14:13:21 +02:00
Knarik1 6f3cb1a6a3
fix typos in datamodule (#8949)
Co-authored-by: Knarik Mheryan <knarik@codics.am>
2021-08-24 11:12:07 +00:00
Adrian Wälchli dfae7342cc
sanitize arrays when logging as hyperparameters in TensorBoardLogger (#9031)
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-08-24 13:02:06 +02:00
Sean Naren 1feec8c601
Add bfloat16 support to Lightning Trainer (#9049) 2021-08-24 09:47:21 +00:00
Adrian Wälchli 208218b4f9
update warning in docs regarding support of tuner features in DDP (#9011)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>

Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-08-24 10:02:39 +02:00
Kaushik B 538e743f17
feat: Add Rich Progress Bar (#8929)
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-08-24 02:40:36 +00:00
ananthsub 1e4d8929fb
Simplify checkpoint connector loading after Checkpoint IO plugin's introduction (#9045)
* Simplify checkpoint connector loading after Checkpoint IO plugins introduction

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-23 13:12:18 -07:00
Yifu Wang 3d5e71a767
Add `ShardedTensor` support in `LightningModule` (#8944)
* Add `ShardedTensor` support in `LightningModule`

Co-authored-by: Yifu Wang <yifuwang@2012@gmail.com>
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-08-23 19:59:38 +00:00
Surya Prakash Sahu b74be4b366
Update correct var name, from `step` to `stage` (#9055) 2021-08-23 19:37:28 +00:00
thomas chaton 92c7eec966
2/n inter batch parallelism (#9047)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-23 19:30:44 +00:00
Kaushik B 9fdc0bef26
Update Changelog with weekly releases (#9056) 2021-08-23 19:26:22 +00:00
Sean Benhur J c49786bed3
Fixes colab links for lightning in 2steps documentation (#9038)
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-08-23 19:25:21 +00:00
Burhanuddin Rangwala c8e9fb40f2
Add docstrings in mlflow logger class (#9030)
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
2021-08-23 10:11:50 -07:00
four4fish c912ebf889
Remove TrainingTypePlugin.on_save and Accelerator.on_save (#9023)
* Remove TrainingTypePlugin.on_save and Accelerator.on_save
2021-08-23 10:11:00 -07:00
Kaushik B f3c5889aa3
FIx mypy for init_ddp_connection (#9051) 2021-08-23 15:46:15 +00:00
Adrian Wälchli 49c52b0d4b
update an outdated error message in DDPPlugin (#9005) 2021-08-23 15:29:07 +00:00
Adrian Wälchli 495812878d
governance updates in documentation (#9025)
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-08-23 20:12:05 +05:30
thomas chaton e9ce598f2b
1/n inter batch parallelism (#9020)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-23 13:12:25 +00:00
Ning 2481816490
Deprecate `prepare_data_per_node` flag on Trainer and set it as a property for DataHooks (#8958)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-08-23 12:43:45 +00:00
Kaushik B 0461107972
Move `init_ddp_connection` to distributed utilities (#9044)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-08-23 14:01:01 +05:30