Commit Graph

6174 Commits

Author SHA1 Message Date
Rohit Gupta 5b9995da04
Fix schedule reset logic in pytorch profiler (#10837) 2021-12-02 14:22:49 +05:30
four4fish 9beeabbced
Removed unnecessary `_move_optimizer_state` method overrides (#10849)
* Update tpu tp share same logic with ttp

* run test

* Update tpu_spawn.py

* debug

* Add changelog

* Apply suggestions from code review

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update training_type_plugin.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update training_type_plugin.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-12-02 05:03:30 +00:00
four4fish 45dd8066e7
3/n Move Accelerator into strategy - remove model_sharded_context() (#10886)
* 3/n Move Accelerator into strategy - remove model_sharded_context()

* update ttp function

* update changelog

* update changelog

Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-12-02 03:34:51 +00:00
four4fish 44cd412e91
Remove precision_plugin pre_dispatch() method (#10887)
* Remove precision_plugin pre_dispatch() method

* update changelog
2021-12-01 18:42:17 -08:00
Carlos Mocholí 26977043bf
Add separate CI job for slow tests (#10830) 2021-12-01 19:58:18 +00:00
Adrian Wälchli 619ef7a665
Remove redundant None check from spawn plugins (#10855)
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-12-01 17:29:05 +00:00
Adrian Wälchli 3a8b3fcaab
Add missing deprecation rerouting for add_to_queue in TPUSpawnPlugin #10854 2021-12-01 15:46:32 +00:00
Carlos Mocholí a7aed2af7a
[CLI] Add support for `ReduceLROnPlateau` (#10860) 2021-12-01 15:41:22 +00:00
Rafał Jankowski c6478414ee
Fixed uploading best model checkpoint in NeptuneLogger (#10369) 2021-12-01 13:58:54 +00:00
Aka.Fido 72cc8b7ca9
Disable validation completely when `overfit_batches>0` (#9709)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-12-01 13:57:57 +00:00
Adrian Wälchli 7514adf814
Remove `return_result` argument from `DDPSpawnPlugin.spawn()` (#10867) 2021-12-01 13:29:08 +00:00
Adrian Wälchli e6cc99ef90
Fix selection of standalone tests (#10857)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-12-01 09:48:37 +01:00
Kaushik B ec0fb2fd95
Raise exception if rich is less than 10.2.2 (#10839) 2021-12-01 06:14:19 +00:00
Matteo Bortolon f7c15f256c
Correct SLURM wrong import (#10842) 2021-12-01 01:24:06 +00:00
Andres Algaba 1a26af1519
Add job_name as a staticmethod in SLURMEnvironment class (#10698)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-12-01 00:01:44 +00:00
Kaushik B 3c9488f62f
Update changelog after v1.5.4 release (#10843) 2021-11-30 23:26:25 +00:00
Mauricio Villegas f3b0a06e90
Fix `SignalConnector._has_already_handler` check for callable type (#10483)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-30 22:47:52 +00:00
Adrian Wälchli 25473acddb
Restore signals on teardown (#10611)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-30 22:07:14 +00:00
Adrian Wälchli c6b52ef3bd
Fix typing in `pl.overrides.distributed` (#10797)
* fix typing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-30 21:22:05 +00:00
Rohit Gupta f407a00cec
Update logging docs (#10734)
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-11-30 21:10:26 +00:00
Rohit Gupta 1437be5e98
Disable batch_size extraction for torchmetric instances (#10815)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-30 20:47:05 +00:00
Adrian Wälchli 32e65220ee
Save and load with CheckpointIO in DDPSpawn plugins (#10846) 2021-11-30 20:31:23 +00:00
Carlos Mocholí 0061619e0a
Improve typing for loops (#10780) 2021-11-30 20:28:55 +00:00
Abhinav Arora f63222d966
Remove references to torchtext.legacy from PyTorch Lightning (#10724)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-30 19:32:07 +00:00
Carlos Mocholí 8e1b9b306c
Skip hanging spawn tests (#10838)
* Skip hanging spawn tests

* Docstring fix

* Add back to TPU spawn
2021-11-30 18:36:12 +00:00
Carlos Mocholí 38ed26ec5a
Do not require omegaconf to run tests (#10832) 2021-11-30 14:48:03 +00:00
Adrian Wälchli a81accb2ad
Update LiteOptimizer signature after optimizer changes in TrainingTypePlugin (#10708) 2021-11-30 15:16:59 +01:00
Carlos Mocholí 1b43e43e9f
Minor changes in preparation for saving the loops state (#10783) 2021-11-30 19:37:04 +05:30
Adrian Wälchli fc86c301e7
Fix typing in `pl.callbacks.timer` (#10798) 2021-11-30 14:54:08 +01:00
Carlos Mocholí 5d9df39b1c
Remove legacy configurations (#10829) 2021-11-30 13:35:55 +00:00
Carlos Mocholí 4710734f14
Improve `@RunIf` docs (#10828) 2021-11-30 14:21:38 +01:00
Ethan Harris af4325046d
Update notebooks submodule (#10827) 2021-11-30 11:54:43 +00:00
Andres Algaba e0474f8f0f
Add test for `job_id` (#10774) 2021-11-30 11:53:55 +01:00
four4fish 1d2878523a
2/n Move Precision Plugin into strategy - move optimizer related logics (#10596)
Co-authored-by: Danielle Pintz <38207072+daniellepintz@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-30 08:31:23 +00:00
Rohit Gupta ce95891f6a
Update extensions doc (#10778)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-29 20:38:23 +00:00
four4fish 8bf7f9cce7
1/n Move Accelerator into strategy - move batch_to_device to strategy (#10649)
* 1/n Integrate Device Specific Accelerator Logic with strategy - move batch_to_device to strategy

* add changelog

* add model is not none check

* Apply suggestions from code review

Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update CHANGELOG.md

* Update test_datamodules.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update test_hooks.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update dp.py

Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 12:11:21 -08:00
Rohit Gupta 753cc4dfad
Fix default logging levels for train step specific hooks (#10756) 2021-11-29 19:51:17 +00:00
Carlos Mocholí 088818fbc6
Do not sanity check on reload (#10785) 2021-11-29 16:23:01 +01:00
Jirka Borovec e8659bd40e
update NGC (#10770) 2021-11-29 14:14:37 +00:00
Carlos Mocholí d3b7492bd0
[CLI] Add support for `--key.help=class` (#10767) 2021-11-29 14:12:53 +00:00
Adrian Wälchli 24fc54f07b
Fix typing in `pl.overrides.fairscale` (#10799)
* update typing in fairscale

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 11:28:28 +00:00
Adrian Wälchli bd3fb2e66e
Fix typing in `pl.core.mixins.hparams_mixin` (#10800)
* fix typing in hparams mixin

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* unused import

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 12:03:47 +01:00
Adrian Wälchli 97e52619ea
Fix typing in `pl.overrides.data_parallel` (#10796)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 10:58:23 +01:00
Carlos Mocholí 724a92b065
Mark outputs as protected in the evaluation loops (#10781)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-28 20:09:30 +00:00
Carlos Mocholí e1bf54c944
Tune Conda CI timeout and other minor improvements (#10769) 2021-11-28 17:58:03 +00:00
Kaushik B 3f915aaaf9
Fix reference link to `s3fs` (#10737) 2021-11-28 17:25:03 +00:00
Kaushik B 4a341e5b24
Add remote filesystems to docs (#10752)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-28 16:46:52 +00:00
Adrian Wälchli 49d09aa28b
Update changelog after 1.5.3 release (#10744) 2021-11-27 05:28:23 +00:00
Adrian Wälchli c752060712
Consolidate state when retrieving sharded state dict in Lite (#10746)
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-11-27 04:54:45 +00:00
Adrian Wälchli 038c151b6e
Improve typing for plugins (#10742)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-26 20:14:58 +00:00