Rohit Gupta
5b9995da04
Fix schedule reset logic in pytorch profiler ( #10837 )
2021-12-02 14:22:49 +05:30
four4fish
9beeabbced
Removed unnecessary `_move_optimizer_state` method overrides ( #10849 )
...
* Update tpu tp share same logic with ttp
* run test
* Update tpu_spawn.py
* debug
* Add changelog
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update training_type_plugin.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update training_type_plugin.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-12-02 05:03:30 +00:00
four4fish
45dd8066e7
3/n Move Accelerator into strategy - remove model_sharded_context() ( #10886 )
...
* 3/n Move Accelerator into strategy - remove model_sharded_context()
* update ttp function
* update changelog
* update changelog
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-12-02 03:34:51 +00:00
four4fish
44cd412e91
Remove precision_plugin pre_dispatch() method ( #10887 )
...
* Remove precision_plugin pre_dispatch() method
* update changelog
2021-12-01 18:42:17 -08:00
Carlos Mocholí
26977043bf
Add separate CI job for slow tests ( #10830 )
2021-12-01 19:58:18 +00:00
Adrian Wälchli
619ef7a665
Remove redundant None check from spawn plugins ( #10855 )
...
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-12-01 17:29:05 +00:00
Adrian Wälchli
3a8b3fcaab
Add missing deprecation rerouting for add_to_queue in TPUSpawnPlugin #10854
2021-12-01 15:46:32 +00:00
Carlos Mocholí
a7aed2af7a
[CLI] Add support for `ReduceLROnPlateau` ( #10860 )
2021-12-01 15:41:22 +00:00
Rafał Jankowski
c6478414ee
Fixed uploading best model checkpoint in NeptuneLogger ( #10369 )
2021-12-01 13:58:54 +00:00
Aka.Fido
72cc8b7ca9
Disable validation completely when `overfit_batches>0` ( #9709 )
...
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-12-01 13:57:57 +00:00
Adrian Wälchli
7514adf814
Remove `return_result` argument from `DDPSpawnPlugin.spawn()` ( #10867 )
2021-12-01 13:29:08 +00:00
Adrian Wälchli
e6cc99ef90
Fix selection of standalone tests ( #10857 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-12-01 09:48:37 +01:00
Kaushik B
ec0fb2fd95
Raise exception if rich is less than 10.2.2 ( #10839 )
2021-12-01 06:14:19 +00:00
Matteo Bortolon
f7c15f256c
Correct SLURM wrong import ( #10842 )
2021-12-01 01:24:06 +00:00
Andres Algaba
1a26af1519
Add job_name as a staticmethod in SLURMEnvironment class ( #10698 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-12-01 00:01:44 +00:00
Kaushik B
3c9488f62f
Update changelog after v1.5.4 release ( #10843 )
2021-11-30 23:26:25 +00:00
Mauricio Villegas
f3b0a06e90
Fix `SignalConnector._has_already_handler` check for callable type ( #10483 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-30 22:47:52 +00:00
Adrian Wälchli
25473acddb
Restore signals on teardown ( #10611 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-30 22:07:14 +00:00
Adrian Wälchli
c6b52ef3bd
Fix typing in `pl.overrides.distributed` ( #10797 )
...
* fix typing
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-30 21:22:05 +00:00
Rohit Gupta
f407a00cec
Update logging docs ( #10734 )
...
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-11-30 21:10:26 +00:00
Rohit Gupta
1437be5e98
Disable batch_size extraction for torchmetric instances ( #10815 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-30 20:47:05 +00:00
Adrian Wälchli
32e65220ee
Save and load with CheckpointIO in DDPSpawn plugins ( #10846 )
2021-11-30 20:31:23 +00:00
Carlos Mocholí
0061619e0a
Improve typing for loops ( #10780 )
2021-11-30 20:28:55 +00:00
Abhinav Arora
f63222d966
Remove references to torchtext.legacy from PyTorch Lightning ( #10724 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-30 19:32:07 +00:00
Carlos Mocholí
8e1b9b306c
Skip hanging spawn tests ( #10838 )
...
* Skip hanging spawn tests
* Docstring fix
* Add back to TPU spawn
2021-11-30 18:36:12 +00:00
Carlos Mocholí
38ed26ec5a
Do not require omegaconf to run tests ( #10832 )
2021-11-30 14:48:03 +00:00
Adrian Wälchli
a81accb2ad
Update LiteOptimizer signature after optimizer changes in TrainingTypePlugin ( #10708 )
2021-11-30 15:16:59 +01:00
Carlos Mocholí
1b43e43e9f
Minor changes in preparation for saving the loops state ( #10783 )
2021-11-30 19:37:04 +05:30
Adrian Wälchli
fc86c301e7
Fix typing in `pl.callbacks.timer` ( #10798 )
2021-11-30 14:54:08 +01:00
Carlos Mocholí
5d9df39b1c
Remove legacy configurations ( #10829 )
2021-11-30 13:35:55 +00:00
Carlos Mocholí
4710734f14
Improve `@RunIf` docs ( #10828 )
2021-11-30 14:21:38 +01:00
Ethan Harris
af4325046d
Update notebooks submodule ( #10827 )
2021-11-30 11:54:43 +00:00
Andres Algaba
e0474f8f0f
Add test for `job_id` ( #10774 )
2021-11-30 11:53:55 +01:00
four4fish
1d2878523a
2/n Move Precision Plugin into strategy - move optimizer related logics ( #10596 )
...
Co-authored-by: Danielle Pintz <38207072+daniellepintz@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-30 08:31:23 +00:00
Rohit Gupta
ce95891f6a
Update extensions doc ( #10778 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-29 20:38:23 +00:00
four4fish
8bf7f9cce7
1/n Move Accelerator into strategy - move batch_to_device to strategy ( #10649 )
...
* 1/n Integrate Device Specific Accelerator Logic with strategy - move batch_to_device to strategy
* add changelog
* add model is not none check
* Apply suggestions from code review
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update CHANGELOG.md
* Update test_datamodules.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update test_hooks.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update dp.py
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 12:11:21 -08:00
Rohit Gupta
753cc4dfad
Fix default logging levels for train step specific hooks ( #10756 )
2021-11-29 19:51:17 +00:00
Carlos Mocholí
088818fbc6
Do not sanity check on reload ( #10785 )
2021-11-29 16:23:01 +01:00
Jirka Borovec
e8659bd40e
update NGC ( #10770 )
2021-11-29 14:14:37 +00:00
Carlos Mocholí
d3b7492bd0
[CLI] Add support for `--key.help=class` ( #10767 )
2021-11-29 14:12:53 +00:00
Adrian Wälchli
24fc54f07b
Fix typing in `pl.overrides.fairscale` ( #10799 )
...
* update typing in fairscale
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 11:28:28 +00:00
Adrian Wälchli
bd3fb2e66e
Fix typing in `pl.core.mixins.hparams_mixin` ( #10800 )
...
* fix typing in hparams mixin
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* unused import
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 12:03:47 +01:00
Adrian Wälchli
97e52619ea
Fix typing in `pl.overrides.data_parallel` ( #10796 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 10:58:23 +01:00
Carlos Mocholí
724a92b065
Mark outputs as protected in the evaluation loops ( #10781 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-28 20:09:30 +00:00
Carlos Mocholí
e1bf54c944
Tune Conda CI timeout and other minor improvements ( #10769 )
2021-11-28 17:58:03 +00:00
Kaushik B
3f915aaaf9
Fix reference link to `s3fs` ( #10737 )
2021-11-28 17:25:03 +00:00
Kaushik B
4a341e5b24
Add remote filesystems to docs ( #10752 )
...
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-28 16:46:52 +00:00
Adrian Wälchli
49d09aa28b
Update changelog after 1.5.3 release ( #10744 )
2021-11-27 05:28:23 +00:00
Adrian Wälchli
c752060712
Consolidate state when retrieving sharded state dict in Lite ( #10746 )
...
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-11-27 04:54:45 +00:00
Adrian Wälchli
038c151b6e
Improve typing for plugins ( #10742 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-26 20:14:58 +00:00