Commit Graph

6339 Commits

Author SHA1 Message Date
Carlos Mocholí 5ac129e95a
Rename ttp -> strategy (#11312) 2022-01-05 12:12:25 +01:00
Carlos Mocholí 33c3490685
Fix min/max logging default value (#11310) 2022-01-05 11:42:03 +01:00
Kaushik B 5a89be6873
Update strategy registry docs (#11311) 2022-01-05 10:37:11 +00:00
Adrian Wälchli a8bd7ac73f
Fix lr scheduler state not being dumped to checkpoint in deepspeed strategy (#11307) 2022-01-05 08:38:08 +00:00
Rohit Gupta 7eab379da2
Raise a warning if evaulation is triggered with best ckpt in case of multiple checkpoint callbacks (#11274)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-01-04 17:22:32 +00:00
Kaushik B 650c710efa
Rename training plugin test files & names to strategy (#11303) 2022-01-04 14:32:45 +01:00
Carlos Mocholí a610e043d7
Add typing for utilities/enums.py (#11298) 2022-01-04 13:30:56 +01:00
Carlos Mocholí e9009d6058
Reset the total fit-validation batch progress on epoch (#11244) 2022-01-04 12:04:20 +01:00
Danielle Pintz 7fa1aebcc9
Remove `profile("training_step_and_backward")` (#11222) 2022-01-04 11:50:11 +01:00
Rohit Gupta 997da52f73
Update logic to make sure logged_metrics always contain tensors (#11270) 2022-01-04 10:32:44 +00:00
Rohit Gupta 98ea79b8b0
Add `opt_idx` to scheduler config if not assigned by user (#11247)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-01-04 14:57:15 +09:00
Ed Pizzi cf32127e7e
Avoid non-blocking GPU->CPU copies. (#11288)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-01-03 22:17:50 +00:00
pre-commit-ci[bot] 95c7e5f785
[pre-commit.ci] pre-commit suggestions (#11301) 2022-01-03 22:26:51 +01:00
Kaushik B 5a4df4ec7d
Update strategy import statements (#11238)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-01-03 15:54:46 +00:00
Adrian Wälchli 5d16970222
Merge pull request #11228 from PyTorchLightning/docs/strategies-code-owners
Update CODEOWNERS for pl/strategies
2022-01-03 09:17:38 -05:00
ananthsub 05ed9a201c
Group metrics generated by `DeviceStatsMonitor` for better visualization (#11254)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-01-03 13:26:17 +00:00
Adrian Wälchli 17cb3c70f7
Fix data fetcher selection (#11294) 2022-01-03 13:49:17 +01:00
Danielle Pintz b082715103
Remove `Strategy.optimizer_zero_grad` (#11246) 2022-01-03 13:46:57 +01:00
Adrian Wälchli 4eede7c30b
Add deprecation path for renamed training type plugins (#11227)
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-01-03 13:41:05 +01:00
jjenniferdai 4b5761539e
Remove `hpc_save` (#11101) 2022-01-03 12:23:13 +00:00
Aki Nitta 7637550ab5
Revert "[CI] Comment flaky tests (#10084)" (#10580)
* Revert "[CI] Comment flaky tests (#10084)"

This reverts commit ed9802643c.
2022-01-03 12:45:41 +01:00
Rohit Gupta 2ec0b133c4
Fix KFold example (#11230) 2022-01-03 09:54:44 +00:00
Adam Viola 1fc046cde2
Fix `_should_reload_dl_epoch` causing inconsistent validation dataloader reloading (#11036)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-28 02:20:57 +01:00
Danielle Pintz ca9b25db80
Remove `Strategy.init_optimizers` (#11236) 2021-12-23 18:48:21 +00:00
Danielle Pintz ba6a8ddcad
refactor _configure_schedulers (#11245) 2021-12-23 10:03:28 -08:00
Carlos Mocholí f44b209e72
Fix CLI race condition saving the config (#11199) 2021-12-23 16:45:06 +00:00
Carlos Mocholí 30236c837f
Reset the progress tracking state after sanity checking (#11218) 2021-12-23 16:36:03 +00:00
Kaushik B 0adcd6a048
Rename training_type_plugin file to strategy (#11239)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-23 14:01:23 +00:00
Adrian Wälchli c210e338ef
Update strategy import statements (#11231) 2021-12-23 08:26:28 +01:00
Carl Lemaire dedfde6859
Fix docs to fix #11081 (#11229) 2021-12-23 05:09:58 +01:00
Danielle Pintz a6a28e08d2
Deprecate `TrainerOptimizersMixin` and move functionality to `core/optimizer.py` (#11155) 2021-12-22 17:56:37 -08:00
four4fish 81301dbba7
Rename `AcceleratorConnector.training_type_plugin` to `AcceleratorConnector.strategy` (#11212)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-23 01:36:23 +00:00
twsl 0b9034baef
Return only unique names/versions for LoggerCollection (#10976)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-12-23 00:35:38 +00:00
Kaushik B 576a5d62a0
Introduce strategies directory for Training Strategies (#11226)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 20:23:30 +00:00
Carlos Mocholí 85304d4672
Update pre-commit hook versions (#11202) 2021-12-22 17:09:27 +00:00
Jirka Borovec 52f308eb89
Include Lezwon in alumni (#11223) 2021-12-23 01:05:43 +09:00
Carlos Mocholí eb5b350f9a
Remove explicit isinstance checks in strategies for checkpoint io (#11177)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 04:41:45 +00:00
Adrian Wälchli b6dd1a3878
Fix typing in `pl.callbacks.lr_monitor` (#10802)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-12-22 03:50:00 +00:00
Adrian Wälchli ba8e7cd787
Fix BF16 teardown for TPU precision plugin (#10990)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-12-22 03:47:14 +00:00
Adrian Wälchli 235efb37d7
Update changelog after 1.5.7 release (#11204)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2021-12-22 03:00:10 +00:00
four4fish cf5ef32f7b
Deprecate Trainer.training_type_plugin in favor of trainer.strategy (#11141)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 02:11:43 +00:00
Adrian Wälchli 17ad1a4c00
Rename `ParallelPlugin` to `ParallelStrategy` (#11123) 2021-12-22 01:09:17 +00:00
four4fish 4bfe5bda0f
Rename the DDPSpawnShardedPlugin to DDPSpawnShardeedStrategy (#11210)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 00:27:36 +00:00
Aki Nitta 28ce9105e4
Rename `SingleDevicePlugin` to `SingleDeviceStrategy` (#11181)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-21 23:56:14 +00:00
four4fish f98cd78e9e
Renamed the `DDPSpawnPlugin` to `DDPSpawnStrategy` (#11145) 2021-12-21 23:06:14 +00:00
four4fish 0c69c757d4
Rename the `DataParallelPlugin` to `DataParallelStrategy` (#11183) 2021-12-21 22:00:24 +00:00
Aki Nitta c3cd4d050f
Rename `SingleTPUPlugin` to `SingleTPUStrategy` (#11182) 2021-12-21 20:09:30 +00:00
four4fish 1c5a5c3dfe
Renamed the DDP2Plugin to DDP2Strategy (#11185)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-21 19:21:00 +00:00
Carlos Mocholí b2c3d01b3e
Fix master import conflict (#11203) 2021-12-21 18:47:56 +00:00
Danielle Pintz ac8dc2c2f3
Deprecate `TrainerCallbackHookMixin` (#11148) 2021-12-21 09:47:08 -08:00