Commit Graph

4059 Commits

Author SHA1 Message Date
Carlos Mocholí 8fa156948a
Add `LightningCLI(auto_registry)` (#12108) 2022-03-08 12:26:10 -05:00
jjenniferdai f3253070c4
Deprecate `LightningDataModule.on_save/load_checkpoint` (#11893) 2022-03-07 18:21:46 -08:00
Carlos Mocholí aea96e45a4
Integrate global step with progress tracking (#11805) 2022-03-07 19:21:37 +00:00
Rohit Gupta fc499bf56f
Disable tuner with distributed strategies (#12179)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-03-07 08:45:07 +00:00
ananthsub 5df519572f
Remove accelerator hooks from being called in `call_hook` (#12237) 2022-03-06 11:35:35 +05:30
Kaushik B a14783ea8c
Add Strategy page to docs (#11441)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-03-06 00:37:48 +00:00
ftorres16 a690fb5167
Remove "Optional" hint from non-None arguments (#12214) 2022-03-05 19:20:04 +00:00
whokilleddb 8b7a12c52e
Replace `eval()` with `ast.literal_eval()` for security (#12212)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-03-05 18:38:16 +00:00
four4fish 91052dc6d5
Move ipu precision flag check to IPUPrecisionPlugin init (#12148) 2022-03-05 09:03:24 +00:00
ananthsub b5fe056765
Update configuration_validator.py (#12123) 2022-03-04 22:19:58 -08:00
ananthsub 9c3d6b8fc7
Deprecate `LightningModule.on_pretrain_routine_{start/end}` (#12122) 2022-03-04 22:17:08 -08:00
Akash Kwatra eff67d7a02
Deprecate `AbstractProfiler` in favor of `BaseProfiler` (#12106) 2022-03-05 02:35:57 +00:00
Danielle Pintz 0b682b807a
Mark `logger_connector` as protected (#12195) 2022-03-05 02:33:42 +00:00
Ethan Harris ac735db0a0
Remove `data_pipeline` attribute patch (#12204) 2022-03-04 23:09:37 +00:00
Akash Kwatra 1f7298d326
Deprecate `LoggerCollection` in favor of `trainer.loggers` (#12147)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-03-04 23:01:43 +00:00
jjenniferdai 5d2a3eab69
add `state_dict`/`load_state_dict` to base `Callback` (#11998) 2022-03-04 02:41:48 +00:00
four4fish 15364c18c8
Check `parallel_devices` passed through `strategy` is consistent with the `accelerator` flag (#12105) 2022-03-03 10:30:24 -08:00
Rohit Gupta 15181fce6c
Rename some doc files (#12163) 2022-03-03 10:19:05 +00:00
jjenniferdai d923dff627
Deprecate `PrecisionPlugin.on_save/load_checkpoint` (#11978) 2022-03-02 10:14:55 -08:00
jjenniferdai 89d37569d8
add `accelerator.is_available()` check (#12104)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
2022-03-02 10:07:49 +00:00
Danielle Pintz 5da065e287
Remove `is_global_zero` check in `training_epoch_loop` (#12134) 2022-03-02 02:05:14 +00:00
Adrian Wälchli 0e24140fe4
Improve mechanism to reset the seed after sanity check (#11870)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-03-01 23:27:30 +00:00
Adrian Wälchli d4d197070f
Add `SyncBatchNormPlugin` (#11754)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-03-01 19:41:40 +05:30
Danielle Pintz 0fe3379fa4
Deprecate `weights_save_path` from the Trainer constructor (#12084)
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-02-28 22:45:26 +00:00
Carlos Mocholí 6309a59c3c
Do not prefetch when possible (#12101) 2022-02-28 18:31:18 +00:00
Kushashwa Ravi Shrimali 02ccd874b9
Stop loading a few properties if checkpoint's `dirpath` has changed (#12045)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-28 16:42:09 +00:00
Kaushik B a52a6ea030
Add support for pluggable Accelerators (#12030)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-28 21:36:23 +05:30
Carlos Mocholí a9024ce870
[CLI] Fix `SaveConfigCallback` with DDP spawn (#12011) 2022-02-28 13:27:42 +00:00
Cai Q.T 01c31ae434
Fix `LightningModule.{un,}toggle_model` when only 1 optimizer is used (#12088)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-28 12:41:51 +00:00
Rohit Gupta 17bb815d01
Add `estimated_stepping_batches` property to `Trainer` (#11599) 2022-02-28 12:40:48 +00:00
Rohit Gupta 5b342f14a6
fix to avoid common hook warning if no hook is overridden (#12131) 2022-02-28 18:07:05 +05:30
Carlos Mocholí db1c709519
Clean loop fetching usage (#12103) 2022-02-28 10:51:33 +00:00
Mauricio Villegas 54b9a85227
Unit test for CLI with subcommands and a common default config file (#12061)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-28 10:17:49 +00:00
DuYicong515 c9af112801
Remove `AcceleratorConnector.num_nodes` (#12107)
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-02-28 09:53:38 +00:00
Carlos Mocholí 8fd17f2edf
[IPU] Support manually instantiating the `poptorch.DataLoader` (#12116) 2022-02-28 09:36:26 +00:00
DuYicong515 b29b07e978
Remove AcceleratorConnector.use_dp (#12112) 2022-02-27 15:03:35 +00:00
DuYicong515 0b677ecf2b
Remove `AcceleratorConnector.has_tpu` (#12109) 2022-02-27 14:16:03 +00:00
DuYicong515 b2932337bc
Remove `AcceleratorConnector.has_ipu` (#12111)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-02-27 13:36:36 +00:00
DuYicong515 c379c93f19
remove AcceleratorConnector.use_ipu (#12110) 2022-02-27 13:57:23 +01:00
Akash Kwatra 7e2f9fbad5
Refactor codebase to use `trainer.loggers` over `trainer.logger` when needed (#11920) 2022-02-25 16:01:04 -08:00
ananthsub 244f365fae
Return early in `reset_seed` (#11983) 2022-02-26 00:58:27 +01:00
Akash Kwatra f5304897ce
Deprecate `BaseProfiler.profile_iterable` (#12102) 2022-02-25 16:26:20 +01:00
Carlos Mocholí 61dd5e4d5e
[IPU] Do not use `DistributedSampler` (#12114) 2022-02-25 14:29:51 +00:00
DuYicong515 6fcfd8ce91
Remove `AccleratorConnector.device_type` (#12081)
* remove AccleratorConnector.device_type

* Update CHANGELOG.md

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-25 11:01:47 +01:00
Rohit Gupta 5d2d9b09df
Avoid patching common `DataHooks` to the `LightningModule` (#10603) 2022-02-25 09:26:59 +01:00
Krishna Kalyan 29d5afbda6
Deprecate callback hooks `on_pretrain_routine_{start,end}` (#11794)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2022-02-24 19:32:48 +00:00
Kushashwa Ravi Shrimali 00211c1de3
Default `benchmark` based on `deterministic` flag (#11944)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-02-24 19:06:03 +00:00
ananthsub 5d040e7fc6
Add support for `dataloader_iter` to validate and test steps (#11546)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-24 18:01:35 +00:00
Jan Stratil c877d54c04
Fix passing _ddp_params_and_buffers_to_ignore (#11949) 2022-02-24 17:22:48 +00:00
Rohit Gupta d9938da8a4
add properties to check for trainer state in pytorch profier (#12063) 2022-02-24 17:03:16 +05:30