ananthsub
|
4277845fa7
|
Add support for specifying process group backend to relevant distributed strategies (#11745)
|
2022-03-17 23:38:03 -07:00 |
|
edward-io
|
90a9da5abb
|
check trainerfn == FITTING before configuring sync_batchnorm (#11919)
Co-authored-by: edward-io <me@edward.io>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
|
2022-03-12 03:52:59 +00:00 |
|
Adrian Wälchli
|
d4d197070f
|
Add `SyncBatchNormPlugin` (#11754)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
|
2022-03-01 19:41:40 +05:30 |
|
four4fish
|
6e14209185
|
Rewrite accelerator_connector (#11448)
|
2022-02-17 23:38:39 +00:00 |
|
Rohit Gupta
|
25b505508d
|
Add process launchers (#11643)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
|
2022-02-17 21:16:51 +00:00 |
|
ananthsub
|
62ebd42ce0
|
Update ddp.py (#11929)
|
2022-02-16 17:29:07 -08:00 |
|
ananthsub
|
0ba25d3cac
|
Update DDPStrategy to use optimizers property from within class (#11777)
|
2022-02-07 13:28:37 +01:00 |
|
ananthsub
|
a64438c897
|
Centralize rank_zero_only utilities into their own module (#11747)
* Centralize rank_zero_only utilities into their own module
Fixes #11746
* PossibleUserWarning
* Update test_warnings.py
* update imports
* more imports
* Update CHANGELOG.md
* Update mlflow.py
* Update cli.py
* Update api_references.rst
* Update meta.py
* add deprecation tests
* debug standalone
* fix standalone tests
* Update CHANGELOG.md
|
2022-02-07 08:09:55 +00:00 |
|
Adrian Wälchli
|
cc43d07db1
|
Remove legacy dead code in DDP script launch (#11678)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
|
2022-02-05 11:40:16 +05:30 |
|
four4fish
|
d43fd0d4d6
|
Lazy initialize Strategy.parallel_devices (#11572)
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
|
2022-02-03 04:25:16 +00:00 |
|
ananthsub
|
f41d1e5e5e
|
Remove `Strategy.on_gpu` (#11537)
|
2022-01-19 21:27:12 +00:00 |
|
Carlos Mocholí
|
344ab1e0a5
|
Move the `lightning_optimizers` ownership to the `Strategy` (#11444)
|
2022-01-18 12:58:56 +01:00 |
|
edward-io
|
6107ce8e0d
|
Add DETAIL logs for batch use cases (#11008)
|
2022-01-12 01:22:48 +01:00 |
|
Kaushik B
|
93223ff5ce
|
Introduce StrategyRegistry (#11233)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
|
2022-01-05 17:14:18 +05:30 |
|
Danielle Pintz
|
a6a28e08d2
|
Deprecate `TrainerOptimizersMixin` and move functionality to `core/optimizer.py` (#11155)
|
2021-12-22 17:56:37 -08:00 |
|
Kaushik B
|
576a5d62a0
|
Introduce strategies directory for Training Strategies (#11226)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
|
2021-12-22 20:23:30 +00:00 |