Danielle Pintz
0e68734ddd
Make default logger name "lightning_logs" ( #11762 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-02-10 15:19:18 +05:30
ananthsub
1b107c5892
Add `Accelerator.is_available()` interface requirement ( #11797 )
2022-02-09 15:11:27 -08:00
Adrian Wälchli
c618e59689
Fix `save_hyperparameters` when no parameters need saving ( #11827 )
2022-02-09 23:10:14 +00:00
Akash Kwatra
a2d8c4f6a6
Create loggers property for Trainer and LightningModule ( #11683 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Danielle Pintz <38207072+daniellepintz@users.noreply.github.com>
2022-02-09 23:39:41 +01:00
Boris Dayma
1e36cffbca
feat(wandb): support distributed modes ( #11650 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-02-09 19:53:21 +01:00
Carlos Mocholí
8394770d4a
Move data fetcher ownership to the loops ( #11621 )
2022-02-09 20:04:24 +05:30
Jv Kyle Eclarin
b34d8673a9
Update `tests/trainer/*.py` to use `devices` instead of `gpus` or `ipus` ( #11697 )
2022-02-09 09:40:22 +00:00
Carlos Mocholí
8822117200
Return the output of the optimizer step ( #11711 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-02-09 09:37:13 +00:00
Danielle Pintz
9e63281a4c
remove todos ( #11804 )
2022-02-09 08:30:27 +00:00
Rohit Gupta
182c18d319
Configure native deepspeed schedulers with interval='step' ( #11788 )
2022-02-09 08:20:50 +00:00
Danielle Pintz
32e7d32956
Delete `test_on_before_accelerator_backend_setup` ( #11803 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-08 09:36:37 +00:00
jjenniferdai
1203094a20
Introduce `Stateful` DataModule ( #11637 )
2022-02-07 21:13:24 +01:00
Rohit Gupta
9ed44dee0d
Fix to avoid moving batch to device for DataParallel ( #11780 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2022-02-07 14:26:18 +00:00
Rohit Gupta
581bf7f2f2
Deprecate `on_epoch_start/on_epoch_end` hook ( #11578 )
2022-02-07 14:15:27 +00:00
Rohit Gupta
7ec1e66e17
reduce only loss with dp ( #11594 )
...
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-02-07 17:00:29 +05:30
Krishna Kalyan
f509e40ae3
Deprecate `on_before_accelerator_backend_setup` callback hook ( #11655 )
...
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2022-02-07 11:07:21 +00:00
ananthsub
a64438c897
Centralize rank_zero_only utilities into their own module ( #11747 )
...
* Centralize rank_zero_only utilities into their own module
Fixes #11746
* PossibleUserWarning
* Update test_warnings.py
* update imports
* more imports
* Update CHANGELOG.md
* Update mlflow.py
* Update cli.py
* Update api_references.rst
* Update meta.py
* add deprecation tests
* debug standalone
* fix standalone tests
* Update CHANGELOG.md
2022-02-07 08:09:55 +00:00
Danielle Pintz
34c454c756
Small improvements to TB and CSV loggers ( #11764 )
...
* small improvements to TB and CSV loggers
* addr comments
* remove redundant lines and update tests
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
2022-02-07 14:59:39 +09:00
Dan Dale
3bc2407239
Allow access to ckpt_path within context of fit() ( #11696 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-05 05:23:16 +01:00
Carlos Mocholí
7da931d1ca
Support no pre-fetching ( #11606 )
2022-02-05 03:59:46 +00:00
Danielle Pintz
c71a1d7ea2
Remove `self._log_dir` from `BaseProfiler` ( #11740 )
2022-02-05 04:45:48 +01:00
Andres Algaba
58324b5197
Improve the result printing at the end of evaluation ( #11332 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-02-05 03:03:22 +01:00
NathanGodey
8a1b1eeef8
WandbLogger's log_image can use step argument ( #11716 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-05 01:02:41 +00:00
wangraying
8c07d8bf90
Add `Trainer(strategy="bagua")` ( #11146 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2022-02-04 17:02:09 +00:00
Rohit Gupta
4d72110b51
Deprecate `on_batch_start/on_batch_end` callback hooks ( #11577 )
2022-02-03 19:51:56 +00:00
Rohit Gupta
400201712f
added warning for distributedsampler in case of evaluation ( #11479 )
2022-02-03 18:42:13 +00:00
Jv Kyle Eclarin
a34930b772
Update `tests/tuner/*.py` to use `devices` instead of `gpus` or `ipus` ( #11520 )
...
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-02-03 20:58:13 +05:30
Rohit Gupta
01abe72278
Fix to avoid val progress bar disappear after validate ( #11700 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-03 13:35:38 +00:00
Rohit Gupta
e9065e9d42
Fix rich with uneven refresh rate tracking ( #11668 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-03 10:27:05 +00:00
Rohit Gupta
7948ed703d
Avoid enforcing `shuffle=False` for eval dataloaders ( #11575 )
2022-02-03 09:35:31 +00:00
Danielle Pintz
9ebd7df22a
Move progress bar disabling out of the Trainer ( #11377 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-02-03 06:29:32 +00:00
Rohit Gupta
0cb64fb8ba
Fix mid-epoch warning call while resuming ( #11556 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-02-03 05:42:31 +00:00
Rohit Gupta
eceefdc602
Fix rich progress bar render only on main pbar ( #11690 )
2022-02-03 04:18:07 +00:00
Krishna Kalyan
6291af5c19
Replace occurrences of `on_before_accelerator_backend_setup_called` with `setup` ( #11568 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-03 04:14:33 +00:00
Anton Schwaighofer
f935319622
Allow a `CombinedLoader` as the training data in DDP ( #11648 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-02-03 04:01:20 +00:00
Carlos Mocholí
3d3172d3da
[CLI] Support shorthand for loggers ( #11533 )
2022-02-03 02:58:14 +00:00
Piyush Hirapara
72f0e5bfae
Deprecate `on_configure_sharded_model` callback hook for v1.6 ( #11627 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Danielle Pintz <38207072+daniellepintz@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-02-03 02:29:26 +00:00
Krishna Kalyan
6586dd23b7
Mark `CheckpointConnector` as protected ( #11550 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-03 02:26:08 +00:00
DuYicong515
06e2635c71
Refactor get_filesystem to use native fsspec API ( #11708 )
2022-02-03 01:55:24 +00:00
Rohit Gupta
ee049e123d
Fix rich progress bar metric render on epoch end ( #11689 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-02-03 01:43:48 +00:00
jjenniferdai
ec1379da2c
Rename `_SupportsStateDict` --> `_Stateful` Protocol ( #11469 )
2022-02-02 23:45:59 +01:00
Carlos Mocholí
b8e360dafa
[CLI] Fix bug that forces overriding `configure_optimizers` ( #11672 )
2022-02-02 22:44:00 +00:00
Rohit Gupta
e76e1e7018
update no_warning_call utility in tests ( #11557 )
2022-02-02 22:43:13 +00:00
Akash Kwatra
115a5d08e8
Decouple utilities from `LightningLoggerBase` ( #11484 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-02-02 23:29:01 +01:00
Nithin Rao
b8d2c65a37
Set the state before saving "last" or "none" checkpoints ( #11481 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-02 23:07:05 +01:00
Rohit Gupta
3eee8f18cf
Sort simple profiler summary based on mean duration ( #11671 )
2022-02-02 20:44:42 +00:00
Rohit Gupta
76175217e4
Fix val_loop run on restart ( #11552 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-02 20:19:34 +00:00
Carlos Mocholí
a44881cd90
Changes in preparation to #8578 ( #11562 )
2022-02-02 19:57:08 +00:00
Chunyang Wen
350c88e621
Let Accelerator inherit from ABC to make sure abstractmethod takes effect ( #11521 )
2022-01-23 20:47:43 +01:00
zzj
76c23f34b8
Update test_fetching.py ( #11551 )
2022-01-21 20:30:13 +01:00