Commit Graph

5984 Commits

Author SHA1 Message Date
Adrian Wälchli 3664659094
Remove deprecated method `ClusterEnvironment.creates_children` (#10339)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-04 17:11:32 +00:00
Peter Dudfield ce3e63262a
Fix failure when `DataLoader(batch_size=None)` is passed (#10345)
* add test, + add change to data loading batch sample method

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Refactor and CHANGELOG

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-04 12:46:57 +01:00
Sean Naren a255dcb421
Update bfloat16 docs (#10330) 2021-11-04 10:29:19 +00:00
puhuk 412f0a4d24
Remove deprecated dataloader arguments in Trainer methods (#10325)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-04 11:03:39 +01:00
Connor Anderson 6f00ba21c2
Remove deprecated `loaded_optimizer_states_dict` property (#10346)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-04 01:51:46 +01:00
Carlos Mocholí ba23d91320
Update recommendation on `dataloader_idx` (#10318) 2021-11-04 01:39:55 +01:00
Carlos Mocholí 72aab583ae
Update issue template ads (#10310) 2021-11-04 00:32:58 +01:00
Danielle Pintz c5d011c3cf
Remove `TrainerModelHooksMixin` (#10322)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-03 20:26:59 +00:00
Adrian Wälchli fff491dd4d
add minimum codeowners for lite (#10298) 2021-11-03 11:47:35 -04:00
Adrian Wälchli c32e9a783a
Update dev branch to continue with 1.6 (#10332)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-03 14:07:55 +00:00
Adrian Wälchli b3db1b6e9c
Update signature of `LightningModule.training_step_end` (#10094)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-03 13:38:08 +00:00
Carlos Mocholí 93caa7cda9
Fix `apply_to_collection(defaultdict)` (#10316) 2021-11-03 11:18:10 +00:00
Kaushik B 4cd7e77ad2
Add note for PyCharm users on configuration for RichProgressBar (#10307) 2021-11-03 03:06:18 +05:30
Jirka Borovec 72288b2b32
update ref to 1.5 as stable (#10311)
* update ref to 1.5 as stable

* Fix CHANGELOG

Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-02 13:43:54 -04:00
Adrian Wälchli 073b735279
Lightning 1.5 release (#10306)
* update changelog

* update version in about

* update references to 1.5 in readme

Co-authored-by: thomas chaton <thomas@grid.ai>
2021-11-02 13:24:28 -04:00
Ning f6ed0bd8ca
introduce has_len_all_ranks() to check the length of dataloader across ranks (#9827)
* introduce , udpate tests

* update CHANGELOG.md

* change staticmethod and hook attribute naming

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix typo

* remove non-essential comment

* fix merge error and comment format

* try to fix test_tpu.py failure

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update on comments

* chlog

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* chlog

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* try fix

* Revert back TPUSpawn changes

* Update test

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
2021-11-02 13:22:58 -04:00
Kaushik B 34fcb87a2b
Add `leave` argument to RichProgressBar (#10301)
* Add display_every_n_epochs argument to RichProgressBar

* Add tests

* Update test

* Update test

* Update changelog

* use leave argument instead

* Update pytorch_lightning/callbacks/progress/rich_progress.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-02 13:20:52 -04:00
thomas chaton 9e844d9db6
Lite Docs and Example Improvements (#10303)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-02 16:13:01 +01:00
Sean Naren 1686aab550
Only enable pulse for infinite datasets (#10305) 2021-11-02 12:01:02 +00:00
Adrian Wälchli 373c32e34b
Fix yielding from iterator in LiteDataLoader (#10304)
* fix yielding form iterator

* update description

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unused code

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-02 11:40:35 +01:00
Rohit Gupta f44b8a7aab
protect ByteCounter (#10300) 2021-11-02 08:35:40 +00:00
Adrian Wälchli 3cd65b592b
Lightning Lite Examples (#9987)
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: four4fish <88516121+four4fish@users.noreply.github.com>
Co-authored-by: Nicki Skafte Detlefsen <skaftenicki@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Pietro Lesci <61748653+pietrolesci@users.noreply.github.com>
2021-11-02 08:04:29 +00:00
Rohit Gupta e4ee6df196
Add warning if multiple batch_sizes are found from ambiguous batch (#10247) 2021-11-01 19:50:30 +00:00
four4fish d56e041635
Update init_ddp_connection's name and log (#10295) 2021-11-01 19:11:15 +00:00
Kaushik B 1127b28bbf
Update docs for devices flag (#10293)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-01 18:39:00 +00:00
Kaushik B 10edc6de6b
Add missing deprecation notes for deprecated Trainer flags (#10296) 2021-11-01 18:38:41 +00:00
victorjoos cc0e9f96a8
Add support for empty `gpus` list to run on CPU (#10246)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2021-11-01 18:37:38 +00:00
thomas chaton facaff94b8
Add custom dataloader support with Lite (#10279) 2021-11-01 18:33:13 +00:00
Mauricio Villegas 828b5315aa
Allow separate config files for parameters with class type when LightningCLI is in subclass_mode=False (#10286) 2021-11-01 17:24:31 +00:00
Kaushik B c52d7ba73d
Add `configure_columns` method to RichProgressBar (#10288)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-01 17:22:53 +00:00
I-iBot 6fd6283e07
update outdated links in examples (#10127)
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-01 17:05:08 +00:00
Kaushik B f5609be40a
Remove unnecessary NotImplementedError used in Training Type Plugin (#10235)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-01 16:53:46 +00:00
Rohit Gupta b77aa718de
Changed the model size calculation using `ByteCounter` (#10123) 2021-11-01 16:42:14 +00:00
Aki Nitta 7ad0ac5509
Exclude docs/ from default pytest dirs (#10078)
Co-authored-by: tchaton <thomas@grid.ai>
2021-11-01 16:30:23 +00:00
Adrian Wälchli 2a331dd842
add mypy ci check for Lite (#10289) 2021-11-01 14:57:58 +00:00
Rohit Gupta 6609b2e46f
enable `on_load_checkpoint` for `datamodule` for all `trainer_fn` (#10238) 2021-11-01 14:20:46 +00:00
Kaushik B 45c45dc7b0
Deprecate `ProgressBar` and rename it to `TQDMProgressBar` (#10134)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-01 11:42:21 +00:00
Jirka Borovec edea0d4bc3
switch azure pool (#10266) 2021-11-01 11:42:11 +00:00
Kaushik B 2ee6d9fbc7
Fix `distrib_type` not being set when Plugin instances being passed to Trainer (#10251) 2021-11-01 17:11:57 +05:30
Rohit Gupta a1fe5ba0aa
attach model parallelism video inside docs (#10274) 2021-11-01 11:17:51 +00:00
Rohit Gupta 49dd787a3f
Remove `reinit_schedulers_properties` (#10271) 2021-11-01 11:05:29 +00:00
Adrian Wälchli ee15a0ba70
Changelog fixes for Lightning 1.5 release (#10281) 2021-11-01 10:43:43 +00:00
Tobias Fischer 305a42c32e
Link to arxiv summary instead of pdf in pruning docs (#10282) 2021-11-01 14:02:11 +05:30
Danielle Pintz cb8a2165a3
Remove `debugging_connector.py` (#10113) 2021-10-30 22:53:45 +00:00
Carlos Mocholí 2b24be2e45
Simplify `LightningOptimizer` (#10224) 2021-10-30 15:56:15 +00:00
Kaushik B e0f7dbdd1c
Add support for `devices='auto'` (#10264) 2021-10-30 15:05:51 +00:00
Carlos Mocholí 9237106451
Clip before step (#10248) 2021-10-30 11:27:49 +01:00
Adrian Wälchli d33429c1e2
Lightning Lite docs (#10176) 2021-10-30 10:25:52 +00:00
Adrian Wälchli 9d136a9fc5
Lightning Lite core and tests (#10175) 2021-10-29 21:46:39 +00:00
Adrian Wälchli b4f43b1695
Update docs for sync_dist logging option (#10186)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-10-29 20:44:23 +00:00