Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,022 Commits 59 Branches 217 Tags 353 MiB
Commit Graph

601 Commits

Author SHA1 Message Date
Carlos Mocholí edbf27430d
Remove deprecated `self.log` arguments (#10423) 2021-11-09 15:49:55 +01:00
Alexandre Mayerowitz b3c0f121ca
Remove deprecated datamodule lifecycle properties (#10350) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-11-05 05:03:57 +00:00
Connor Anderson 6f00ba21c2
Remove deprecated `loaded_optimizer_states_dict` property (#10346) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-11-04 01:51:46 +01:00
Carlos Mocholí ba23d91320
Update recommendation on `dataloader_idx` (#10318) 2021-11-04 01:39:55 +01:00
Adrian Wälchli b3db1b6e9c
Update signature of `LightningModule.training_step_end` (#10094) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-11-03 13:38:08 +00:00
Ning f6ed0bd8ca
introduce has_len_all_ranks() to check the length of dataloader across ranks (#9827) 
* introduce , udpate tests

* update CHANGELOG.md

* change staticmethod and hook attribute naming

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix typo

* remove non-essential comment

* fix merge error and comment format

* try to fix test_tpu.py failure

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update on comments

* chlog

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* chlog

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* try fix

* Revert back TPUSpawn changes

* Update test

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
 2021-11-02 13:22:58 -04:00
Rohit Gupta b77aa718de
Changed the model size calculation using `ByteCounter` (#10123) 2021-11-01 16:42:14 +00:00
Carlos Mocholí 2b24be2e45
Simplify `LightningOptimizer` (#10224) 2021-10-30 15:56:15 +00:00
Carlos Mocholí 9237106451
Clip before step (#10248) 2021-10-30 11:27:49 +01:00
Adrian Wälchli b4f43b1695
Update docs for sync_dist logging option (#10186) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-10-29 20:44:23 +00:00
Ning dbfadedfe7
Revert "Add support for `len(datamodule)` (#9895)" (#10072) 
This reverts commit 6429de8944.
 2021-10-29 13:33:51 +02:00
Carlos Mocholí dbe1662dc3
Replace `_TORCH_GREATER_EQUAL_DEV_1_10` with `_TORCH_GREATER_EQUAL_1_10` (#10157) 2021-10-27 13:38:39 +01:00
Carlos Mocholí 48b6292cf0
Move optimizer step and clipping into the `PrecisionPlugin` (#10143) 2021-10-26 17:26:26 +02:00
Rajat Goel 47e7a2860f
Fix Enums parsing in generated hparms yaml (#9170) 
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-25 21:23:20 +00:00
Carlos Mocholí 43c70ece17
Fix `optimizers` overloads typing annotation (#10069) 2021-10-25 16:51:46 +00:00
Carlos Mocholí b376799430
Minor fixes related to clipping (#10130) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-25 16:40:22 +00:00
Kaushik B c3614f1c07
Fix: skip importing DistributedOptimizer for Windows (#10071) 2021-10-21 21:01:56 +00:00
Carlos Mocholí 6aeebf1bd3
Remove unnecessary dependency available checks (#10050) 2021-10-20 16:21:37 +00:00
Carlos Mocholí ef5a12212a
Isolate optimizer step logic to the `PrecisionPlugin` (#10029) 2021-10-20 15:43:08 +00:00
Kaushik B 56bc55db71
Update strategy flag in docs (#10000) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-10-20 21:02:53 +05:30
thomas chaton 1759403c8d
Add check for callable with datamodule len (#10003) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-10-19 14:51:08 +00:00
Carlos Mocholí efc8727314
Add typing for `LightningOptimizer` (#9990) 2021-10-18 17:29:51 +02:00
Carlos Mocholí 3f355d0eb7
Remove manual tracking of optimizer steps (#9957) 2021-10-18 12:43:06 +00:00
Carlos Mocholí 788f6864d9
Fix `LightningOptimizer` step and toggling logic (#9958) 2021-10-18 00:23:51 +00:00
kingyiusuen 6429de8944
Add support for `len(datamodule)` (#9895) 
Co-authored-by: tchaton <thomas@grid.ai>
 2021-10-15 14:19:50 +02:00
Rohit Gupta 23e8b59ae7
Add `configure_gradient_clipping` hook in `LightningModule` (#9584) 
* init hook

* docs

* dep train args

* update tests

* doc

* doc

* .gitignore

* not dep

* add trainer args

* add & update tests

* fix tests

* pre-commit

* docs

* add docs

* add exception

* code review

* deepspeed

* update tests

* not

* try fix

* Apply suggestions from code review

* update deepspeed

* disable some tests

* disable some tests

* enable all tests
 2021-10-13 20:15:13 +05:30
Gili Tzabari 4afe53791b
Clarify lr scheduler frequency (#9843) 2021-10-12 01:44:07 +00:00
Rohit Gupta 4decbc0d95
Deprecate `dataloader_idx` from `on_train_batch_start/end` (#9816) 
* deprecate hooks

* dep todo

* explicit

* Apply suggestions from code review

* Apply suggestions from code review

* code review

* base
 2021-10-07 10:18:11 +00:00
Kaushik B f94faa9cd3
Enable auto parameters tying for TPUs (#9525) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-10-06 10:16:44 +02:00
Carlos Mocholí 60d4cc4f90
Convert error to warning for logging without a `Trainer` (#9733) 
Co-authored-by: thomas chaton <thomas@grid.ai>
 2021-09-29 04:49:51 +00:00
ananthsub 019e69ffd2
Fix docstring in saving.py (#9738) 2021-09-29 02:08:57 +02:00
Carlos Mocholí bc50591d49
reduce loop structure leakage into the `TrainingEpochLoop` (#9490) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-09-28 13:22:22 +00:00
four4fish 15cd6ad45b
Call TrainingTypePlugin collective functions directly instead of going through the Accelerator (#9677) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-09-27 14:52:57 +02:00
ananthsub 41e3be197f
Remove `call_configure_sharded_model` lifecycle property (#9612) 2021-09-24 03:57:53 +02:00
Adrian Wälchli 87b11fbd9d
add legacy load utility (#9166) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2021-09-23 09:52:48 +00:00
han c66d30a4aa
Fix typo in `LightningModule.configure_callbacks()` (#9591) 2021-09-18 15:34:09 +02:00
PuneetDabral 3aba9d16a8
Remove `ABC` from `LightningModule` (#9517) 2021-09-16 20:00:54 +00:00
Rohit Gupta f949a229a2
update to _has_prepared_data (#9411) 2021-09-13 09:05:42 +01:00
Danielle Pintz cc2ac02dd1
Move add_to_queue/get_from_queue to DDPSpawnPlugin (#9118) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2021-09-10 20:58:02 +00:00
Danielle Pintz 160e7e1289
Deprecate LightningModule.get_progress_bar_dict (#8985) 
* Move get_progress_bar_dict from lightning module to progress bar callback
 2021-09-09 20:53:47 +00:00
Carlos Mocholí 3070a9ea6e
Fix hiddens type annotation (#9377) 2021-09-09 08:45:52 +01:00
Carlos Mocholí 15d943089d
Enforce that the optimizer closure is executed when `optimizer_step` is overridden (#9360) 2021-09-08 12:24:57 +02:00
Carlos Mocholí 6892d533ea
Run plugin closure before `on_before_optimizer_step` [1/2] (#9288) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-09-07 11:52:20 +00:00
Jirka Borovec 6e124e7207
CI: precommit - docformatter (#8584) 
* CI: precommit - docformatter
* fix deprecated

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-09-06 12:49:09 +00:00
Adrian Wälchli 9a14f04322
Fix mypy typing errors in optimizer loop (#9317) 2021-09-06 13:54:07 +02:00
Kaushik B dc3391beae
Remove deprecation warnings being called for `on_{task}_dataloader` (#9279) 
* Avoid deprecation warnings being called when hooks are not implemented
* Update tests & changelog
* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-09-06 10:03:30 +02:00
Gili Tzabari 908e60dc85
Renamed `lr_dict` to `lr_scheduler_config` (#9313) 2021-09-04 00:47:43 +00:00
Carlos Mocholí 171d242a89
Add typing for `_FxValidator` [1/3] (#9269) 2021-09-03 13:41:05 +00:00
Adrian Wälchli b91747ef75
remove backward from training batch loop (#9265) 2021-09-03 00:15:40 +00:00
B. Kerim Tshimanga f0788b3bbc
scheduled removal of auto_move_data decorator (#9231) 
* scheduled removal of auto_move_data decorator

* update CHANGELOG.md

* remove unused import

* remove test_decorators.py

* fix missed merge conflict

Co-authored-by: thomas chaton <thomas@grid.ai>
 2021-09-03 00:54:36 +02:00