Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,380 Commits 55 Branches 212 Tags 383 MiB
Commit Graph

3380 Commits

Author SHA1 Message Date
Jirka Borovec 2bd045bb4a
new chlog template (#3963) 2020-10-07 20:42:24 -04:00
William Falcon 65b6a6a497
0.10.0 (#3965) 2020-10-07 20:41:56 -04:00
Jeff Yang 9be26d0c1b
Use `viewcode` extension instead of `linkcode` (#3503) 
* use viewcode instead of linkcode

* use viewcode instead of linkcode

* Apply suggestions from code review

Co-authored-by: William Falcon <waf2107@columbia.edu>

* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-10-07 23:55:24 +02:00
William Falcon b4051e7c1e
0.10.0 (#3954) 2020-10-07 17:04:28 -04:00
irene50288 f9a9a5f298
[CI SKIP] Sequential data & TPU support docs fix (#3956) 
* sequential data docs fix

* TPU support docs fix

Co-authored-by: Iryna Koroliuk <irynakoroliuk@Irynas-MacBook-Pro.local>
 2020-10-07 16:11:03 -04:00
Caroline Adams 3aef67c8dc
Documentation Fixes [skip ci] (#3955) 
* Documentation Fixes

Just did some scanning for errors. Fixed indentation spelling, and grammar changes.

* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2020-10-07 16:10:41 -04:00
Eric Harper 0a3aa8b6ce
[ci skip] NeMo Documentation for PyTorch Lightning (#3707) 
* initial commit

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* updated

Signed-off-by: ericharper <complex451@gmail.com>

* doc clean up

Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-10-07 15:26:21 -04:00
Justus Schock bd5621dc79
Add functional metric docs [skip ci] (#3946) 
* add functional docs

* drop

* format

Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
 2020-10-07 21:12:15 +02:00
Jirka Borovec fef9b7777f
missing logs [to be merged before release][skip ci] (#3131) 
* missing logs

* chlog

* add chlo to docs

* Apply suggestions from code review

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* chlog

* docs

* log

* metrics

* logs

* log

* format

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2020-10-07 14:51:35 -04:00
Jirka Borovec 616fe82c7d
latest restore func metrics (#3949) 
* latest restore

* latest restore
 2020-10-07 14:26:30 -04:00
Juan Pablo Carzolio 186fc130cf
Minor formatting & grammar fixes in docs [CI SKIP] (#3952) 
* Minor formatting & grammar fixes in docs

* Few more tentative doc fixes
 2020-10-07 14:25:52 -04:00
irene50288 0c4b22e28a
LightingDataModule doc fix (#3948) 
Co-authored-by: Iryna Koroliuk <irynakoroliuk@Irynas-MacBook-Pro.local>
 2020-10-07 13:54:21 -04:00
William Falcon 6044cf9003
Fixes #3945 (#3947) 2020-10-07 13:46:27 -04:00
edenlightning 27f536b2ce
[CI SKIP] Fix early stop docs (#3940) 
* Update early_stopping.rst

* Update __init__.py

* Update new-project.rst

* Update early_stopping.rst

* Update __init__.py

* Update early_stopping.rst

* Update __init__.py

Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-10-07 13:01:50 -04:00
Jirka Borovec b3d25262e9
restore functional metrics (#3943) 
* restore functional metrics

* clean

* fix
 2020-10-07 12:48:58 -04:00
Jirka Borovec c77073f040
skip files in coverage (#3944) 2020-10-07 12:37:01 -04:00
William Falcon 838940eee7
removing this troubling test that has random behavior (#3941) 
* threshold

* threshold
 2020-10-07 12:01:51 -04:00
Jirka Borovec 4299e52de8
codecov can't parse GPU/TPU coverage - temporary skip until that is fixed on their end (#2743) 
* skip file

* todo

* skip

* skip

* note

* move
 2020-10-07 11:17:24 -04:00
William Falcon b922409624
clean and organize fit (#3938) 
* clean and organize fit

* clean and organize fit

* clean and organize fit

* clean and organize fit

* clean and organize fit
 2020-10-07 11:04:10 -04:00
edenlightning 7c36c4a413
remove logging from callback (#3939) 2020-10-07 10:42:40 -04:00
William Falcon 575e01be82
tests for multiple optimizers and dataloader combinations (#3937) 
* added tests for multiple optimizers and dataloaders

* added tests for multiple optimizers and dataloaders

* added tests for multiple optimizers and dataloaders
 2020-10-07 10:13:57 -04:00
Jirka Borovec 05cb6fcc58
Update ci_dockers.yml (#3935) 2020-10-07 08:26:07 -04:00
Sean Naren 2aebf65241
Test to ensure ckpt filepath contains correct val score (#3933) 
* Added test to ensure ckpt filepath contains the correct val score reported from the trainer

* Modified to check all saved ckpt files
 2020-10-07 07:43:17 -04:00
ananthsub 0c5ca4e2b8
Update lightning.py (#3929) 2020-10-07 07:40:38 -04:00
ananthsub d3f40d6a9e
Update to_disk to use fsspec for remote file support (#3930) 
* Update supporters.py

* Update CHANGELOG.md

* Update supporters.py

* Update supporters.py

* Update supporters.py

* Update supporters.py

* Update supporters.py

* Update supporters.py

* Update CHANGELOG.md

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2020-10-07 07:28:23 -04:00
William Falcon 9c415d2c71
moves configure ddp to each backend (#3924) 
* moves configure ddp to each backend

* moves configure ddp to each backend

* moves configure ddp to each backend

* added torch manual seed in test_mean_error

* test for complicated batch structure

* test for complicated batch structure

* test for complicated batch structure

Co-authored-by: ananyahjha93 <ananya@pytorchlightning.ai>
 2020-10-07 00:50:16 -04:00
Adrian Wälchli d65b037a40
Mocking Loggers Part 5/5 (final) (#3926) 
* base

* add xfail

* new test

* import

* missing import

* xfail if not installed


include mkpatch


fix test

* mock comet


comet mocks


fix test


remove dep


undo merge duplication

* line

* line

* convert doctest

* doctest

* docs

* prune Results usage in notebooks (#3911)

* notebooks

* notebooks

* revamp entire metrics (#3868)

* removed metric

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* added new metrics

Co-authored-by: Teddy Koker teddy.koker@gmail.com

* pep8

Co-authored-by: Teddy Koker teddy.koker@gmail.com

* pep8

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* reset in compute, cache compute

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* reduce_ops handling

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* sync -> sync_dist, type annotations

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* wip docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* mean squared error

* docstring

* added mean ___ error metrics

* added mean ___ error metrics

* seperated files

* accuracy doctest

* gpu fix

* remove unnecessary mixin

* metric and accuracy docstring

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* metric docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* pep8, changelog

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* refactor dist utils, pep8

* refactor dist utils, pep8

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* Callback docs with autosummary (#3908)

* callback docs with autosummary

* do not show private methods

* callback base docstring

* skip some docker builds (temporally pass) (#3913)

* skip some docker builds

* todos

* skip

* use badges only with push (#3914)

* testtube

* mock test tube

* mock mlflow

* remove mlflow

* clean up

* test

* test

* test

* test

* test

* test

* code blocks

* remove import

* codeblock

* logger

* wandb causes stall

Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Ananya Harsh Jha <ananya@pytorchlightning.ai>
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
 2020-10-06 23:49:06 -04:00
William Falcon 1a345a4a78
test for complicated batch structure (#3928) 
* test for complicated batch structure

* test for complicated batch structure
 2020-10-06 23:14:51 -04:00
William Falcon 71a4c61f6e
fixes #3871 (#3919) 
* fixes #3871

* ✅ tests

* ✅ tests

* ✅ tests

* ✅ tests

* ✅ tests

* ✅ tests

* ✅ tests

* moves sync bn to each backend

* moves sync bn to each backend

Co-authored-by: nateraw <nxr9266@g.rit.edu>
 2020-10-06 22:56:34 -04:00
William Falcon e3007ffe0c
moves sync bn to each backend (#3925) 2020-10-06 22:42:33 -04:00
William Falcon af5887c0aa
fixed ddp flag crash (#3927) 2020-10-06 22:41:08 -04:00
Adrian Wälchli 9928125768
Mocking Loggers (part 4c, mlflow) (#3889) 
* base

* add xfail

* new test

* import

* missing import

Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-10-06 21:55:59 -04:00
William Falcon d71ed277d4
moves init apex from LM to apex connector (#3923) 2020-10-06 21:31:56 -04:00
Adrian Wälchli c1559a1476
Mocking Loggers (part 4b, mlflow) (#3885) 
* base

* mock test

Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-10-06 20:50:06 -04:00
ananthsub 6c47535de8
Update tensorboard.py (#3920) 2020-10-06 20:34:15 -04:00
Ananya Harsh Jha 4cd14c4237
fixes metrics pickle issue (#3921) 
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
 2020-10-06 20:33:57 -04:00
Adrian Wälchli db0e295f67
Complete mocking Comet and remove dep (#3910) 
* xfail if not installed


include mkpatch


fix test

* mock comet


comet mocks


fix test


remove dep


undo merge duplication

* line

* line

* convert doctest

* doctest

* docs
 2020-10-06 19:50:42 -04:00
edenlightning 335bb75356
update docs on logging (#3916) 
* Update loggers.rst

* Update loggers.rst

* Update index.rst

* Create logging.rst

* Delete experiment_reporting.rst

* Delete experiment_logging.rst

* Update __init__.py
 2020-10-06 18:53:39 -04:00
Jirka Borovec 217043bc9d
use badges only with push (#3914) 2020-10-06 17:30:16 -04:00
Jirka Borovec 7f4a9b75f3
skip some docker builds (temporally pass) (#3913) 
* skip some docker builds

* todos

* skip
 2020-10-06 17:29:43 -04:00
Jeff Yang fe5b943965
Callback docs with autosummary (#3908) 
* callback docs with autosummary

* do not show private methods

* callback base docstring
 2020-10-06 17:28:45 -04:00
Ananya Harsh Jha f76bc5254e
revamp entire metrics (#3868) 
* removed metric

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* added new metrics

Co-authored-by: Teddy Koker teddy.koker@gmail.com

* pep8

Co-authored-by: Teddy Koker teddy.koker@gmail.com

* pep8

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* win ddp tests skip

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* reset in compute, cache compute

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* reduce_ops handling

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* sync -> sync_dist, type annotations

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* wip docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* mean squared error

* docstring

* added mean ___ error metrics

* added mean ___ error metrics

* seperated files

* accuracy doctest

* gpu fix

* remove unnecessary mixin

* metric and accuracy docstring

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* metric docs

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* pep8, changelog

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>

* refactor dist utils, pep8

* refactor dist utils, pep8

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
 2020-10-06 17:03:24 -04:00
Jirka Borovec 4722cc0bf0
prune Results usage in notebooks (#3911) 
* notebooks

* notebooks
 2020-10-06 16:57:56 -04:00
Nathan Painchaud c510a7f900
Additional test for logging during validation loop (#3907) 
* Added test for logging in validation step when using dict dataset with string value

* fix recursive issue

* fix recursive issue

Co-authored-by: Nathan Painchaud <nathanpainchaud@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-10-06 15:27:18 -04:00
Jirka Borovec 064ae53d63
nb steps in early stop (#3909) 
* nb steps

* if

* skip

* rev

* seed

* seed
 2020-10-06 15:20:08 -04:00
maxjeblick 39b3704285
add current_epoch to dumped_params (#3261) 
* add current epoch to __dumped_params

* log

* reset

* add to test

* Update CHANGELOG.md

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2020-10-06 19:54:48 +02:00
Lezwon Castelino 69833dad5b
Added check to verify xla device is TPU (#3274) 
* tpu device check

* replaced with xmp spawn

* Revert "replaced with xmp spawn"

This reverts commit 6835380f

* replaced all instances of XLA_AVAILABLE

* moved inner_f to global scope

* made refactors

* added changelog

* added TPU_AVAILABLE variable

* fix codefactor issues

* removed form trainer and early stopping

* add TORCHXLA_AVAILABLE check

* added tests

* refactoring

* Update pytorch_lightning/utilities/xla_device_utils.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* updated function names

* fixed bug

* updated CHANGELOG.md

* added todo

* added type hints

* isort and black

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-10-06 19:54:37 +02:00
William Falcon 2cf17a3718
Adds tests to make sure logging doesn't happen multiple times (#3899) 
* Makes sure logging doesn't ever happen from non-root zero

* Makes sure logging doesn't ever happen from non-root zero

* Makes sure logging doesn't ever happen from non-root zero

* added bug report model

* fix local model

* fix local model

* fix local model

* fix local model
 2020-10-06 12:43:51 -04:00
Sean Naren e4a56fa5cf
Ensure global seed exists before passing into env subprocess.Popen call (#3904) 2020-10-06 12:31:49 -04:00
Jirka Borovec f55a9cf63a
fic CI parsing Horovod version (#3804) 2020-10-06 17:18:16 +02:00