Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,738 Commits 59 Branches 217 Tags 353 MiB
Commit Graph

107 Commits

Author SHA1 Message Date
William Falcon 5b410681c3
Update __init__.py 2020-07-28 16:34:07 -04:00
Jirka Borovec 0fe933e23d
fixing TPU tests (#2632) 
* init

* rename

* tpu_core_idx

* idx 8

* idxs

* @pl_multi_process_test

* assert

* assert

* deamon

* no close

* imort

* msg

* use_single_gpu

* dataset

* idx

* fix idx

* dataset

* format

* add pickable

* typo

* apex

* typo

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* docs

* typo

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* tests

* docs

* docs

* Apply suggestions from code review

Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Apply suggestions from code review

Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>

* docs

* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2020-07-27 19:07:09 -04:00
William Falcon 5dc8c1d355
Update __init__.py 2020-07-25 13:04:06 -04:00
William Falcon 4794175545
Update __init__.py 2020-07-24 15:44:06 -04:00
Nathan Raw 1caf8beb2c
Datamodule (#2668) 
* ✨ Add copy of pl_bolts datamodule to lightning

* ✨ add datamodule to necessary init files

* 🚧 add datamodule property to LightningModule

* 🚧 .

* 🎨 Let DataModule do its own thing

* 🚧 add back setup and run both hooks implicitly

* 🚧 .

* 🐛 fix add_argparse_args

* 💄 apply black formatting and isort

* 📝 docstrings

* 📝 .

* 📝 .

* 🐛 overwrite cls prepare_data instead of instance

* 📝 .

* ✅ add some tests

* Update datamodule.py

* Update datamodule.py

* Update datamodule.py

Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-07-24 11:42:15 -04:00
William Falcon 6d10ac2ac8
Structured results (train loop only. val loop separate PR) (PR 2/5) (#2615) 
* r

* r

* r

* patched optimizer closure with sr

* patched optimizer closure with sr

* patched optimizer closure with sr

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added train step structured result

* added autoreduce for train step

* added auto reduce on train

* added auto reduce on train

* added auto reduce on train

* added auto reduce on train

* added auto reduce on train

* added auto reduce on train

* added hooks

* added hooks

* added hooks

* added hooks

* added hooks

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* cache

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* Update pytorch_lightning/callbacks/early_stopping.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/callbacks/early_stopping.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/callbacks/early_stopping.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/callbacks/model_checkpoint.py

* Update pytorch_lightning/core/step_result.py

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* Apply suggestions from code review

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* simple

* finished tests for structured results on train epoch

* simple

* simple

* revert

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* Update tests/base/deterministic_model.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* finished tests for structured results on train epoch

* docstring typos

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* finished tests for structured results on train epoch

* Update pytorch_lightning/core/step_result.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update pytorch_lightning/overrides/data_parallel.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: Jirka <jirka@pytorchlightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
 2020-07-20 19:00:20 -04:00
Jirka Borovec 817d25b157
missing changelog (#2464) 
* missing

* miss

* miss

* new
 2020-07-10 17:16:48 +02:00
William Falcon 92d6abcbb9
0.8.5 (#2573) 
* remove grad scaling tpu

* remove grad scaling tpu
 2020-07-09 22:00:23 -04:00
William Falcon c197b74289
Update __init__.py 2020-07-09 20:40:58 -04:00
davinnovation b6507daf89
add metrics to pl module (#2506) 2020-07-04 23:55:22 -04:00
Jirka Borovec dcd6000be7
continue (#2450) 2020-07-01 08:35:51 -04:00
Jirka Borovec 695e0514f8
cleaning (#2449) 2020-07-01 07:56:10 -04:00
Jirka Borovec a75398530c
continue (#2416) 2020-06-29 21:00:52 +02:00
William Falcon 33b92557f5
Update __init__.py 2020-06-29 06:59:35 -04:00
Jirka Borovec 3ff695510e
missing changes (#2283) 
* missing

* RC1

* RC1

* format
 2020-06-29 06:34:19 -04:00
William Falcon 8f07b77fc0
Update __init__.py 2020-06-28 22:08:51 -04:00
Jirka Borovec c7f8367650
devel version (#2292) 2020-06-19 23:42:57 -04:00
William Falcon 2fbc997895
Update __init__.py 2020-06-19 02:43:21 -04:00
Jirka Borovec 596a5d771f
Docs new section (#2236) 
* chlog

* docs

* ver++

* docs

* url

* docs

* readme

* docs ---
 2020-06-18 17:54:29 -04:00
Jirka Borovec a2d3ee80ad
final cleanup for v0.8.0 (#2181) 
* final clean for v0.8.0

* chlog

* chlog

* date

* rename stage

* date

* missing
 2020-06-18 07:21:44 -04:00
William Falcon 9ec940493b
Update __init__.py 2020-06-17 19:51:26 -04:00
William Falcon 2411c3be70
replace train_percent_check with limit_train_batches (#2220) 
* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* drop train_percent_check

* chlog

* deprecated

* deprecated

* deprecated

* tests

* tests

* Apply suggestions from code review

* tests

* hydra support

* tests

* hydra support

* hydra support

* hydra support

* tests

* typo

* typo

* Update test_dataloaders.py

* docs

* docs

* docs

* docs

Co-authored-by: Jirka <jirka@pytorchlightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2020-06-17 13:42:28 -04:00
William Falcon 022ba5c667
Update __init__.py 2020-06-16 07:52:33 -04:00
William Falcon c826a5f599
Update __init__.py 2020-06-13 19:30:01 -04:00
William Falcon 3f28a8ef32
Update __init__.py 2020-06-08 19:28:50 -04:00
Adrian Wälchli 8211256c46
data transfer model hook (+ refactor) (#1756) 
* refactor and added hook


variant a


variant b


add test


revert rename


add changelog


docs

* resolve merge duplication

* overridden typo

* fix test

* tpu id

* raise if TPU not available

* re-use apply_to_collection function for parsing collections

* comment

* make utility function available to user

* documentation

* move changelog entry to top

* fix tpu transfer call

* fix call

* remove hardcoded string

* improve test

* call model hook by default

* Apply suggestions from code review

* rename utility function

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2020-06-02 21:45:19 -04:00
Jirka Borovec 9893681859
fix changelog (#1864) 
* fix chlog

* test for #1729

* hist

* update

* Document use case of passing test dataloaders to Trainer.test() (#1992)

* Issue 1990 Doc patch.

* Codeblock directive.

* Update to reflect current state of pytorch-lightning

* Final grammar cleaning. I hope these commits are squashed.

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: authman <uapatira@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2020-05-31 00:48:05 -04:00
Jirka Borovec 692f302837
continue devel (#1793) 
* miss

* miss

* miss

* update

* format
 2020-05-17 08:30:45 -04:00
Jirka Borovec e95e1d71c7
release 0.7.6 (#1813) 
* release 0.7.6rc2

* release 0.7.6

* include img

* smaller image

* missing

* miss

* miss

* miss

* up
 2020-05-15 08:36:40 -04:00
William Falcon c8c5d33208
Update __init__.py 2020-05-14 18:44:46 -04:00
William Falcon 1265b2fe02
Update __init__.py 2020-05-13 19:51:41 -04:00
William Falcon 12138ced7c
Update __init__.py 2020-05-13 14:42:50 -04:00
kumuji 619f984c36
Option to provide seed to random generators to ensure reproducibility (#1572) 
* Option to provide seed to random generators to ensure reproducibility

I added small function in utilities which imports torch, numpy, python
random and sets seed for all of the libraries to ensure reproducibility
of results.

* Apply recommendations from core contributors on seeding

1. Moved the seeding code to another file
2. Make deterministic as a parameter for trainer class
3. Add assertions for seeding numpy
4. Added warnings
5. torch.manual_seed should be enough for seeding torch

* Revert "Apply recommendations from core contributors on seeding"

This reverts commit a213c8e6882eec8a9e7408b9418926d2db7c5461.

* Revert "Revert "Apply recommendations from core contributors on seeding""

This reverts commit 59b2da53c62878de7aab0aa3feb3115e105eea06.

* Change in test, for correct seeding

* Allow seed equal to 0

* Allow seed to be uint32.max

* Added deterministic to benchmarks

* Cuda manual seed as in benchmark seeding

* Seeding should be done before model initialization

* cuda manual_seed is not necessary

* Fixing seed test_cpu_lbfgs

On some seeds seems like lbfgs doesn't converge.
So I fixed the seed during testing.

* rebasing issue with old reproducibility.py

* Improved documentation and ability to seed before initializing Train
class

* Change in docs

* Removed seed from trainer, update for documentation

* Typo in the docs

* Added seed_everything to _all_

* Fixing old changes

* Model initialization should be earlier then Trainer

* Update pytorch_lightning/trainer/__init__.py

From Example to testcode

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Fixing according to the contributors suggestions

* Moving horovod deterministic to Trainer class

* deterministic flag affects horovod docs update

* Improved static typing

* Added deterministic to test runners of horovod

It is failing on some versions, not very predictable

* static seeds for horovod tests

* Change for reset_seed function in tests

* Seeding horovod using reset_seed from tutils

* Update pytorch_lightning/trainer/__init__.py

* chlog

* Update trainer.py

* change "testcode" to "Example" in trainer init documentation

* Update pytorch_lightning/trainer/seed.py, first line in comment

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: William Falcon <waf2107@columbia.edu>
 2020-05-12 07:53:20 -04:00
Jeremy Jordan 1df0d2dc97
set logger level for package (#1718) 
* move logging config to trainer class init

* alternate logging config
 2020-05-12 00:14:35 -04:00
Jirka Borovec 9d2df24d6b
RC & Docs/changelog (#1776) 
* missing

* RC

* tol

* Apply suggestions from code review

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* test

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2020-05-11 21:57:53 -04:00
William Falcon 694f1d789d
Update __init__.py 2020-04-27 09:04:55 -04:00
William Falcon acfb054103
Update __init__.py 2020-04-26 17:48:27 -04:00
William Falcon d290b818d0
Update __init__.py 2020-04-26 11:08:00 -04:00
William Falcon 17bce62e5f
Update __init__.py 2020-04-25 19:04:39 -04:00
William Falcon f531ab957b
Update __init__.py 2020-04-24 17:21:52 -04:00
William Falcon f07176da9b
Update __init__.py 2020-04-24 10:33:26 -04:00
William Falcon 67d5f4dc39
Update __init__.py 2020-04-23 21:02:19 -04:00
William Falcon 5ab5084f7b
Update __init__.py 2020-04-23 15:32:40 -04:00
William Falcon 759557050a
Update __init__.py 2020-04-23 11:04:57 -04:00
William Falcon 990fd22488
Update __init__.py 2020-04-22 20:16:04 -04:00
Justus Schock 29c7d2f195
Revert namespace package search to normal package search (#1545) 
* Revert this

* typos

* version++

Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
 2020-04-21 08:26:47 -04:00
Justus Schock 8035c10f37
Prepare Namespace package (#1543) 
* Update __init__.py

* Update setup.py
 2020-04-21 07:12:02 -04:00
Jirka Borovec bd168819f2
fix changelog (#1452) 
* fix changelog

* formatting

* add ddp_cpu

* docs

* add another
 2020-04-20 17:36:26 -04:00
William Falcon b0bf51f99f
Update __init__.py 2020-04-19 17:58:45 -04:00
Jirka Borovec dcda5194df
continues develop (#1419) 
* continues develop

* changelog

* typo
 2020-04-10 13:10:46 -04:00