Commit Graph

593 Commits

Author SHA1 Message Date
William Falcon d81851843e
Update README.md 2021-02-13 11:51:33 -05:00
Jirka Borovec 388eeea52d
bye bye Drone (#5901) 2021-02-10 09:13:38 -05:00
William Falcon da02ac30fb Update README.md 2021-02-05 21:40:40 +01:00
Alex Parinov 78918a9e8e Rename opt_idx to optimizer_idx in docs for complex training loops (#5712) 2021-02-05 21:40:40 +01:00
Carlos Mocholí 4d9c51d316 Update help steps (#5564)
* Update help steps

* Update README.md

Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>

* Update README.md

* Update README.md

Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
2021-02-04 20:55:40 +01:00
Jirka Borovec d5c107fa96
Docs: move images (#5756)
* move images

* logo
2021-02-03 15:08:19 +00:00
chaton 0435e23a64 deprecate enable_pl_optimizer as it is not restored properly (#5244)
* update

* clean test

* still in progress

* udpdate test

* update

* update

* resolve flake

* add test for zero_grad

* update

* works without accumulated_grad

* update

* update

* resolve amp

* revert back to True

* update

* clean tests

* cleaned out

* typo

* update test

* git repare bug

* remove print

* udpate

* Fix formatting/optimizer imports

* Refactor the test for cleanliness

* Add vanilla model to the test, better var names

* Fixed var names, let's clean up these mock tests

* repare test

* update test

* resolve flake8

* add manual_optimization

* update tests

* resolve flake8

* add random accumulate_grad_batches

* improve test

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* update

* clean tests

* correct bug

* Apply suggestions from code review

* format

* adress comments

* update on comments

* wip

* typo

* depreceate enable_pl_optimizer

* resolve latest bugs

* update

* resolve merge

* add comment

* Update pytorch_lightning/core/lightning.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update tests/deprecated_api/test_remove_1-3.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/trainer/connectors/optimizer_connector.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/trainer/trainer.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/trainer/trainer.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* update on comments

* update restore

* add a property

* remove setstate as not needed anymore

* update test

* provide optimizer to on_before_zero_grad

* update on comments

* update on comments

* Update pytorch_lightning/trainer/trainer.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* mofidy import

* update changelog

* resolve flake8

* update

* update

* clean doc

Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-109.ec2.internal>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>

(cherry picked from commit f2e99d617f)
2021-01-26 14:29:46 +01:00
Jirka Borovec 7e4d6cbe48
set minimal req. PT 1.4 (#5418)
* set minimal req. PT 1.4

* chlog
2021-01-12 19:15:35 -05:00
Varad Pimpalkhute a1784b7d55 Update README.md (#5018)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
(cherry picked from commit 90c1c0f68b)
2021-01-06 11:55:03 +01:00
Rohit Gupta 8ac00bd2fb Add TPU example (#5109)
* Add TPU example

* add badge

* add badge

* add badge

* bullets

* name

* trigger

* add dataset name

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: chaton <thomas@grid.ai>
(cherry picked from commit b930b5f222)
2021-01-06 11:54:54 +01:00
Jirka Borovec d19d711dcf skip some description from pypi (#5234)
* skip some description from pypi

* flake8

(cherry picked from commit 9b3c6a3e84)
2021-01-06 11:40:16 +01:00
Jirka Borovec 5e71c88096 releasing feature as nightly (#5233)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
(cherry picked from commit c479351a93)
2021-01-06 11:40:06 +01:00
William Falcon 2ddd36bcd7 Update README.md 2021-01-05 09:58:37 +01:00
William Falcon 64f9b4d113 Update README.md 2021-01-05 09:58:37 +01:00
Rohit Gupta cd83829aa0 Remove Sourcerer (#5172)
* Remove Sourcerer

* trigger

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-01-05 09:58:37 +01:00
Jirka Borovec e2c404bad2
CI: update badges for release (#5002)
* fix images

* not sleep

* a0

* path

* assets

* assets

* bitecode

* rls

* rls

* badges

* fix

* org

* drop

* clean

* codecov

* fix

* clean
2020-12-09 10:59:44 +01:00
Jirka Borovec eeae426b33
CI: skip hanging (#4943)
* CI: try increase time limit

* try min 3.8

* no ex

* CI

* dep

* test

* deps

* deps

* drop

* drop

Co-authored-by: chaton <thomas@grid.ai>
2020-12-02 16:18:14 +00:00
Jirka Borovec 597dfa174c
build dockers XLA 1.7 (#4891)
* build XLA 1.7

* night XLA 1.7

* rename

* use 1.7

* tpu ver
2020-11-29 15:14:19 -04:00
edenlightning 78076ea0d9
Replace readme DQN link with bolts implementation (#4841) 2020-11-24 23:45:25 +01:00
Jirka Borovec b10b11deb0
add version for CPU users (#4794) 2020-11-20 21:32:13 +01:00
Jirka Borovec bd6c413829
Conda: PT 1.8 (#3833)
* PT 1.8

* unfreeze PT

* drop nightly from full

* add PT 1.8 to workflow

* readme table

* cuda

* skip cuda

* test 1.8

* unfreeze torch vision

Co-authored-by: ydcjeff <ydcjeff@outlook.com>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-11-12 15:03:43 +01:00
Jeff Yang ee414d25be
Switch to PyTorch 1.6 in Drone CI (#4393)
* switch to 1.6

* readme

* 1.7

* back to normal [ci skip]

* horovodrun --verbose

* try with apex

* add apex test

* change base

* description

* test with 1.7

* back to 1.6

* no gradient_clip_val

* re-add gradient_clip_val

* no amp

* temp skip torch.cuda.amp + horovod test

* Apply suggestion from code review

Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>

* Fix formatting

* ddp

* Moved extended model outside of function to prevent pickling issue for drone

* typo

* resolve bug

* extract automatic_automization

Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: chaton <thomas@grid.ai>
2020-11-03 18:01:51 +00:00
Muyang Li 169e8c3d98
Fix a typo in README (#4474) 2020-11-02 14:00:58 +06:30
Jeff Yang 0f584faa6b
PyTorch 1.7 Stable support (#3821)
* prepare for 1.7 support [ci skip]

* tpu [ci skip]

* test run 1.7

* all 1.7, needs to fix tests

* couple with torchvision

* windows try

* remove windows

* 1.7 is here

* on purpose fail [ci skip]

* return [ci skip]

* 1.7 docker

* back to normal [ci skip]

* change to some_val [ci skip]

* add seed [ci skip]

* 4 places [ci skip]

* fail on purpose [ci skip]

* verbose=True [ci skip]

* use filename to track

* use filename to track

* monitor epoch + changelog

* Update tests/checkpointing/test_model_checkpoint.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-10-30 15:42:14 +00:00
Jirka Borovec ce8abd6255
Drone: use nightly build cuda docker images (#3658)
* upgrade PT version

* update docker

* docker

* try 1.5

* badge

* fix typo: dor -> for (#3918)

* prune

* prune

* env

* echo

* try

* notes

* env

* env

* env

* notes

* docker

* prune

* maintainer

* CI

* update

* just 1.5

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* docker

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* CI

* push

* try

* prune

* CI

* CI

* CI

* CI

Co-authored-by: Klyukin Valeriy <mr.clyukin@gmail.com>
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
2020-10-26 10:47:09 +00:00
Jirka Borovec ec424e7b91
add svg logo [SKIP CI] (#3988)
* docs logo

* use png

* cleaning

* vectorial

* Apply suggestions from code review

Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>

* Apply suggestions from code review

Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-10-21 19:11:31 +02:00
William Falcon 0474464c45
Update README.md 2020-10-13 21:13:45 -04:00
William Falcon 19a9978702
Update README.md 2020-10-13 08:21:27 -04:00
William Falcon 85f1000ef0
Update README.md 2020-10-13 06:50:23 -04:00
William Falcon 079898fe82
Update README.md 2020-10-11 14:20:07 -04:00
William Falcon ee10171fe8
Update README.md 2020-10-11 14:14:30 -04:00
William Falcon 48083765b0
Update README.md 2020-10-11 10:43:28 -04:00
William Falcon c189678cbc
Update README.md 2020-10-10 22:55:16 -04:00
William Falcon 3227ba89f3
docs clean up (#4068)
* docs

* docs
2020-10-10 22:48:50 -04:00
William Falcon ba639b4ff5
Update README.md 2020-10-10 22:09:01 -04:00
Jirka Borovec 1b4209bc35
swap example (#4029) 2020-10-09 19:11:54 -04:00
edenlightning b33655982d
Update README.md (#4036) 2020-10-09 19:09:02 -04:00
Paul Baumstark 01f131665a
Minor edit in README (#3959)
Align the number of steps in README to the documentation

Update README

Fix grammar

Update README.md

typos

Co-authored-by: pbmstrk <pbmstrk@users.noreply.github.com>
2020-10-09 10:43:31 +02:00
William Falcon cf04bc53a7
Update README.md 2020-10-08 09:20:32 -04:00
William Falcon 98399044cc
Update README.md 2020-10-08 09:19:51 -04:00
William Falcon 298c884390
Update README.md 2020-10-08 09:19:14 -04:00
edenlightning 6e5e385188
Update README.md (#3986) 2020-10-08 09:17:51 -04:00
William Falcon 933ca4a0ad
Update README.md 2020-10-08 07:29:57 -04:00
William Falcon 19a7f1c5fd
Update README.md 2020-10-08 07:28:32 -04:00
William Falcon 89973b6f44
Update README.md 2020-10-08 07:27:13 -04:00
William Falcon 28733fdd90
Update README.md 2020-10-08 07:21:10 -04:00
William Falcon c13ef21cbb
Update README.md 2020-10-08 07:20:43 -04:00
William Falcon 2db4f25f8b
Update README.md 2020-10-08 07:19:57 -04:00
William Falcon 6218787e11
Update README.md 2020-10-08 07:16:33 -04:00
William Falcon a47929f4aa
Update README.md 2020-10-08 07:16:05 -04:00
William Falcon 31c0ef6661 docs 2020-10-08 07:15:07 -04:00
William Falcon 1d9fe0e969
Update README.md 2020-10-08 07:07:35 -04:00
Jirka Borovec 217043bc9d
use badges only with push (#3914) 2020-10-06 17:30:16 -04:00
Jirka Borovec 1160270882
fix path in CI for release & python version in all dockers & duplicated badges (#3765)
* typo

* path

* check

* trigger

* fix conda

* pip ver

* fix cuda

* fix XLA

* fix xla

* ci

* docker

* BIULD

* unBIULD

* update

* py 3.8

* apex

* apex
2020-10-02 05:26:21 -04:00
Jirka Borovec ab508dae0c
run TPU tests with multiple versions (#3024)
* rename

* multi build

* multi build

* copy

* copy

* copy

* copy

* copy

* copy

* clean

* note

* docker

* formatting

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-09-30 08:36:02 -04:00
Jirka Borovec a0968e4bdf
fix PT version in CUDA docker images (#3739)
* upgrade PT version

* update docker

* docker

* try 1.5

* fix docker versions

* old

* badge
2020-09-30 08:33:22 -04:00
Jeff Yang 05e5f03fd7
Enable PyTorch 1.7 in conda CI (#3541)
* enable pt 1.7

* readme

* nightly diff version testing, will delete later

* nightly diff version testing, will delete later

* back to normal [ci skip]

* use __ignored_properties__

* define __ignored_properties__ in respective modules

* change log

* formatting

Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-09-25 16:20:15 +02:00
William Falcon 2db86381c6
Update README.md 2020-09-23 07:39:46 -04:00
William Falcon c0e26b8766
fix examples (#3623)
* fix examples

* fix examples
2020-09-23 07:36:51 -04:00
edenlightning b4c553b9e6
update readme with new notebooks (#3608) 2020-09-22 20:27:52 +02:00
William Falcon f53e739637
clarify forward (#3611)
* clarify forward

* clarify forward

* clarify forward

* clarify forward
2020-09-22 14:00:02 -04:00
William Falcon 2a10cfaf3d
clarify forward (#3609)
* clarify forward

* clarify forward
2020-09-22 13:37:11 -04:00
William Falcon 674d33061f
Update README.md 2020-09-21 17:06:40 -04:00
William Falcon 3bfd2edb08
Update README.md 2020-09-21 17:04:05 -04:00
William Falcon 8238f687c6
Update README.md 2020-09-21 16:45:25 -04:00
William Falcon 3cfa448e88
Update README.md 2020-09-21 16:44:44 -04:00
William Falcon 6aad8adfa3
Update README.md 2020-09-21 16:42:38 -04:00
William Falcon 6309a0dbb8
Update README.md 2020-09-21 16:37:26 -04:00
William Falcon 1957de371a
Update README.md 2020-09-21 16:36:22 -04:00
William Falcon 90b9194ade
Update README.md 2020-09-21 16:34:55 -04:00
William Falcon 726b589ecb
Update README.md 2020-09-21 16:33:29 -04:00
William Falcon 35cc3b2269
Update README.md 2020-09-21 16:31:54 -04:00
William Falcon ae5e28f9d9
Update README.md 2020-09-21 16:29:44 -04:00
William Falcon 656972cd37
Update README.md 2020-09-21 11:25:13 -04:00
William Falcon 2f301faf85
Update README.md 2020-09-21 11:19:29 -04:00
William Falcon 32303f1022
Docs clean up of results and forward vs training_step confusion (#3584)
* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs

* docs
2020-09-21 11:17:59 -04:00
Jeff Yang 8be79a9a96
stable, dev PyTorch in Dockerfile and conda gh actions (#3074)
* dockerfile and actions file

* dockerfile and actions file

* added pytorch conda cpu nightly

* added pytorch conda cpu nightly

* recopy base reqs

* gh action `include` torch nightly

* add pytorch nightly & conda gh badge

* rebase

* fix horovod

* proposal refactor

* Update .github/workflows/ci_pt-conda.yml

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update .github/workflows/ci_pt-conda.yml

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* update

* update

* fix cmd

* filled &&

* fix

* add -y

* torchvision >0.7 allowed

* explicitly install torchvision

* use HOROVOD_GPU_OPERATIONS env variable

* CI

* skip 1.7

* table

Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-09-17 20:30:39 +02:00
William Falcon 6817701371
Update README.md 2020-09-15 14:32:27 -04:00
William Falcon 944867a2ea
Update README.md 2020-09-15 14:31:37 -04:00
William Falcon 651f573f85
Update README.md 2020-09-15 06:13:10 -04:00
Jeff Yang 615d563ec6
docs: configure_sync_batchnorm, amp, readme python/conda badge (#3328)
* fix(docs): change to configure_sync_batchnorm for sync bn hook

* Update docs/source/lightning-module.rst

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* distinguish pypi and conda download badges

* python version badge and original pypi download badge

* Update docs/source/lightning-module.rst

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-09-14 10:35:14 +02:00
William Falcon 186e464f3b
Update README.md 2020-09-14 00:19:09 -04:00
Jirka Borovec cbc4f6f8a4
add CI for building dockers (#3383)
* rename

* fix badges

* add docker build

* mergify

* update

* env

* ci

* times

* CI

* name

* comment
2020-09-10 18:38:29 -04:00
Aashish Pawar ⚡ 0b5f417dfd
📝Update Readme.md (Code Error Minimal Example) (#3416)
* 📝Update Readme.md (Code Error Minimal Example)

to use gpus we need to use
```
trainer = pl.Trainer(max_epochs=1, gpus=8)
```
but In readme only Trainer() is used

* 📝Update Readme.md(added import in GPU/TPU stmts)

* 📝Update Readme.md ( Added Import to all imports)

as per the suggestion from @awaelchli

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-09-10 09:14:49 +00:00
William Falcon 43b8d62ccb
Update README.md 2020-09-05 08:07:03 -04:00
Jeff Yang b951097758
Add conda version/downloads, discourse badges to readme (#3247)
* add conda badge to readme

* Update README.md

* Update README.md

* Apply suggestions from code review

* make same color with `pypi package`

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-09-02 15:50:02 +00:00
edenlightning b4887d7647
Update README.md (#3289) 2020-08-31 10:52:45 -04:00
Lezwon Castelino 8b504a15da
update core contributors (#3224) 2020-08-27 11:27:54 -04:00
nithin varghese 6f634a1f0a
README.md typo correction (#3147) 2020-08-25 09:22:58 +00:00
Blue Tyson 54d78fbbd4
Update README.md (#3106)
Automating
2020-08-24 11:02:18 +02:00
William Falcon 83ab3eadb6
Update README.md 2020-08-22 09:02:27 -04:00
edenlightning af8acebc6c
Readme changes (#3078)
* Readme changes

* Update README.md

* Update README.md

* 0.9.0 readme

* 0.9.0 readme

Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-08-20 12:45:40 -04:00
William Falcon cc205f6a65
0.9.0 readme (#3075)
* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme

* 0.9.0 readme
2020-08-20 11:45:28 -04:00
William Falcon f43028f3ae
added copyright notices (#3062) 2020-08-19 22:03:22 -04:00
Jirka Borovec 097757b450
add linked badge (#2983) 2020-08-14 16:34:47 -04:00
Jirka Borovec 9110ea5301
add docker badge (#2980) 2020-08-14 16:05:53 -04:00
William Falcon 0260a05a95
Update README.md 2020-08-09 07:11:45 -04:00
William Falcon 13fe0a4da5
Update README.md 2020-08-09 06:22:48 -04:00
William Falcon 56d63772f0
Update README.md 2020-08-09 06:19:05 -04:00
edenlightning a59e140ee8
Add PL mastercalss to readme (#2873)
* Update index.rst

* add thumbanil

* update readme

* Update README.md

* Update index.rst

* image

Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-08-08 00:21:51 +00:00
Jirka Borovec b01ad75700
missing chlogs (#2672)
* missing

* miss

* Apply suggestions from code review

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* miss

* note

* notes

* update CI testing with pip upgrade (#2380)

* try pt1.5

* cpu

* upgrade

* tpu

* user

* [blocked by #2380] freeze GPU PT 1.4 (#2780)

* freeze

* user

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-08-02 12:34:36 +02:00
Jirka Borovec 3772601cd6
update CI testing with pip upgrade (#2380)
* try pt1.5

* cpu

* upgrade

* tpu

* user

* [blocked by #2380] freeze GPU PT 1.4 (#2780)

* freeze

* user
2020-07-31 14:50:06 -04:00
Jirka Borovec 06e8910f06
pytorch 1.6 (#2745)
* pt 1.6

* don't use the new zipfile serialization for now

* quick flake8 fixes

* remove unnecessary f

* coalesce strings

* remove comma

* remove extra commas

* Apply suggestions from code review

Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>

* set _use_new_zipfile_serialization to False only for pytorch 1.6.0

* remove unnecessary comments

* flake8 fixes

* use pkg_resources instead of packaging

* readme

* format

* version

* chlog

Co-authored-by: Peter Yu <peter@asapp.com>
Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>
2020-07-31 11:18:32 +02:00
William Falcon bc9348f2c4
Update README.md 2020-07-28 11:43:47 -04:00
William Falcon f770a91864
Update README.md 2020-07-28 11:37:48 -04:00
William Falcon 37d1bc6a42
Update README.md 2020-07-28 10:30:32 -04:00
William Falcon fa16624cc2
Update README.md 2020-07-28 10:28:59 -04:00
Jirka Borovec 590e7fb1fd
tests: add default_root_dir=tmpdir (#2392)
* tests: add default_root_dir=tmpdir

* remove duplicate tmpdir args

* add missing fixture

* test requires multi gpu

* typo

* resize

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-07-28 09:47:53 -04:00
Rohit Gupta e9ed9b72dc
Add Rohit (rohitgr7) to core (#2706) 2020-07-25 23:10:09 +02:00
Peter Yu 4bf1918b3a
Add Peter Yu (yukw777) to core maintainers (#2690) 2020-07-25 17:22:08 +02:00
krfricke 816d8cff06
[docs] add ray tune tutorial link to sidebar and readme (#2648)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-20 16:24:17 -04:00
Tushar Jain 7b4db3045d
Add Transformers Question Answering to community examples (#2603)
* Update index.rst

Add QA Finetuning in community examples.

* Update README.md
2020-07-15 11:26:30 +02:00
William Falcon 92d6abcbb9
0.8.5 (#2573)
* remove grad scaling tpu

* remove grad scaling tpu
2020-07-09 22:00:23 -04:00
Jirka Borovec 39a6435726
Revert "Revert "join coverage (#2460)" (#2499)" (#2500)
This reverts commit 355918af8d.
2020-07-04 11:31:12 -04:00
William Falcon 355918af8d
Revert "join coverage (#2460)" (#2499)
This reverts commit 944ffba305.
2020-07-04 10:29:50 -04:00
Jirka Borovec 944ffba305
join coverage (#2460)
* join coverage

* full TPU test

* codecov

* typo

* report

* docker

* timeout

* base

* show

* cd dir

* req

* docker

* docker

* docker

* coverage

* upload

* drop main

* report

* report

* python

* upload

* drone

* drone

* drone

* drone

* drone

* drone

* drone

* drone

* drone
2020-07-04 10:22:58 -04:00
zcain117 1a40963d1d
Add Github Action to run TPU tests. (#2376)
* Add Github Action to run TPU tests.

* Trigger new Github Actions run.

* Clean up more comments.

* Use different fixed version of ml-testing-accelerators and update config to match.

* use cluster in us-central1-a

* Run 'gcloud logging read' directly without 'echo' to preserve newlines.

* cat coverage.xml on the TPU VM side and upload xml on the Github Action side

* Use new commit on ml-testing-accelerators so command runs fully.

* Preserve newlines in the xml and use if: always() temporarily to upload codecov

* Use pytorch_lightning for coverage instead of pytorch-lightning

* Remove the debug cat of coverage xml

* Apply suggestions from code review

* jsonnet rename

* name

* add codecov flags

* add codecov flags

* codecov

* codecov

* revert codecov

* Clean up after apt-get and remove old TODOs.

* More codefactor cleanups.

* drone

* drone

* disable codecov

* cleaning

* docker py versions

* docker py 3.7

* readme

* bash

* docker

* freeze conda

* py3.6

* Stop using apt-get clean.

* Dont rm pytorch-lightning

* Update docker/tpu/Dockerfile

* Longer timeout in the Github Action to wait for GKE to finish.

* job1

* job2

* job3

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-07-01 21:44:19 -04:00
Jirka Borovec 7f1eab4cad
try adding coverage (#2441)
* add coverage, test failing

* fix test

* badges

* typo

* freeze conda
2020-07-01 08:00:36 -04:00
Jirka Borovec 695e0514f8
cleaning (#2449) 2020-07-01 07:56:10 -04:00
Jirka Borovec d4a02e3bd8
tests: drop CircleCI (#2412)
* drop CircleCI

* add PT testing

* fix

* cpu

* conda

* conda

* req

* base

* conda

* conda

* conda

* conda

* conda

* conda

* conda

* name

* req

* info

* tests

* pt 1.6

* drop 1.6

* info
2020-06-30 10:56:05 -04:00
Jirka Borovec 02d6045cac
release (#2414) 2020-06-29 07:21:28 -04:00
Jirka Borovec 3ff695510e
missing changes (#2283)
* missing

* RC1

* RC1

* format
2020-06-29 06:34:19 -04:00
William Falcon 58f03f3076
Update README.md 2020-06-28 22:44:58 -04:00
Jirka Borovec 41f5df18a4
move Trains logger to Bolts (#2384)
* move Trains logger

* chlog
2020-06-27 09:14:05 -04:00
William Falcon 0a092f6683
making optimization steps for hooks (#2363)
*simplified optimizer step and zero grad overriding
2020-06-25 16:02:16 -04:00
davinnovation b6ab7ca121
[docs] add community example : pl + ms nni (#2340)
https://github.com/PyTorchLightning/pytorch-lightning/issues/2329
2020-06-24 23:13:49 -04:00
William Falcon b2dd1a35aa
Update README.md 2020-06-19 02:50:30 -04:00
William Falcon 0b0c292cb9
Update README.md 2020-06-18 17:55:35 -04:00
Jirka Borovec 596a5d771f
Docs new section (#2236)
* chlog

* docs

* ver++

* docs

* url

* docs

* readme

* docs ---
2020-06-18 17:54:29 -04:00
William Falcon 34783781d2
Update README.md 2020-06-18 09:48:54 -04:00
Jirka Borovec a2d3ee80ad
final cleanup for v0.8.0 (#2181)
* final clean for v0.8.0

* chlog

* chlog

* date

* rename stage

* date

* missing
2020-06-18 07:21:44 -04:00
William Falcon 62029c17ee
Update README.md 2020-06-17 15:56:19 -04:00
Adrian Wälchli ff45842041
README typo (#2177) 2020-06-15 19:41:51 -04:00
William Falcon 49b2424e6e
Update README.md 2020-06-09 07:43:33 -04:00
William Falcon 3f71f0ce29
Update README.md 2020-06-09 07:30:38 -04:00
William Falcon db0c94e4a4
Update README.md 2020-06-09 07:30:10 -04:00
Tushar Jain 8d3d471f03
Update README.md (#2117) 2020-06-09 07:09:43 -04:00
edenlightning 9e8716afe8
Update Readme with tunning overhead time (#2082) 2020-06-08 07:26:58 -04:00
Adrian Wälchli 1f95fb9af7
update readme with conda installation instruction (#2099)
* update readme with conda installation instruction

* fix team header

* bibtex spelling

* Update README.md

Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-06-08 07:22:54 -04:00
Jirka Borovec c09317e68f
cleaning (#2030)
* cleaning

* optim imports

* fix

* typo

* on

* mergify
2020-06-04 11:25:07 -04:00
kumuji fd7814d287
Added black formater for the code with code-checker on pull (#1610)
* black

Added throught black.toml other options are hard so far

No caching for black github action

Moved from black.toml to pyproject.toml

Exclude not only yml but also yaml

Update pyproject.toml

Co-authored-by: Thomas Johansen <thomasjo@gmail.com>

Update .github/workflows/code-formatting-check.yml

mergify

Remove formating check

E231 error ignoring because of black formating

Updated CONTRIBUTING to the master

* Update .github/workflows/code-formatting-check.yml

* Bump black to 19.10b0 version

* resolved incorrect merge of CONTRIBUTING,

Black skipping string normalization

* Minor fixes in CONTRIBUTING, two typos

* Update setup.cfg

* chlog

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-06-03 18:23:14 +02:00
Jirka Borovec 5d93d57573
Tests/drop macos py38 (#2061)
* tests drop macOS py38

* ignore single test

* try freeze env

* drop

* drop

* drop

* drop

* drop skips

* imports

* fix
2020-06-03 08:38:56 -04:00
Jirka Borovec b4eb6ef5a1
tests drop macOS py38 (#2054)
* tests drop macOS py38

* ignore single test

* try freeze env

* drop

* drop

* drop

* drop

* drop skips

* drop macOS py38

* imports
2020-06-03 06:48:20 -04:00
Jirka Borovec 033ddc0c29
update min req (#1934) 2020-05-25 07:43:17 -04:00
Nicki Skafte a20db4e4a2
readme (#1931)
* readme

* add governance.rst

Co-authored-by: Nicki Skafte <nugginea@gmail.com>
2020-05-23 16:38:37 +01:00
Jirka Borovec d610f3bb53
set min PT 1.3 (#1917)
* set min PT 1.3

* circleCI

* mergify

* min

* chlog

* skip
2020-05-22 07:14:08 -04:00
Jirka Borovec c717873d26
fix syntax issue (#1900) 2020-05-20 07:46:18 -04:00
Justus Schock 9b629637b8
New metric classes (#1326) (#1877)
* New metric classes (#1326)

* Create metrics package

* Create metric.py

* Create utils.py

* Create __init__.py

* add tests for metric utils

* add docstrings for metrics utils

* add function to recursively apply other function to collection

* add tests for this function

* update test

* Update pytorch_lightning/metrics/metric.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* update metric name

* remove example docs

* fix tests

* add metric tests

* fix to tensor conversion

* fix apply to collection

* Update CHANGELOG.md

* Update pytorch_lightning/metrics/metric.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* remove tests from init

* add missing type annotations

* rename utils to convertors

* Create metrics.rst

* Update index.rst

* Update index.rst

* Update pytorch_lightning/metrics/convertors.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/metrics/convertors.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/metrics/convertors.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/metrics/metric.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update tests/utilities/test_apply_to_collection.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update tests/utilities/test_apply_to_collection.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update tests/metrics/convertors.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Apply suggestions from code review

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* add doctest example

* rename file and fix imports

* added parametrized test

* replace lambda with inlined function

* rename apply_to_collection to apply_func

* Separated class description from init args

* Apply suggestions from code review

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* adjust random values

* suppress output when seeding

* remove gpu from doctest

* Add requested changes and add ellipsis for doctest

* forgot to push these files...

* add explicit check for dtype to convert to

* fix ddp tests

* remove explicit ddp destruction

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* move dtype device mixin to more general place

* refactor to general device dtype mixin

* add initial metric package description

* change default to none for mac os

* pep8

* fix import

* Update index.rst

* Update ci-testing.yml

* Apply suggestions from code review

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update CHANGELOG.md

* Update pytorch_lightning/metrics/converters.py

* readme

* Update metric.py

* Update pytorch_lightning/metrics/converters.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-05-19 11:05:07 -04:00
Lezwon Castelino 7c7e50ca47
Allow user to select individual TPU core to train on (#1729)
* added tpu_id

added tpu_id to mixins

* train on individual tpu

* parallel loader if tpu_id is None

* removed progress_bar_refresh_rate

* chlog

* replaced num_tpu_cores with tpu_cores

* set tpu_id to None if int

* changed num_tpu_cores to tpu_cores in docs

* updated docs

* updated __init__.py
removed self.tpu_id for ParallelLoader

* Update pytorch_lightning/trainer/__init__.py

* check if tpu_cores is a list

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* xla device conditional

* num_tpu_cores deprecation

* removed duplicate warning

* fixed pep8 error

* Revert "removed duplicate warning"

This reverts commit 8adb0a9b

* deprecated api update

* fixed recursion error

* fixed tests

* fixed flake errors

* removed current_tpu_index

* Update CHANGELOG.md

* Update trainer.py

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-05-17 16:30:54 -04:00
William Falcon d7f9c03663
Update README.md 2020-05-17 12:02:09 -04:00