Commit Graph

3090 Commits

Author SHA1 Message Date
Rohit Gupta a1ea681c47
Fix batch_outputs with optimizer frequencies (#3229)
* Fix batch_outputs with optimizers frequencies

* optimizers

* fix batch_outputs with optimizer frequencies

* clean test

* suggestion

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* chlog

* failing doctest

* failing doctest

* update doctest

* chlog

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-09-10 23:01:20 +02:00
William Falcon 3281586ab4
ref: organize args 3/n (#3449)
* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n
2020-09-10 13:21:04 -04:00
William Falcon a208d6da46
ref: organize args 2/n (#3448)
* ref: organize args 2/n

* ref: organize args 2/n

* ref: organize args 2/n
2020-09-10 10:51:35 -04:00
David Waterworth 1255a8f738
Updated "Models defined by data" (#3433)
* Updated "Models defined by data"

* Fixed WARNING: Inline substitution_reference start-string without end-string.

Co-authored-by: David Waterworth <david.waterworth@cim.io>
2020-09-10 09:22:27 -04:00
Alexander 19c0c2e091
Fix Train result in val and test steps doc (#3440) 2020-09-10 09:21:11 -04:00
William Falcon 541c4ab01d
ref: organize args 3/n (#3447)
* ref: organize args 2/n

* ref: organize args 2/n

* ref: organize args 2/n

* ref: organize args 2/n
2020-09-10 08:55:30 -04:00
William Falcon deb82d9c08
ref: organize args 2/n (#3442)
* ref: organize args 2/n

* ref: organize args 2/n
2020-09-10 08:07:55 -04:00
William Falcon 49290a569b
ref: organize args 1/n (#3435)
* ref: organize args 1/n

* ref: organize args 1/n
2020-09-10 07:24:42 -04:00
Aashish Pawar ⚡ 0b5f417dfd
📝Update Readme.md (Code Error Minimal Example) (#3416)
* 📝Update Readme.md (Code Error Minimal Example)

to use gpus we need to use
```
trainer = pl.Trainer(max_epochs=1, gpus=8)
```
but In readme only Trainer() is used

* 📝Update Readme.md(added import in GPU/TPU stmts)

* 📝Update Readme.md ( Added Import to all imports)

as per the suggestion from @awaelchli

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-09-10 09:14:49 +00:00
William Falcon 5abf7d9123
ref: move lr_finder (#3434)
* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder
2020-09-09 22:12:27 -04:00
William Falcon 435e479bbd
ref: separate properties (#3432)
* ref: separate properties

* ref: separate properties

* ref: separate properties

* ref: separate properties
2020-09-09 20:03:18 -04:00
William Falcon 9696484153
ref: separate argparse (#3428) 2020-09-09 18:07:56 -04:00
Mario Ishac f7dac3ff6c
make PyTorch Lightning PEP 561 Compliant (#3187)
* Added py.typed.

* Move py.typed inclusion to MANIFEST.in

* Added path separator for inclusion
2020-09-09 13:37:03 -04:00
William Falcon b36c5e86d0
ref: trainer argparse 1/n (#3421)
* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n
2020-09-09 12:31:17 -04:00
Jirka Borovec d2e1d16b61
license (#3423) 2020-09-09 12:14:59 -04:00
Alexander 5b4db52851
Fix #3417 (#3419) 2020-09-09 09:27:35 -04:00
William Falcon cb791dcfb6
ref: separate trainer docstrings poc (#3418)
* ref: trainer 1/n

* ref: separate trainer docstrings poc

* ref: separate trainer docstrings poc

* ref: separate trainer docstrings poc

* ref: separate trainer docstrings poc
2020-09-09 08:45:21 -04:00
William Falcon 10cf86b94b
ref: trainer 1/n (#3412)
* ref: moved eval loop 2/n

* ref: moved eval loop 2/n

* ref: trainer 1/n

* ref: trainer 1/n

* ref: trainer 1/n
2020-09-09 08:45:04 -04:00
Jirka Borovec cd40cb2fad
ignore types in files (#3409)
* ignore types in files

* CI timeout
2020-09-09 07:11:53 -04:00
Patrick Orlando 656c1af0df
Get experiment_id from MLFlow only once instead of each training loop (#3394)
* Get experiment_id from MLFlow only once instead of each training loop.

* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* add test that asserts mlflow client is called to retrieve experiment id only once

* make pep8 happy

* logs

Co-authored-by: Patrick Orlando <patrick.orlando@rea-group.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-09-09 11:38:26 +02:00
Adrian Wälchli e245065fbc
limit auto scaling batch size to the size of the training dataset (#3271)
* fix

* fix and test

* fix merge error

* test for max dataset size

* changelog

* update docs

* fix merge

* unused imports

* imports
2020-09-09 10:51:43 +02:00
William Falcon 0c2e315950
ref: moved eval loop logging to loggers 1/n (#3408) 2020-09-09 01:05:50 -04:00
William Falcon 8f6b115511
ref: added model connector (#3407)
* ref: added model connector

* ref: added model connector

* ref: added model connector
2020-09-09 00:24:20 -04:00
William Falcon 722c44c7d0
ref: device to gpus (#3405)
* ref: device to gpus

* ref: device to gpus

* ref: device to gpus

* ref: device to gpus

* ref: device to gpus
2020-09-08 22:14:17 -04:00
Travis Addair 091d37f968
Added check for apex AMP and unit tests for Horovod + AMP (#3404)
* Added check for apex AMP and unit tests for Horovod + AMP

* Changelog

* Fixed order of Horovod and Apex optimizer wrapping
2020-09-08 20:30:57 -04:00
William Falcon aaf26d70c4
ref: device parser (#3400)
* ref: train loop refactors part 2: 1/n

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser
2020-09-08 18:46:42 -04:00
William Falcon ff5f099cb7
ref: remove inner train loop 1/n (#3397)
* ref: remove inner train loop 1/n

* ref: remove inner train loop 1/n
2020-09-08 12:05:00 -04:00
William Falcon 701ca8b549
ref: all logging related calls in a connector 1/n (#3395)
* ref: all results+dict actions in a connector 1/n

* ref: all results+dict actions in a connector 2/n

* ref: all results+dict actions in a connector 2/n

* ref: all results+dict actions in a connector 2/n
2020-09-08 09:06:11 -04:00
William Falcon d438ad8a8d
ensure calling test multiple times does not change results (#3391) 2020-09-07 22:25:12 -04:00
Ibraheem Moosa 306d55c7f8
Fix sample code of LightningModule DataLoaders (#3360)
* Fix sample code of LightningModule DataLoaders

In the LightningModule DataLoaders sample code the train `DataLoader` is again passed to `DataLoader` constructor which is incorrect.

* Pass transform to MNIST dataset in documenattion.

* Apply suggestions from code review

* minor changes

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-09-08 01:24:05 +02:00
William Falcon b76d9e5dd5
Refa22 (#3388)
* ref: inner train loop (intermediate step) 20/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n
2020-09-07 16:45:31 -04:00
William Falcon 7e874d70d6
ref: inner train loop (intermediate step) 19/n (#3385)
* ref: inner train loop (intermediate step) 19/n

* Update debugging.py

* ref: inner train loop (intermediate step) 19/n
2020-09-07 11:55:14 -04:00
William Falcon 0b5b70d6c9
ref: inner train loop (intermediate step) 17/n (#3376)
* ref: inner train loop (intermediate step) 17/n

* ref: inner train loop (intermediate step) 17/n

* ref: inner train loop (intermediate step) 17/n
2020-09-07 09:31:42 -04:00
Sergiu Danalachi b4256df121
Use full yaml loader (load is deprecated) (#3357) 2020-09-07 10:00:35 +02:00
William Falcon 69e3f904df
ref: inner train loop (intermediate step) 16/n (#3375)
* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n
2020-09-06 21:57:20 -04:00
William Falcon bce5c81f3a ref: inner train loop (intermediate step) 16/n 2020-09-06 20:48:29 -04:00
William Falcon 60a3e28fd8
ref: inner train loop (intermediate step) 15/n (#3374)
* ref: inner train loop (intermediate step) 15/n

* ref: inner train loop (intermediate step) 15/n
2020-09-06 20:38:31 -04:00
William Falcon 7073de8a95
ref: inner train loop (intermediate step) 14/n (#3373)
* ref: inner train loop (intermediate step) 14/n

* ref: inner train loop (intermediate step) 14/n
2020-09-06 19:55:18 -04:00
William Falcon 9939f53b7c
ref: inner train loop (intermediate step) 12/n (#3372)
* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n
2020-09-06 17:50:47 -04:00
William Falcon d091fafc12
ref: inner train loop (intermediate step) 12/n (#3371)
* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n
2020-09-06 13:31:00 -04:00
William Falcon 8eef97c76f
ref: inner train loop (intermediate step) 11/n (#3370)
* ref: inner train loop (intermediate step) 11/n

* ref: inner train loop (intermediate step) 11/n
2020-09-06 12:49:12 -04:00
William Falcon 85421466ab
ref: inner train loop (intermediate step) 10/n (#3369) 2020-09-06 08:59:58 -04:00
William Falcon b375a2646c
ref: inner train loop (intermediate step) 9/n (#3368)
* ref: inner train loop (intermediate step) 9/n

* ref: inner train loop (intermediate step) 9/n

* ref: inner train loop (intermediate step) 9/n

* ref: inner train loop (intermediate step) 9/n
2020-09-06 08:04:08 -04:00
William Falcon df7e064ab3
ref: inner train loop (intermediate step) 8/n" (#3367)
* ref: inner train loop (intermediate step) 7/n

* ref: inner train loop (intermediate step) 8/n
2020-09-05 20:00:20 -04:00
William Falcon dcbfd09ee8
ref: inner train loop (intermediate step) 6/n (#3366)
* ref: inner train loop (intermediate step) 6/n

* ref: inner train loop (intermediate step) 6/n

* ref: inner train loop (intermediate step) 6/n
2020-09-05 19:17:19 -04:00
William Falcon 38b9677638
ref: inner train loop (intermediate step) 5/n (#3365) 2020-09-05 18:27:28 -04:00
William Falcon c7ef5ee874
ref: inner train loop (intermediate step) 3/n (#3363) 2020-09-05 17:01:46 -04:00
William Falcon 4b52142988
ref: inner train loop (intermediate step) 3/n (#3362)
* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n
2020-09-05 15:08:58 -04:00
William Falcon f55efb7616
ref: inner train loop (intermediate step) 1/n (#3361) 2020-09-05 10:10:49 -04:00
William Falcon 5a474c452c
ref: inner train loop (intermediate step) 1/n (#3359) 2020-09-05 08:55:22 -04:00