Commit Graph

3211 Commits

Author SHA1 Message Date
William Falcon 6bcfa8b068
ref: merge backends x/n (#3482) 2020-09-12 16:28:29 -04:00
William Falcon 518a0c0e92
ref: merge backends x/n (#3480) 2020-09-12 15:27:11 -04:00
William Falcon 0045119b3f
ref: merge backends x/n (#3478)
* ref: merge backends x/n

* ref: merge backends x/n

* ref: merge backends x/n

* ref: merge backends x/n
2020-09-12 13:55:55 -04:00
William Falcon 00d155ae01
ref: merge backends x/n (#3477) 2020-09-12 12:36:55 -04:00
William Falcon 59d8472548
ref: slurm connector 1/n (#3476)
* ref: slurm connector 1/n

* ref: slurm connector 1/n

* ref: slurm connector 1/n

* ref: slurm connector 1/n
2020-09-12 11:07:15 -04:00
William Falcon cd16aa9854
ref: checkpoint connector methods 4/n (#3474)
* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n

* ref: checkpoint connector methods 4/n
2020-09-12 08:42:27 -04:00
William Falcon 4724cdf5e0 ref: checkpoint connector methods 3/n 2020-09-12 07:05:21 -04:00
William Falcon ff0064f956
ref: group connectors (#3472)
* ref: accelerator connector methods 3/n

* ref: accelerator connector methods 3/n
2020-09-11 23:33:09 -04:00
William Falcon dd324e4086
ref: accelerator connector methods x/n (#3470) 2020-09-11 22:25:48 -04:00
William Falcon de99222834
ref: accelerator connector methods x/n (#3469)
* ref: accelerator connector methods x/n

* ref: accelerator connector methods x/n
2020-09-11 21:52:22 -04:00
William Falcon f99e3d8743
Update __init__.py 2020-09-11 15:59:36 -04:00
William Falcon 9e33a720e3
forward key metrics (#3467) 2020-09-11 15:59:14 -04:00
ananthsub d1d48e2ea1
Fix trivial comparison in model checkpoint test (#3464)
We were comparing keys across the same checkpoint dict instead of ckpt_last vs ckpt_last_epoch

All other changes here are formatting
2020-09-11 20:50:46 +02:00
William Falcon ef20310873
ref: move specific accelerator code x/n (#3457)
* ref: organize args x/n

* ref: move specific accelerator code x/n

* ref: move specific accelerator code x/n

* ref: move specific accelerator code x/n
2020-09-11 10:56:21 -04:00
Adrian Wälchli bd5f53c519
implement fix and test (#3459) 2020-09-11 10:55:58 -04:00
Nicki Skafte 93cf6d0054
[Metrics] class based embedding similarity + tests (#3358)
* embedding similarity class + test

* fix tests

* fix pep8

* add docs

* noindex

* Update docs/source/metrics.rst

* Update pytorch_lightning/metrics/self_supervised.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Update pytorch_lightning/metrics/self_supervised.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* suggestions

* changes to init

* move __all__

* fix imports

* Apply suggestions from code review

* assert typo

* change import

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
2020-09-11 12:11:50 +02:00
William Falcon 70af47db84
ref: organize args 4/n (#3456) 2020-09-10 21:58:47 -04:00
William Falcon 1fab33030f
Update __init__.py 2020-09-10 19:56:03 -04:00
Jirka Borovec a81ca4d1c1
drop nb sphinx (#3452) 2020-09-10 19:51:09 -04:00
Cookie_thief d05d4c78e1
add num_classes argument to confusion matrix (#3450)
* add num_classes arg to confusion matrix

* update ConfusionMatrix test

* final update)
2020-09-10 18:39:04 -04:00
Jirka Borovec cbc4f6f8a4
add CI for building dockers (#3383)
* rename

* fix badges

* add docker build

* mergify

* update

* env

* ci

* times

* CI

* name

* comment
2020-09-10 18:38:29 -04:00
Rohit Gupta a1ea681c47
Fix batch_outputs with optimizer frequencies (#3229)
* Fix batch_outputs with optimizers frequencies

* optimizers

* fix batch_outputs with optimizer frequencies

* clean test

* suggestion

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* chlog

* failing doctest

* failing doctest

* update doctest

* chlog

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-09-10 23:01:20 +02:00
William Falcon 3281586ab4
ref: organize args 3/n (#3449)
* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n

* ref: organize args 3/n
2020-09-10 13:21:04 -04:00
William Falcon a208d6da46
ref: organize args 2/n (#3448)
* ref: organize args 2/n

* ref: organize args 2/n

* ref: organize args 2/n
2020-09-10 10:51:35 -04:00
David Waterworth 1255a8f738
Updated "Models defined by data" (#3433)
* Updated "Models defined by data"

* Fixed WARNING: Inline substitution_reference start-string without end-string.

Co-authored-by: David Waterworth <david.waterworth@cim.io>
2020-09-10 09:22:27 -04:00
Alexander 19c0c2e091
Fix Train result in val and test steps doc (#3440) 2020-09-10 09:21:11 -04:00
William Falcon 541c4ab01d
ref: organize args 3/n (#3447)
* ref: organize args 2/n

* ref: organize args 2/n

* ref: organize args 2/n

* ref: organize args 2/n
2020-09-10 08:55:30 -04:00
William Falcon deb82d9c08
ref: organize args 2/n (#3442)
* ref: organize args 2/n

* ref: organize args 2/n
2020-09-10 08:07:55 -04:00
William Falcon 49290a569b
ref: organize args 1/n (#3435)
* ref: organize args 1/n

* ref: organize args 1/n
2020-09-10 07:24:42 -04:00
Aashish Pawar ⚡ 0b5f417dfd
📝Update Readme.md (Code Error Minimal Example) (#3416)
* 📝Update Readme.md (Code Error Minimal Example)

to use gpus we need to use
```
trainer = pl.Trainer(max_epochs=1, gpus=8)
```
but In readme only Trainer() is used

* 📝Update Readme.md(added import in GPU/TPU stmts)

* 📝Update Readme.md ( Added Import to all imports)

as per the suggestion from @awaelchli

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-09-10 09:14:49 +00:00
William Falcon 5abf7d9123
ref: move lr_finder (#3434)
* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder

* ref: move lr_finder
2020-09-09 22:12:27 -04:00
William Falcon 435e479bbd
ref: separate properties (#3432)
* ref: separate properties

* ref: separate properties

* ref: separate properties

* ref: separate properties
2020-09-09 20:03:18 -04:00
William Falcon 9696484153
ref: separate argparse (#3428) 2020-09-09 18:07:56 -04:00
Mario Ishac f7dac3ff6c
make PyTorch Lightning PEP 561 Compliant (#3187)
* Added py.typed.

* Move py.typed inclusion to MANIFEST.in

* Added path separator for inclusion
2020-09-09 13:37:03 -04:00
William Falcon b36c5e86d0
ref: trainer argparse 1/n (#3421)
* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n

* ref: trainer argparse 1/n
2020-09-09 12:31:17 -04:00
Jirka Borovec d2e1d16b61
license (#3423) 2020-09-09 12:14:59 -04:00
Alexander 5b4db52851
Fix #3417 (#3419) 2020-09-09 09:27:35 -04:00
William Falcon cb791dcfb6
ref: separate trainer docstrings poc (#3418)
* ref: trainer 1/n

* ref: separate trainer docstrings poc

* ref: separate trainer docstrings poc

* ref: separate trainer docstrings poc

* ref: separate trainer docstrings poc
2020-09-09 08:45:21 -04:00
William Falcon 10cf86b94b
ref: trainer 1/n (#3412)
* ref: moved eval loop 2/n

* ref: moved eval loop 2/n

* ref: trainer 1/n

* ref: trainer 1/n

* ref: trainer 1/n
2020-09-09 08:45:04 -04:00
Jirka Borovec cd40cb2fad
ignore types in files (#3409)
* ignore types in files

* CI timeout
2020-09-09 07:11:53 -04:00
Patrick Orlando 656c1af0df
Get experiment_id from MLFlow only once instead of each training loop (#3394)
* Get experiment_id from MLFlow only once instead of each training loop.

* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* add test that asserts mlflow client is called to retrieve experiment id only once

* make pep8 happy

* logs

Co-authored-by: Patrick Orlando <patrick.orlando@rea-group.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-09-09 11:38:26 +02:00
Adrian Wälchli e245065fbc
limit auto scaling batch size to the size of the training dataset (#3271)
* fix

* fix and test

* fix merge error

* test for max dataset size

* changelog

* update docs

* fix merge

* unused imports

* imports
2020-09-09 10:51:43 +02:00
William Falcon 0c2e315950
ref: moved eval loop logging to loggers 1/n (#3408) 2020-09-09 01:05:50 -04:00
William Falcon 8f6b115511
ref: added model connector (#3407)
* ref: added model connector

* ref: added model connector

* ref: added model connector
2020-09-09 00:24:20 -04:00
William Falcon 722c44c7d0
ref: device to gpus (#3405)
* ref: device to gpus

* ref: device to gpus

* ref: device to gpus

* ref: device to gpus

* ref: device to gpus
2020-09-08 22:14:17 -04:00
Travis Addair 091d37f968
Added check for apex AMP and unit tests for Horovod + AMP (#3404)
* Added check for apex AMP and unit tests for Horovod + AMP

* Changelog

* Fixed order of Horovod and Apex optimizer wrapping
2020-09-08 20:30:57 -04:00
William Falcon aaf26d70c4
ref: device parser (#3400)
* ref: train loop refactors part 2: 1/n

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser

* ref: device parser
2020-09-08 18:46:42 -04:00
William Falcon ff5f099cb7
ref: remove inner train loop 1/n (#3397)
* ref: remove inner train loop 1/n

* ref: remove inner train loop 1/n
2020-09-08 12:05:00 -04:00
William Falcon 701ca8b549
ref: all logging related calls in a connector 1/n (#3395)
* ref: all results+dict actions in a connector 1/n

* ref: all results+dict actions in a connector 2/n

* ref: all results+dict actions in a connector 2/n

* ref: all results+dict actions in a connector 2/n
2020-09-08 09:06:11 -04:00
William Falcon d438ad8a8d
ensure calling test multiple times does not change results (#3391) 2020-09-07 22:25:12 -04:00