Commit Graph

3062 Commits

Author SHA1 Message Date
William Falcon d438ad8a8d
ensure calling test multiple times does not change results (#3391) 2020-09-07 22:25:12 -04:00
Ibraheem Moosa 306d55c7f8
Fix sample code of LightningModule DataLoaders (#3360)
* Fix sample code of LightningModule DataLoaders

In the LightningModule DataLoaders sample code the train `DataLoader` is again passed to `DataLoader` constructor which is incorrect.

* Pass transform to MNIST dataset in documenattion.

* Apply suggestions from code review

* minor changes

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-09-08 01:24:05 +02:00
William Falcon b76d9e5dd5
Refa22 (#3388)
* ref: inner train loop (intermediate step) 20/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n

* ref: inner train loop (intermediate step) 21/n
2020-09-07 16:45:31 -04:00
William Falcon 7e874d70d6
ref: inner train loop (intermediate step) 19/n (#3385)
* ref: inner train loop (intermediate step) 19/n

* Update debugging.py

* ref: inner train loop (intermediate step) 19/n
2020-09-07 11:55:14 -04:00
William Falcon 0b5b70d6c9
ref: inner train loop (intermediate step) 17/n (#3376)
* ref: inner train loop (intermediate step) 17/n

* ref: inner train loop (intermediate step) 17/n

* ref: inner train loop (intermediate step) 17/n
2020-09-07 09:31:42 -04:00
Sergiu Danalachi b4256df121
Use full yaml loader (load is deprecated) (#3357) 2020-09-07 10:00:35 +02:00
William Falcon 69e3f904df
ref: inner train loop (intermediate step) 16/n (#3375)
* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n

* ref: inner train loop (intermediate step) 16/n
2020-09-06 21:57:20 -04:00
William Falcon bce5c81f3a ref: inner train loop (intermediate step) 16/n 2020-09-06 20:48:29 -04:00
William Falcon 60a3e28fd8
ref: inner train loop (intermediate step) 15/n (#3374)
* ref: inner train loop (intermediate step) 15/n

* ref: inner train loop (intermediate step) 15/n
2020-09-06 20:38:31 -04:00
William Falcon 7073de8a95
ref: inner train loop (intermediate step) 14/n (#3373)
* ref: inner train loop (intermediate step) 14/n

* ref: inner train loop (intermediate step) 14/n
2020-09-06 19:55:18 -04:00
William Falcon 9939f53b7c
ref: inner train loop (intermediate step) 12/n (#3372)
* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n
2020-09-06 17:50:47 -04:00
William Falcon d091fafc12
ref: inner train loop (intermediate step) 12/n (#3371)
* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n

* ref: inner train loop (intermediate step) 12/n
2020-09-06 13:31:00 -04:00
William Falcon 8eef97c76f
ref: inner train loop (intermediate step) 11/n (#3370)
* ref: inner train loop (intermediate step) 11/n

* ref: inner train loop (intermediate step) 11/n
2020-09-06 12:49:12 -04:00
William Falcon 85421466ab
ref: inner train loop (intermediate step) 10/n (#3369) 2020-09-06 08:59:58 -04:00
William Falcon b375a2646c
ref: inner train loop (intermediate step) 9/n (#3368)
* ref: inner train loop (intermediate step) 9/n

* ref: inner train loop (intermediate step) 9/n

* ref: inner train loop (intermediate step) 9/n

* ref: inner train loop (intermediate step) 9/n
2020-09-06 08:04:08 -04:00
William Falcon df7e064ab3
ref: inner train loop (intermediate step) 8/n" (#3367)
* ref: inner train loop (intermediate step) 7/n

* ref: inner train loop (intermediate step) 8/n
2020-09-05 20:00:20 -04:00
William Falcon dcbfd09ee8
ref: inner train loop (intermediate step) 6/n (#3366)
* ref: inner train loop (intermediate step) 6/n

* ref: inner train loop (intermediate step) 6/n

* ref: inner train loop (intermediate step) 6/n
2020-09-05 19:17:19 -04:00
William Falcon 38b9677638
ref: inner train loop (intermediate step) 5/n (#3365) 2020-09-05 18:27:28 -04:00
William Falcon c7ef5ee874
ref: inner train loop (intermediate step) 3/n (#3363) 2020-09-05 17:01:46 -04:00
William Falcon 4b52142988
ref: inner train loop (intermediate step) 3/n (#3362)
* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n

* ref: inner train loop (intermediate step) 3/n
2020-09-05 15:08:58 -04:00
William Falcon f55efb7616
ref: inner train loop (intermediate step) 1/n (#3361) 2020-09-05 10:10:49 -04:00
William Falcon 5a474c452c
ref: inner train loop (intermediate step) 1/n (#3359) 2020-09-05 08:55:22 -04:00
William Falcon 43b8d62ccb
Update README.md 2020-09-05 08:07:03 -04:00
Will Price 64ee25ed9c
Correct documentation examples of `optimizer_step` (#3326)
* Correct documentation examples of `optimizer_step`

Without the default arguments set in `optimizer_step` the examples fail due to the arguments not being provided

* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-09-04 18:57:21 +02:00
William Falcon 227959b3df
added emb similarity (#3349) 2020-09-04 09:45:21 -04:00
Adrian Wälchli 7bd2f946d9
Ref: Pull duplicate data interface definition up into DataHooks class (#3344)
* pull data hooks up into a common interface

* fix multiple inheritance ordering

* docs reference datahooks
2020-09-04 06:04:45 -04:00
Rohit Gupta 24809b0b26
Refactor GPUStatsMonitor to improve training speed (#3257)
* Refactor GPUMonitor to improve training speed

* added gpu ids to monitor

* update tests

* added deprecation warning

* pep

* fix test

* fix docs

* fix log_gpu_memory

* move deprecation check

* chlog

* Update CHANGELOG.md

* suggestions and fix

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-09-04 06:02:16 -04:00
Charles Catta 22045b12b1
Fix non autoplaying videos on Safari iOS (#3343) 2020-09-04 08:49:14 +02:00
Adrian Wälchli 48c22c8bad
update batch size in DataModule when auto scaling batch size (#3266)
* fix datamodule hasattr

* fix patch check

* fix setattr

* update docs

* revert patch fix

* changelog

* fix datamodule passed in as fit arg

* docs

* set datamodule batch size in lightning_setattr

* fix merge

* check with has_attr

* access datamodule via trainer

* pass fit args down to tuner

* docs

* fix typos in docs

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-09-03 22:07:49 +02:00
Adrian Wälchli 4ad5a78dce
to_torchscript method for LightningModule (#3258)
* script

* docs

* simple test

* move test

* fix doctest

* no grad context

* extend tests


test


test

* datamodule test

* clean up test

* docs

* name

* fix import

* update changelog

* fix import

* skip pytorch 1.3 in test

* update codeblock

* skip bugged 1.4

* typehints

* doctest not working on all pytorch versions

* rename TestGAN to prevent pytest interference

* add note about pytorch version

* fix torchscript version inconsistency in tests

* reset training state + tests

* update docstring

* Apply suggestions from code review

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* update docstring, dict return

* add docs to index

* add link

* doc eval mode

* forward

* optional save to file path

* optional

* test torchscript device

* test save load with file path

* pep

* str

* Commit typing suggestion

Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>

* skip test if cuda not available

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2020-09-03 20:24:44 +02:00
Rohit Gupta 4a22fca524
Changed LearningRateLogger to LearningRateMonitor (#3251)
* Change LearningRateLogger to LearningRateMonitor

* file rename

* docs

* add LearningRateLogger with deprecation warning

* deprecated LearningRateLogger

* move deprecation check

* chlog

Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-09-03 18:17:15 +00:00
Brendan Fahy 2d8c1b7c54
use fsspec instead of gfile for all IO (#3320)
* use fsspec instead of gfile for all IO

This better supports remote (and local) file operations with a dedicated package

* Apply suggestions from code review

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* chlog

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-09-03 14:19:20 +02:00
HT Liu d521c1b178
Fix: gather_all_tensors cross GPUs in DDP (#3319)
* Fix: gather_all_tensors cross GPUs in metrics

* add a test case for gather_all_tensors_ddp in #3253
2020-09-03 12:27:32 +02:00
nithin varghese ee72271d20
Docs/improved multigpu doc clarity (#3194)
* + clarifying doc

* improved documentation clarity

* docs minor correction

* remove device from type_as

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-09-02 17:57:56 +02:00
Jeff Yang b951097758
Add conda version/downloads, discourse badges to readme (#3247)
* add conda badge to readme

* Update README.md

* Update README.md

* Apply suggestions from code review

* make same color with `pypi package`

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-09-02 15:50:02 +00:00
s-rog 65e6687c54
Fix (weights only) checkpoints loading without pl (#3287)
* cast pl AttributeDict to dict

* fix for omegaconf
2020-09-02 15:36:42 +02:00
William Falcon f747cb6843
ref: moving train loop to own object 2/n (intermediate steps) (#3314)
* ref: moving train loop to own object 2/n (intermediate steps)

* ref: moving train loop to own object 2/n (intermediate steps)
2020-09-01 22:06:15 -04:00
William Falcon 0d90d53a81
ref: moving train loop to own object 2/n (intermediate steps) (#3313)
* ref: moving train loop to own object 2/n (intermediate steps)

* ref: moving train loop to own object 2/n (intermediate steps)
2020-09-01 21:06:40 -04:00
William Falcon a5288fea1a
ref: moving train loop to own object (intermediate steps) (#3312)
* ref: moving train loop to own object (intermediate steps)

* ref: moving train loop to own object (intermediate steps)

* ref: moving train loop to own object (intermediate steps)

* ref: moving train loop to own object (intermediate steps)
2020-09-01 18:03:28 -04:00
William Falcon 60d50f646e
ref: train loop refactor (mid-step) (#3310) 2020-09-01 16:32:54 -04:00
William Falcon 0a119403d6
ref: moved accelerator router (#3309)
* ref: moved accelerator

* ref: moved accelerator

* ref: moved accelerator

* ref: moved accelerator
2020-09-01 15:48:28 -04:00
Nicki Skafte b66ce88f0d
[metrics] Renaming of precision recall metric (#3308)
* rename metrics

* update docs
2020-09-01 14:59:33 -04:00
William Falcon 7d57f8d407
ref: move prepare_data to data connector (#3307)
* ref: moved argparse code to central class

* ref: moved argparse code to central class

* ref: moved argparse code to central class
2020-09-01 14:59:09 -04:00
Lezwon Castelino 3910ad0330
bugfix/3185 transpose (#3252)
* change t() to transpose() as xla devices do not support .t() on 1-dim tensor

* detach tensor before copying

* Revert "detach tensor before copying"

This reverts commit 37cc7bbe

* changed dims

* added test_result_obj_on_tpu

* detach before copying

* detach before copying

* detach before copying

* replace torch.cat with sum
2020-09-01 09:17:52 -04:00
Suraj Donthi 8354c4ad6d
Added missing term 'Data' in 'LigthningModuleAPI' (#3284)
* Added missing term 'Data' in 'LigthningModuleAPI'

This could be a possible typo!

* Update datamodules.rst

Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-09-01 11:40:21 +02:00
Zach Rothenberg cecad9f3ef
distinguished between overfit_batches examples (#3298)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-09-01 09:08:18 +00:00
Sumanth Ratna b22a65e2fe
Fix typo in results.rst (#3277) 2020-09-01 09:58:49 +02:00
William Falcon b0298cead8
ref: move train outside of setup training (#3297)
* ref: move train outside of setup training

* ref: move train outside of setup training

* ref: move train outside of setup training

* ref: move train outside of setup training
2020-08-31 20:36:52 -04:00
William Falcon bcd13f70b8
ref: run_pretrain_routine -> setup_training (#3294)
* ref: .tune()

* ref: run_pretrain_routine -> setup_training
2020-08-31 18:06:11 -04:00
William Falcon 805ff37e8c
ref: .tune() (temporary) (#3293)
* ref: .tune()

* ref: .tune()

* ref: .tune()

* ref: .tune()

* ref: .tune()

* ref: .tune()
2020-08-31 17:36:09 -04:00