6ad27187f3
Finish PR #2432 : Imagenet example updates + basic testing ( #2889 )
...
* fix imagenet example: lr_scheduler, loader workers, batch size when ddp
* Fix evaluation for imagenet example
* add imagenet example test
* cleanup
* gpu
* add imagenet example evluation test
* fix test output
* test is fixed in master, remove unecessary hack
* CHANGE
* Apply suggestions from code review
* image net example
* update imagenet example
* update example
* pep
* imports
* type hint
* docs
* obsolete arg
* [wip] fix imagenet example: lr_scheduler, loader workers, batch size when ddp (#2432 )
* fix imagenet example: lr_scheduler, loader workers, batch size when ddp
* Fix evaluation for imagenet example
* add imagenet example test
* cleanup
* gpu
* add imagenet example evluation test
* fix test output
* test is fixed in master, remove unecessary hack
* CHANGE
* Apply suggestions from code review
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* update chlog
* add missing chlog
* pep
* pep
Co-authored-by: Ruotian Luo <rluo@ttic.edu>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-08-09 06:02:07 -04:00
256059a1d0
tracks all outputs including TBPTT and multiple optimizers ( #2890 )
...
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
* pl 0.9 update
2020-08-09 06:00:15 -04:00
4d0406ec8b
deepcopy model state_dict in tests ( #2887 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-08-08 16:13:06 +00:00
1bb268ad8a
Clarify what gpus=0 means in docs ( #2876 )
...
* docs clarify what gpus=0 means
* add example suggested by @ydcjeff
2020-08-08 11:50:08 -04:00
6ebe0d7266
Fix docstring ( #2884 )
...
* Fix docstring
"mean absolute loss" rather than "root mean absolute loss"
* minor docstring fix
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2020-08-08 11:58:18 +00:00
f798cffd02
save last model after saving top_k when save_last=True ( #2881 )
...
* save_last should be last
* changelog
* seed, docs
* retrigger ci
* compare filenames
* move constants
* fix test
* epoch, global step
* improve test
2020-08-08 06:02:43 -04:00
d9d7e91a3b
hotfix on classification metrics ( #2878 )
...
* Faster classfication stats
* Faster accuracy metric
* minor change on cls metric
* Add out-of-bound class clamping
* Add more tests and minor fixes
* Resolve code style warning
* Update for #2781
* hotfix
* Update pytorch_lightning/metrics/functional/classification.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update about conversation
* Add docstring on stat_scores_multiple_classes
* Fixing #2862
Co-authored-by: Younghun Roh <yhunroh@mindslab.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-08-08 06:01:38 -04:00
a6e7aa7796
allow using apex with any PT version ( #2865 )
...
* wip
* setup
* type
* name
* wip
* docs
* imports
* fix if
* fix if
* use_amp
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* fix tests
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* fix tests
* todos
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-08-08 11:07:32 +02:00
fed0ac838b
Fix Trainer arg name in docs ( #2879 )
...
* Fix Trainer arg name in docs
* Fix a PR comment
2020-08-08 07:52:35 +02:00
79c913bb36
Fix docs typo ( #2880 )
2020-08-08 07:51:21 +02:00
a59e140ee8
Add PL mastercalss to readme ( #2873 )
...
* Update index.rst
* add thumbanil
* update readme
* Update README.md
* Update index.rst
* image
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-08-08 00:21:51 +00:00
664258c825
Update __init__.py
2020-08-07 19:17:14 -04:00
aa6fe25436
Fix install setup - push pypi ( #2872 )
...
* fix setup install
* fix setup install
* 📝 edit docs install command
Co-authored-by: nateraw <nxr9266@g.rit.edu>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-08-07 19:02:38 -04:00
b7d72706c3
clean imports ( #2867 )
...
* clean imports
* miss
2020-08-08 00:33:51 +02:00
f8c058215f
simplify tests & cleaning ( #2588 )
...
* simplify
* tmpdir
* revert
* clean
* accel
* types
* test
* edit test acc
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update test acc
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-08-07 23:22:05 +02:00
78d6592464
Update index.rst ( #2870 )
2020-08-07 16:43:52 -04:00
aaeb848e5a
Update __init__.py
2020-08-07 10:27:10 -04:00
2cc60c625e
fix set_epoch on TPUs ( #2740 )
...
* fix https://github.com/PyTorchLightning/pytorch-lightning/issues/2622
* Update training_loop.py
2020-08-07 09:31:30 -04:00
f82d7feb6c
updated hooks ( #2850 )
...
* modified hooks
* modified hooks
* modified hooks
* modified hooks
* modified hooks
* modified hooks
* modified hooks
* modified hooks
* modified hooks
2020-08-07 09:29:57 -04:00
b39f4798a6
Add support to Tensorboard logger for OmegaConf hparams ( #2846 )
...
* Add support to Tensorboard logger for OmegaConf hparams
Address https://github.com/PyTorchLightning/pytorch-lightning/issues/2844
We check if we can import omegaconf, and if the hparams are omegaconf instances. if so, we use OmegaConf.merge to preserve the typing, such that saving hparams to yaml actually triggers the OmegaConf branch
* avalaible
* chlog
* test
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-07 09:13:21 -04:00
91b0d46cd5
do not fails all dockers ( #2861 )
2020-08-07 09:10:35 -04:00
ad956b5ed9
do not fails all dockers ( #2860 )
2020-08-07 14:14:22 +02:00
a642349228
Support limit_mode_batches (int) for infinite dataloader ( #2840 )
...
* Support limit_mode_batches(int) for infinite dataloader
* flake8
* revert and update
* add and update tests
* pep8
* chlog
* Update CHANGELOG.md
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Add suggestions by @awaelchli
* docs
* Apply suggestions from code review
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Apply suggestions from code review
* fix
* max
* check
* add and update tests
* max
* check
* check
* check
* chlog
* tests
* update exception message
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-07 13:02:36 +02:00
b37c35a8ff
Update CONTRIBUTING.md ( #2855 )
...
* Update CONTRIBUTING.md
Added docker option to testing section.
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-08-07 11:53:29 +02:00
234e2b590f
Use .comet.config file for CometLogger ( #1913 )
...
* Use .comet.config file or env var for API key.
* Make CometLogger API key changes backwards compatible.
* Fix line too long.
* Add documentation about loading from ~/.comet_config.
* Update required comet_ml version.
* Comet logger: allow offline experiments with config file.
This adds a new argument to the logger to control the online / offline mode explicitly so that if you give an API key and a save_dir (e.g. to control where checkpoints go while having ~/.comet.config) you can specify which mode you want.
* Make CometLogger API key changes backwards compatible.
* Comet logger: change online argument to be offline.
For consistency with other loggers.
* chlog
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-07 09:46:50 +02:00
4307dd9dc6
fix PR link ( #2858 )
2020-08-07 09:43:38 +02:00
793036d29c
Support returning python scalars in DP ( #1935 )
...
* Override the default gather method to support scalars
* add computing average of a list
* bug: change if to elif
* add some tests
* change style
* change documentation
* use apply_to_collection in DP gather
* use apply_to_collection in DP gather
* fix warning msg
* override gather method in DP
* add tests for python scalars
* add python scalars to docstring
* Update message
* override gather method in DP
* formatting
* chlog
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-07 09:18:29 +02:00
ea658e300c
Tests/install pkg ( #2835 )
...
* add install matrix
* nb tests
* win
* cfg
* torch
* link
* Update .github/workflows/install-pkg.yml
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
* try
* try
* try
* try
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2020-08-07 03:08:23 -04:00
9a402461da
Bugfix: Lr finder and hparams compatibility ( #2821 )
...
* fix hparams lr finder bug
* add tests for new functions
* better tests
* fix codefactor
* fix styling
* fix tests
* fix codefactor
* Apply suggestions from code review
* modified hook
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-08-07 00:34:48 +02:00
1dc411fc53
Update contributing guide ( #2830 )
...
* update contributing.md
* Update CONTRIBUTING.md
* Update CONTRIBUTING.md
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update .github/CONTRIBUTING.md
* suggestion from code review
* minor changes
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-08-06 22:46:45 +02:00
6d637c4beb
add wandb autoclass in logger.rst ( #2854 )
2020-08-06 22:05:06 +02:00
ed3ee982b3
clean tests imports ( #2834 )
2020-08-06 16:58:51 +02:00
9ab071588b
Setup extras ( #2831 )
...
* 🎨 use package extras
* 🎨 get extras from reqs
* 🎨 .
* 📝 docs
* 🎨 .
2020-08-06 07:12:47 -04:00
9b997c8616
add test for none checkpoint in ddp_spawn ( #2845 )
...
* add test for none checkpoint in ddp_spawn
* fix code style
* make sure checkpoint_callback is none
* Fix tests
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2020-08-06 07:11:43 -04:00
767c44950c
Added basic file logger ( #2721 )
...
* Added basic file logger #1803
* fixup! Added basic file logger #1803
* fixup! Added basic file logger #1803
* fixup! Added basic file logger #1803
* fixup! Added basic file logger #1803
* fixup! Added basic file logger #1803
* csv
* Apply suggestions from code review
* tests
* tests
* tests
* miss
* docs
Co-authored-by: xmotli02 <xmotli02@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-08-06 06:08:25 -04:00
ac4a215071
Faster Accuracy metric ( #2775 )
...
* Faster classfication stats
* Faster accuracy metric
* minor change on cls metric
* Add out-of-bound class clamping
* Add more tests and minor fixes
* Resolve code style warning
* Update for #2781
* hotfix
* Update pytorch_lightning/metrics/functional/classification.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update about conversation
* Add docstring on stat_scores_multiple_classes
Co-authored-by: Younghun Roh <yhunroh@mindslab.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-08-06 11:40:35 +02:00
dd78be516a
Update __init__.py
2020-08-05 20:45:11 -04:00
fe29c53ab5
add ddp sync for logging in result step ( #2822 )
...
* add ddp sync for logging in result step
* pep8
* pep8
* make ddp tests run also on cpu (except windowws)
* create class instance in ddp test
* revert automated formatting
* pep8
2020-08-05 20:42:09 -04:00
b507c42c47
clarify batch hooks ( #2842 )
...
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
* modified hook
2020-08-05 20:01:30 -04:00
a5f2b89ed0
updated sync bn ( #2838 )
...
* updated sync bn
* updated sync bn
* updated sync bn
* updated sync bn
* updated sync bn
* updated sync bn
* updated sync bn
* updated sync bn
* added ddp_spawn test
* updated test
* clean
* clean
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-06 01:12:11 +02:00
633cf76c68
Update __init__.py
2020-08-05 15:58:27 -04:00
5d0f0325d8
Revert "Support limit_mode_batches (int) for infinite dataloader" ( #2839 )
...
* Revert "Support limit_mode_batches (int) for infinite dataloader (#2787 )"
This reverts commit de9c9f0864
2020-08-05 15:57:26 -04:00
2242af11b6
another try to filter master from CircleCI jobs ( #2734 )
...
* circleci config
* Apply suggestions from code review
* miss
2020-08-05 21:43:33 +02:00
d09098ca5a
[DOCS] title clarification in Results page ( #2827 )
...
* title tweak
* remove changes in new-project
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-08-05 21:06:26 +02:00
bef27c58ed
save apex scaler states ( #2828 )
2020-08-05 13:43:50 -04:00
6034d5e37d
fix apex gradient clipping ( #2829 )
2020-08-05 13:42:21 -04:00
5bbcb8db1f
Improve SSIM ( #2833 )
...
* make ssim fast
* remove padding
* pep8
* add comments for readability
* plus -> coef
2020-08-05 13:40:11 -04:00
2cbb1496d0
Update __init__.py
2020-08-05 13:37:11 -04:00
e31c520c21
add support for sync_bn ( #2801 )
...
* initial commit for sync_bn
* updated changelog
* tests
* tests
* ddp tests hanging with script tests
* updated trainer
* updated params
* test
* passingtests
* passing tests
* passing tests
* passing tests
* tests
* removed apex
* doc
* doc
* doc
* doc
* docs
* tests
* tests
* tests
2020-08-05 13:29:05 -04:00
de9c9f0864
Support limit_mode_batches (int) for infinite dataloader ( #2787 )
...
* Support limit_mode_batches(int) for infinite dataloader
* flake8
* revert and update
* add and update tests
* pep8
* chlog
* Update CHANGELOG.md
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Add suggestions by @awaelchli
* docs
* Apply suggestions from code review
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Apply suggestions from code review
* fix
* max
* check
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-05 17:04:49 +00:00
Adrian Wälchli