ede1227c39
hotfix: drop bad pyyaml version ( #5606 )
...
* drop potetionaly bad version
* *
2021-02-04 20:55:40 +01:00
74d175bfac
fix PyPI releasing ( #5605 )
2021-02-04 20:55:40 +01:00
e8206a9295
Mnodes ( #5020 )
...
* add a multi-nodesworkflow
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-02-04 20:55:40 +01:00
3b43e5a4fc
Add note about returning None ( #5578 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-02-04 20:55:40 +01:00
5ff1306582
Add new CHANGELOG section ( #5580 )
2021-02-04 20:55:40 +01:00
e425bf3ba9
[BugOnFeat] Resolve bug with Finetuning ( #5744 )
...
* resolve bug + add doc
* Update pytorch_lightning/callbacks/finetuning.py
* resolve bug
* start adding more test
* add more tests for finetuning callback functions
* rename to flatten_modules
* resolve doc
* Update pytorch_lightning/callbacks/finetuning.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* resolve comments
* remove update on BoringModel
* update on comments
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-02-04 18:36:54 +00:00
d05cdf83f1
Merge remote-tracking branch 'carmocca/sync-1.1.5' into release/1.2-dev
2021-02-04 09:42:59 -05:00
26cc3b5357
Change the seq of on_train_batch_end, on_batch_end & on_train_epoch_end, on_epoch_end hooks ( #5688 )
2021-02-04 18:30:20 +05:30
9555043a29
Force ModelCheckpoint callback to run last ( #5731 )
2021-02-03 16:40:57 -05:00
630a88addb
drop deprecated docs ( #5768 )
...
* drop deprecated docs
* notes
* .
2021-02-03 20:21:19 +00:00
a37416843b
Fix sync
...
resolve wrong merge
tpu
yapf
2021-02-03 20:11:35 +01:00
09b8dc7738
Prepare 1.1.5 release ( #5576 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-02-03 19:41:47 +01:00
2b6738832b
fix argparse conflicting options error ( #5569 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-02-03 19:41:46 +01:00
1d99530c66
Fix root node resolution in slurm environment
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
2021-02-03 19:41:46 +01:00
fd6b3ec349
Drop greetings comment ( #5563 )
...
Co-authored-by: chaton <thomas@grid.ai>
2021-02-03 19:41:46 +01:00
f72d93974c
Fix command line run for refinforce_learn_qnet in pl_examples ( #5414 )
...
* fix wrong argument in argparse
* remove wrong default arg in argparser
* disable add help argparse
2021-02-03 19:41:46 +01:00
b7920b1c84
Fix logging on_train_batch_end in a callback with multiple optimizers ( #5521 )
...
* Start with the failing test
* Then fix the failing test
* Update CHANGELOG
2021-02-03 19:41:46 +01:00
f2229fdd50
Fix val_check_interval with fast_dev_run ( #5540 )
...
* fix val_check_interval with fast_dev_run
* chlog
2021-02-03 19:41:45 +01:00
ad4e25fde5
[bugfix] Fix signature mismatch in DDPCPUHPCAccelerator's model_to_device ( #5505 )
...
* Update ddp_cpu_hpc_accelerator.py
* Update CHANGELOG.md
2021-02-03 19:41:45 +01:00
293984bbc0
fix reinit_schedulers with correct optimizer ( #5519 )
...
* update test
* syntax
* fix
* update test
* scheduler
* only apex
* fix
* rev drone
* chlog
2021-02-03 19:41:45 +01:00
a375240c0c
Tensorboard Docu about Hyperparams saving ( #5158 )
...
* Add documentation to tensorboard
* Remove unnecessary whitespaces
* Update pytorch_lightning/loggers/tensorboard.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Add metrics to tensorboard logger
* Whitespace removed
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-02-03 19:41:45 +01:00
43e926b880
Fix Wrong exception message ( #5492 )
...
* Update accelerator_connector.py
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-02-03 19:41:44 +01:00
f8abcf707c
reconfigure mergify ( #5499 )
...
* configure mergify
* drop gha
* drop commented section
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Roger Shieh <sh.rog@protonmail.ch>
2021-02-03 19:41:44 +01:00
7b42494d0e
Fix visual progress bar bug / properly reset progress bar ( #4579 )
...
* reset
* fix reset
* changelog
* update chlog
* typing
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-02-03 19:41:44 +01:00
a9a376019f
add section & add testing ckpt 1.1.4 ( #5495 )
...
* add section
* test legacy
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2021-02-03 19:41:44 +01:00
10c7dbe6a1
Refactor setup_training and remove test_mode ( #5388 )
...
* ref and fix call for on_pretrained_routine
* avoid failing tests
* unnecessary_call
* unnecessary call in accelerators
* tmpdir
* rm test_mode
* pep
* updates
* more ref
* Revert "more ref"
This reverts commit 5d9e95f873
2021-02-03 19:41:42 +01:00
c27d4d2d9c
pipeline release CI ( #5494 )
...
* pipeline release CI
* trigger
* trigger
* .
* t1
* t2
* t1
* t2
2021-02-03 19:39:28 +01:00
0ff4c56d9b
fix typo in multi-gpu docs ( #5402 )
...
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2021-02-03 19:39:28 +01:00
5bef046759
[Docs] fix on_after_backward example ( #5278 )
...
* fix on_after_backward docs
* doc fix
2021-02-03 19:39:28 +01:00
7a50c33f97
update tests with new auto_opt api ( #5466 )
...
* update tests with new auto_opt api
* Apply suggestions from code review
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-02-03 19:39:28 +01:00
03c861bdb4
fix generate checkpoint ( #5489 )
2021-02-03 19:39:27 +01:00
d5c107fa96
Docs: move images ( #5756 )
...
* move images
* logo
2021-02-03 15:08:19 +00:00
aba212341a
formatting 4/n: Trainer ( #5720 )
...
* yapf trainer
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* .
* fix
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-02-03 09:25:42 +00:00
aa03b73e60
Remove psf/black references ( #5739 )
...
* Update pyproject.toml
* Update setup.cfg
* Update test.txt
* Update CONTRIBUTING.md
* Update requirements/test.txt
2021-02-03 08:37:06 +00:00
dca3b19e59
Add yapf to pre-commit ( #5747 )
2021-02-02 15:03:36 +01:00
50fd4879a9
Update metrics to use Enum ( #5689 )
...
- Add DataType, AverageMethod and MDMCAverageMethod
2021-02-01 13:50:10 -05:00
8943d8bca0
add missing logic to new plugins and accelerator ( #5734 )
...
* add missing logic
* missed imports
* import fixes
* isort
* mv f
* changelog
* format
* move helper to parallel plugin
* d
2021-02-01 13:23:53 -05:00
344f3a984a
Refactor access to trainer attributes in LightningModule ( #5730 )
...
* rank access
* tests for property
* weekref
* logger
* changelog
* torchscript
* changelog
* chlog
* .
* amp
* yapf
* flake8
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-02-01 14:28:17 +00:00
9064b83caf
Accelerator Refactor/RPC + Sharded ( #5732 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-02-01 14:49:15 +01:00
b3ebc18bcb
Hardware specific parts of Accelerator Refactoring ( #5719 )
...
* add basic accelerator class.
Co-Authored with @awaelchi
* pep8
Co-authored-by: @awaelchi
* add cpu accelerator
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add gpu accelerator
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add tpu accelerator
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add accelerator connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add single device training
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add single tpu
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add tpu spawn
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* make on_colab_kaggle utility func
* add basic accelerator class.
Co-Authored with @awaelchi
* pep8
Co-authored-by: @awaelchi
* add cpu accelerator
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add gpu accelerator
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add tpu accelerator
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add accelerator connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add single device training
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add single tpu
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add tpu spawn
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* make on_colab_kaggle utility func
* fixes
* move
* yapf
* .
* .
* .
* flake8
* sync accelerator connector changes from dev1.2
* changelog
* fix tpu handling
* tpu
* aval
* yapf
* Update pytorch_lightning/plugins/training_type/tpu_spawn.py
Co-authored-by: chaton <thomas@grid.ai>
* Update pytorch_lightning/accelerators/accelerator_connector.py
Co-authored-by: chaton <thomas@grid.ai>
* Update pytorch_lightning/plugins/training_type/tpu_spawn.py
Co-authored-by: chaton <thomas@grid.ai>
* Update tpu_spawn.py
* Update pytorch_lightning/accelerators/accelerator_connector.py
Co-authored-by: chaton <thomas@grid.ai>
* indentation
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
Co-authored-by: chaton <thomas@grid.ai>
2021-02-01 08:34:59 -05:00
963c17b669
formatting 6/n: metrics ( #5722 )
...
* yapf metrics
* op
2021-02-01 09:24:07 +01:00
069ae27cef
Accelerator Refactor: Precision Plugins ( #5718 )
...
* add basic accelerator class.
Co-Authored with @awaelchi
* add basic trainign type plugin.
Co-Authored with @awaelchi
* pep8
Co-authored-by: @awaelchi
* update copyright
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add apex_amp
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add mixed base class
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add native amp
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add native amp sharded
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add tpu bfloat
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add inits
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update precision_plugin.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-01-31 13:12:02 -05:00
3bacac7734
accelerator refactor - add parallel plugins ( #5714 )
...
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-01-31 07:48:14 -05:00
692f77b8a7
Refactor LightningDataParallel ( #5670 )
...
* module
* fix model access
* scalar conversion
* refactor
* kwargs
* auto unsqueeze
* refactor code duplication
* clean up
* docs
* update dp docs
* changelog
* generalize test
* test
* rename
* warning cache
* isort
* unsqueezing test
* device
* device
* scalar test
* device
* device
* include coverage of overrides
* clear
* add deprecation test
* docs
* improve coverage
* increase coverage
* fix merge
* extend test
* rename base class
* mention the predict method in docs
* combine iteration over collection
* remove override
* move
* line
* Apply suggestions from code review
* fix running stage
* f401
* fix cyclic import
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-01-31 06:08:16 -05:00
5d239ccd70
Base classes for accelerator refactoring ( #5715 )
...
* add basic accelerator class.
Co-Authored with @awaelchi
* Add base plugin class.
Co-authored with @awaelchi
* add basic trainign type plugin.
Co-Authored with @awaelchi
* add basic precision plugin.
Co-Authored with @awaelchi
* Add missing inits.
Co-authored with @awaelchi
* pep8
Co-authored-by: @awaelchi
* ignore flake8
* coverage omit
* imports in init
* lost
* imports
* flake8
* .
* .
* chlog
* Update pytorch_lightning/plugins/training_type/training_type_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/training_type/training_type_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/training_type/training_type_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/training_type/training_type_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/training_type/training_type_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/training_type/training_type_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/training_type/training_type_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-01-30 14:55:28 -05:00
fca927288c
Refactor: drop LoggerStages ( #5673 )
...
* drop LoggerStages
* chlog
2021-01-30 15:59:18 +01:00
eee38d59e7
formatting to PL utils ( #5713 )
...
* yapf pl base
* over
* dist
* utils
* Apply suggestions from code review
* flake8
* neew way
2021-01-30 15:28:59 +01:00
21d313edc5
yapf examples ( #5709 )
2021-01-30 10:17:12 +00:00
07f24d2438
add nvidia docker image ( #5668 )
...
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2021-01-29 11:01:03 -05:00
a17c941cc4
LR scheduler docs update ( #5678 )
...
* doc updates
* typo suggestions by rohit
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* update based on suggestions
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-01-29 10:08:29 +01:00
Jirka Borovec