20ff50caa6
Accelerator API docs ( #6936 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-04-10 12:25:07 +05:30
3baac71252
v1.3.0rc1 ( #6925 )
...
* v1.3.0rc1
* .
2021-04-09 10:36:06 -04:00
128f6ab508
Add separators to performance docs ( #6882 )
2021-04-08 08:22:50 +01:00
19e67d18c4
Docs fixes ( #6870 )
2021-04-07 16:57:22 +01:00
7f6154fcad
Add `Trainer(gradient_clip_algorithm='value'|'norm')` ( #6123 )
...
* add changelog
* add clip by value
* fix bug in training tricks.rst
* fix bug in trainer.rst
* Update trainer.rst
* Update trainer.rst
* Update CHANGELOG.md
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/precision/deepspeed_precision.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/utilities/enums.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* yapf formatting
* update training tricks
* update based on comment
* update based on comment
* Update pytorch_lightning/trainer/trainer.py
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* update based on comment
* pep8
* mypy
* mypy
* Update docs/source/advanced/training_tricks.rst
Co-authored-by: thomas chaton <thomas@grid.ai>
* Update sharded_native_amp.py
* Update test_sharded_parity.py
* update test codes
* Update test_tpu.py
* Update pytorch_lightning/trainer/connectors/training_trick_connector.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update test_trainer.py
* Update enums.py
* Update enums.py
* add super-class initialization to precision plugins.
* add clip_grad horovod cpu test
* add clip_grad horovod cpu test
* use subprocess check_call
* change order of horovod tests
* set max_epochs 2 in horovod test
* remove clip_grad_val test from horovod-cpu
* remove "type: ignore"
* divide clip grad val test in horovod
* update based on comments
* add super-class initialization to precision plugins.
* bugfix
* bugfix
* revert some changes
* revert some changes
* Update tests/models/test_horovod.py
* merge master
* Delete signature test
No point in testing a signature
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-04-06 08:27:37 -05:00
b7f3a3c421
Simple reproducibility with minimum boilerplate CLI training with `LightningCLI` ( #4492 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-06 14:19:11 +01:00
22a266d8b8
Update TPU docs for installation ( #6794 )
2021-04-04 00:19:43 +05:30
f8a379830d
Remove extinct parameters from lightning_module.rst ( #6801 )
...
Fixes #6800
2021-04-02 20:49:20 +02:00
0dd2deebea
Remove legacy support for the magic `log`/`progress_bar` keys in dict returns ( #6734 )
2021-03-31 00:28:04 +02:00
f9bb7c641a
DeepSpeed ZeRO Docs update ( #6752 )
...
* Added base docs
* Add more information
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-30 21:52:02 +00:00
9876df16a2
[docs] Update Bolts link ( #6743 )
...
* Update Bolts link
* Update Bolts link
* formt
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-30 22:52:59 +05:30
f0c5479de9
Remove legacy `Result` parameters ( #6016 )
2021-03-28 11:55:08 +02:00
bc613611e2
Do not add return dict items to callback_metrics ( #6682 )
2021-03-26 14:05:20 +01:00
217c12a4e7
Simplify deprecations ( #6620 )
...
* use external deprecate
* simplify
* simplify
* simplify
* flake8
* .
* others
* .
2021-03-25 15:26:38 +01:00
9be092dbdb
Add on_epoch_start to run at the beginning of every loop irrespective of train/val/test ( #6498 )
...
* update docs
* add hook and update docs
* update tests
* chlog
* Update CHANGELOG.md
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* chlog
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-25 14:20:49 +01:00
40976e4eba
Support teardown hook on DataModule ( #4673 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
2021-03-25 07:51:55 -05:00
d02fe342c1
Feature/double precision ( #6595 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-03-24 15:47:58 +05:30
5733889203
Docs/robots ( #6658 )
2021-03-24 10:46:56 +01:00
b1e3dcc607
Use `pl.LightningModule` in new-project docs ( #6656 )
2021-03-24 00:08:57 +01:00
0995d30fab
Flash predict step ( #6577 )
...
* add predict_step
* Update predict_loop.py
* Update trainer.py
* Update trainer.py
* resolve bugs
* update
* update
* update
* resolve bug
* resolve some failing tests
* udpate tests
* update
* resolve tests
* add a test
* remove typo
* add a test for attachement
* update
* changed to on_train_dataloader
* remove __flash_special_attr__
* resolve tests
* update
* update
* update
* update on comments
* Update pytorch_lightning/trainer/data_loading.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-23 11:13:13 -04:00
8cd75a4dd5
fix comparing versions ( #6434 )
...
* fix comparing versions
* chlog
* .
* ...
* datasets
2021-03-23 07:51:45 +00:00
1fae10a2dc
refactoring setup ( #6590 )
...
* refactoring setup
* .
* docs
* flake8
2021-03-22 08:39:19 -04:00
42a7b70585
Add DDP Spawn being default for Multi GPUs ( #6292 )
2021-03-21 22:10:54 +01:00
8853a36d45
[doc] Update Dict Train Loader doc. ( #6579 )
...
* update doc
* update example
2021-03-18 17:14:38 +00:00
00cd918177
[doc] Add Zero Grad `set_to_none=True` trick ( #6548 )
...
* add trick to doc
* update
* update path
* Update docs/source/benchmarking/performance.rst
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-03-16 23:40:14 +00:00
9c5973357e
Update hook lifecycle ( #6538 )
...
* Update hook lifecycle
* Update docs/source/common/lightning_module.rst
2021-03-15 19:16:31 +00:00
383565d225
Update DeepSpeed docs ( #6528 )
...
* Clean up docs and add some explicitness around stages
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-03-15 18:00:21 +00:00
b341b53f70
deprecate metrics pkg ( #6505 )
...
* deprecate metrics
* examples
* req
* docs
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* pep8
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2021-03-15 14:39:38 +00:00
5d73fbbd81
Mean Average Precision metric for Information Retrieval (1/5) ( #5032 )
...
* init information retrieval metrics
* changed retrieval metrics names, expanded arguments and fixed typo
* added 'Retrieval' prefix to metrics and fixed conflict with already-present 'average_precision' file
* improved code formatting
* pep8 code compatibility
* features/implemented new Mean Average Precision metrics for Information Retrieval + doc
* fixed pep8 compatibility
* removed threshold parameter and fixed typo on types in RetrievalMAP and improved doc
* improved doc, put first class-specific args in RetrievalMetric and transformed RetrievalMetric in abstract class
* implemented tests for functional and class metric. fixed typo when input tensors are empty or when all targets are False
* fixed typos in doc and changed torch.true_divide to torch.div
* fixed typos pep8 compatibility
* fixed types in long division in ir_average_precision and example in mean_average_precision
* RetrievalMetric states are not lists and _metric method accepts predictions and targets for easier extension
* updated CHANGELOG file
* added '# noqa: F401' flag to not used imports
* added double space before '# noqa: F401' flag
* Update CHANGELOG.md
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* change get_mini_groups in get_group_indexes
* added checks on target inputs
* minor refactoring for code cleanness
* split tests over exception raising in separate function && refactored test code into multiple functions
* fixed pep8 compatibility
* implemented suggestions of @SkafteNicki
* fixed imports for isort and added types annontations to functions in test_map.py
* isort on test_map and fixed typing
* isort on retrieval and on __init__.py and utils.py in metrics package
* fixed typo in pytorch_lightning/metrics/__init__.py regarding code style
* fixed yapf compatibility
* fixed yapf compatibility
* fixed typo in doc
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-03-15 12:18:43 +01:00
680e83adab
[doc] Update the order of zero_grad and backward ( #6478 )
...
* Fix zero_grad in docs
* Fix zero_grad in docs
2021-03-12 09:00:23 +00:00
e886d55ac1
argparse: Add use_argument_group=True ( #6088 )
...
* argparse: Add inplace option
Replicate in GAN model
* datamodule: Deduplicate logic w/ argparser utilities
* Update pl_examples/domain_templates/generative_adversarial_net.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
* Keep docstrings
* Correct name
* Whitespace
* Consistency
* fix weird type stuff
* try alt - use_argument_group
* fix syntax + lint
* fix ci errs
* fix ci
* change examples... still failing w/ "unrecognized arguments: --batch_size"
* address review
* mnist_datamodule: add some docstrings
* argparse: check cls or cls.__init__ for param
didn't capture issue, but meh
* fix lint
* fix no-doc edge case
* address review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-03-11 10:50:49 -05:00
f4cc7451a9
Add Trainer.validate(…) method to run one validation epoch ( #4948 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-11 03:46:37 +01:00
c81b2a8189
Set find unused parameters to True by default to fix breaking compatibility ( #6438 )
...
* Set find unused parameters to True by default to fix breaking models, add suggestion to re-enable
* Add changelog
2021-03-10 10:40:24 +01:00
75c6486ac7
update ( #6403 )
2021-03-09 09:47:51 +00:00
efd272a3ca
Pass {fit,validate,test,predict} to setup() and teardown() ( #6386 )
2021-03-08 15:27:07 +01:00
ff16104927
Update TBLogger docs ( #6315 )
...
* Update tensorboard.py
* Update logging.rst
* pep8
* Update logging.rst
* Update logging.rst
* Apply suggestions from code review
* add code sample
* Update logging.rst
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-08 01:17:49 +00:00
c7f30a204c
[doc] Fix closure in manual optimization ( #6374 )
...
* Fix manual optimization docs
* Fix typo. Thanks @import-antigravity
2021-03-07 13:34:51 +01:00
2708c3993d
[doc] Improve Multiple Val/Test Dataloaders with simultaneous batches option ( #6320 )
...
* improve doc to describe how to combine batches of multiple test and val dataloaders simultaneously
* fix typo
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* use paramref
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-07 11:24:19 +00:00
38a5fe7af1
Remove optimizer_idx arg in manual optimization ( #6093 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
2021-03-07 08:48:50 +01:00
4f391bce7c
give a more complete GAN example ( #6294 )
2021-03-05 17:54:09 -05:00
4f904556e4
Update docs on arg train_dataloader in fit ( #6076 )
...
* add to docs
* update docs
* Apply suggestions from code review
* Update pytorch_lightning/core/hooks.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* nested loaders
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* shorten text length
* Update pytorch_lightning/core/hooks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-04 14:22:18 -05:00
577323c92a
leaving lezwon ( #6347 )
2021-03-04 18:37:58 +00:00
bc577ca792
fix duplicate console logging bug v2 ( #6275 )
...
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-02 15:17:55 +05:30
412a7d812e
Remove opt from manual_backward in docs ( #6267 )
2021-03-01 18:15:43 +00:00
925f082572
Call `optimizer.zero_grad()` before backward inside closure in AutoOpt ( #6147 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-03-01 14:36:46 +01:00
ce0568700b
update ( #6237 )
2021-03-01 14:14:53 +01:00
c7130b7e1e
Update with GitHub Discussions ( #6186 )
2021-02-25 00:28:23 +05:30
46617d9021
Prune deprecated checkpoint arguments ( #6162 )
...
* prune prefix
* prune mode=auto
* chlog
2021-02-24 06:58:53 -05:00
1d9c553b86
prune deprecated Trainer arg `enable_pl_optimizer` ( #6163 )
...
* prune enable_pl_optimizer
* prune automatic_optimization
2021-02-24 10:01:24 +00:00
09baf29ecb
prune deprecated profiler as bool ( #6164 )
...
* prune profiler
* chlog
2021-02-24 09:08:21 +00:00
Adrian Wälchli