110e49dc99
De-duplicate `DistributedSampler` mentions ( #7636 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-05-21 23:01:13 +02:00
751975e39f
fix flag name to flush_logs_every_n_steps in logging doc ( #7633 )
...
* fix method name to flush_logs_every_n_steps in logging doc
* apply corrections in comments
2021-05-21 10:50:13 +00:00
03ea68f8a2
removed hparams assignment example ( #7639 )
2021-05-21 11:15:38 +01:00
485554c8b0
Add link to TorchIO tutorial in PyTorch Ecosystem examples ( #7612 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-05-19 21:06:26 +00:00
922c0a607b
Fix incorrect code-snippet in optimizers doc ( #7598 )
...
`training_step(...)` should take `self` as the first argument. It's a simple but necessary fix.
2021-05-19 19:33:09 +00:00
f4f51e0dcf
Add kubeflow cluster environment ( #7300 )
...
* Add kubeflow cluster environment
* Add KubeflowEnvironment to docs
* Add KubeflowEnvironment to the changelog
* break up a long line
* Add method to detect kubeflow environment
* Select Kubeflow environment when available
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Run pre-commit
* task_idx == 0
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-17 09:05:24 +01:00
e126649d19
add missing punctuation in lightning_cli.rst ( #7554 )
2021-05-15 00:26:47 +00:00
53f8d9a800
update alumni ( #7545 )
2021-05-14 19:06:12 +02:00
233f252bb4
update logo 48px ( #7530 )
2021-05-13 22:33:12 +02:00
7ca41734da
Add `dataloader_idx` to batch transfer hooks ( #6241 )
...
* replace with kwargs
* chlog
* fix
* add test
* fix
* device
* deepspeed
* pep
* optional
* docs
* bc
* comments
* pep
* mypy
* pep
* Apply suggestions from code review
* kwargs
* docs
* .
* .
* 1.3 -> 1.4
* kwargs -> step_kwargs
2021-05-13 23:03:55 +05:30
a584196abf
Default `seed_everything(workers=True)` in the `LightningCLI` ( #7504 )
2021-05-13 12:18:03 +02:00
b65ae79478
Automatically check `DataModule.has_{setup,teardown,prepare_data}` [2/2] ( #7238 )
...
* Automatically check `DataModule.has_{setup,teardown,prepare_data}`
* Use variable
* Spacing
* Docs
* Update CHANGELOG
* Remove `_DataModuleWrapper`
* Add test
* Update docs/source/extensions/datamodules.rst
* Bad merge
* add test for invalid name
* Remove ValueError
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-11 10:53:00 +02:00
f6fe715e73
Fix Sphinx argument deprecation ( #7464 )
2021-05-10 17:30:23 +02:00
3ec54203bb
Fix slack link ( #7452 )
...
* Update README.md
* Update Slack link
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2021-05-10 08:50:14 +00:00
159308e4ef
Update introduction_guide.rst ( #7453 )
2021-05-10 08:49:54 +00:00
f9e050c5e5
Move DP warning suppression to the DataParallel Plugin ( #7421 )
2021-05-07 23:02:44 +02:00
8208c330eb
Use `torch.nn.utils.clip_grad_norm_` and add `clip_grad_by_value` support for TPU ( #7025 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-05-07 16:41:39 +00:00
9ba76ce60c
Unify `configure_optimizers` docs ( #7399 )
2021-05-07 16:10:24 +02:00
94f6c3e160
Advanced GPU Documentation ( #7259 )
...
* Added advanced gpu section
* Small changes
* Better documentation
* Address code review
* Add warning about using trainer.model, clean up some of the examples
* Add section for ddp, remove references and old sequential documentation
* Remove Fully Sharded documentation for now
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
* Address code review
* Address code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-05-06 13:53:20 +01:00
c3fc0313ef
Updating docs and error message: half precision not available on CPU ( #7384 )
...
* Updating docs and error message to specify that half precission not available on CPU
* update messages
Co-authored-by: Martin Kristiansen <martinkristiansen@sixgill.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: jirka <jirka.borovec@seznam.cz>
2021-05-06 09:05:50 +00:00
49c8740338
update docs about transfer_batch_to_device hook while using DP ( #7343 )
...
* update
* clarify
* update
2021-05-05 13:51:16 +00:00
98670c83a9
Deprecate`truncated_bptt_steps` flag on Trainer in favor of same setting on the LightningModule ( #7323 )
...
* deprecate-tbptt-trainer
* Update CHANGELOG.md
* Update lightning.py
* test
* Update lightning.py
* Update training_loop.py
* Update training_loop.py
* Update lightning.py
* Update training_loop.py
* Update training_loop.py
* update docs
* Update accelerator.py
* Update accelerator.py
* more docs
* tweaks
* chlog
* comments
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-05-05 11:21:00 +01:00
a6aa1a0f82
make gpus=str in Trainer consistent with command line parsing of string ( #6388 )
...
* string gpu input
* update docs
* deprecation warning
* Revert "update docs"
This reverts commit c5f3893413
2021-05-04 09:56:27 +00:00
f135debb6a
Clarify logger flag ( #7190 )
...
* Clarify logger flag
Clarify behavior of boolean values on the logger flag for Trainer.
* Update docs/source/common/trainer.rst
* doc
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-05-04 00:21:28 +00:00
6da747e775
Deprecate `LightningModule.datamodule` reference in favor of the trainer one ( #6929 ) ( #7168 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-05-04 00:01:41 +00:00
78a6fd5588
Example and documentation for LightningCLI linking model and data arguments ( #7299 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-03 20:45:46 +00:00
5af086ab9f
Attach data refactor and tuner bugs [4/n] ( #7258 )
...
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-30 13:54:58 +00:00
8bffa4f0ca
Updated docs to fix typo and update grid status ( #7270 )
...
* Updated docs to fix typo and update grid status
* Update docs/source/starter/new-project.rst
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* Update docs/source/starter/new-project.rst
* Update docs/source/starter/new-project.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-30 12:45:17 +01:00
7a48db591e
Fixes a potential bug on pip install ( #7256 )
...
* Fix install bug
* Better fix
* Fix
* Fix
* Remove unused import
* Update docs conf.py
* Updates
2021-04-29 03:15:09 +05:30
78d45a1134
Improve `LightningCLI` documentation and tests ( #7156 )
...
* - Added cli unit tests for help, print_config and submodules.
- Added to cli documentation use of subclass help and print_config, submodules and other minor improvements.
- Increased minimum jsonargparse version required for new documented features.
* Improvements to lightning_cli.rst
* Add check for all trainer parameters in test_lightning_cli_help
* Increased minimum jsonargparse version
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-28 09:34:32 +01:00
bfac0e899f
warn about dp + manual optimization in docs ( #7230 )
...
* add warning
* typo
* add link
2021-04-28 09:01:06 +01:00
e76ebd640e
[feat] Add BasePredictionWriter 3/3 ( #7127 )
...
* wip
* update
* update
* update
* update
* update
* typo
* update on comments
* update
* update
* update
* update
* update changelog
* update
* Fix merge
* Fix merge
* move code
* resolve test
* add extra test
* add an extra test
* update on comments
* add typing
* resolve flake8
* Refactor and Docs
* Fix tests
* Fix tests
* Fix tests
* Duplicate
* Fix tests
* resolve bug
* update
* update on comments
* Update pytorch_lightning/utilities/imports.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/utilities/device_parser.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* update
* update
* update
* update on comments
* resolve flkae8
* update test
* Apply suggestions from code review
* update on comments
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* update on comments
* update
* update on comment
* Apply suggestions from code review
* update
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-04-27 20:23:55 +00:00
5cf9afa176
Add fairscale install msg for Sharded Plugins ( #7213 )
2021-04-27 08:22:44 +00:00
d534e53ec4
add missing predict docs ( #7150 )
...
* update docs
* add datamodule predict
* fix docs
* typo
2021-04-23 10:38:44 +00:00
d6470bf193
Delete unused CI scripts ( #7152 )
2021-04-22 03:07:48 +02:00
345e9a0245
Fix argparse docs ( #7148 )
2021-04-22 02:13:00 +02:00
d902181b50
Update `ClusterEnvironment` docs ( #7120 )
...
* update cluster
* update index
* update references
* update grid docs
* update duplicated title
* Update docs/source/clouds/cloud_training.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* fix doctest
* Remove self-balancing section
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-22 01:38:16 +02:00
e4f3a8d3dd
Update `EarlyStopping` docs ( #7121 )
2021-04-21 01:23:36 +02:00
1a68dcd9a2
Update governance.rst ( #7111 )
2021-04-20 16:55:49 +02:00
0302b8be32
Disable `lr_scheduler.step()` in manual optimization ( #6825 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-04-20 13:00:45 +02:00
24248d6dd4
Update community example links ( #7087 )
...
Co-authored-by: tchaton <thomas@grid.ai>
2021-04-20 06:56:59 +00:00
60c1c8fe83
Auto-set `DataLoader.worker_init_fn` with `seed_everything` ( #6960 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-04-19 16:28:37 +02:00
d1529c28a1
Optimization docs ( #6907 )
...
* .
* .
* Fix link to the section
* Fix link to the section
* Consistent indent
* Update docs
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Add note for optimizer.optimizer
* .
* Update hooks
* Update closure docstring
* Update optimizer methods
* Update optimizer
* Remove manopt + grad clipping (by @flukeskywalker)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-04-19 10:08:49 -04:00
a5e356adb1
Deprecate `@auto_move_data` in favor of `trainer.predict` ( #6993 )
...
* Deprecated `@auto_move_data` in favor of `trainer.predict`
* Update CHANGELOG
2021-04-19 14:53:21 +01:00
e9fca760ac
Set `DistributedSampler` seed if `seed_everything` was called ( #7024 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-19 14:50:31 +01:00
67d21609c9
Add Trainer max_time argument + Callback ( #6823 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2021-04-16 13:38:57 +02:00
402a258705
[docs]: pass parser to Trainer.add_argparse_args() ( #7029 )
2021-04-16 01:52:47 +02:00
7b0b6c3112
Update DeepSpeed docs after single saving PR ( #7036 )
2021-04-15 08:56:04 -07:00
f852a4f592
Changed basic_examples to use `LightningCLI` ( #6862 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-04-15 15:01:16 +00:00
895bea1ad3
rename about ( #7002 )
...
* rename about
* .
* ..
2021-04-14 18:56:40 -04:00
Carlos Mocholí