Carlos Mocholí
a501cd3b4b
Update Lite docs ( #10347 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Roger Shieh <sh.rog@protonmail.ch>
2021-11-05 03:50:06 +00:00
Sean Naren
a255dcb421
Update bfloat16 docs ( #10330 )
2021-11-04 10:29:19 +00:00
puhuk
412f0a4d24
Remove deprecated dataloader arguments in Trainer methods ( #10325 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-04 11:03:39 +01:00
Carlos Mocholí
ba23d91320
Update recommendation on `dataloader_idx` ( #10318 )
2021-11-04 01:39:55 +01:00
Adrian Wälchli
b3db1b6e9c
Update signature of `LightningModule.training_step_end` ( #10094 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-03 13:38:08 +00:00
thomas chaton
9e844d9db6
Lite Docs and Example Improvements ( #10303 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-11-02 16:13:01 +01:00
Adrian Wälchli
3cd65b592b
Lightning Lite Examples ( #9987 )
...
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: four4fish <88516121+four4fish@users.noreply.github.com>
Co-authored-by: Nicki Skafte Detlefsen <skaftenicki@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Pietro Lesci <61748653+pietrolesci@users.noreply.github.com>
2021-11-02 08:04:29 +00:00
four4fish
d56e041635
Update init_ddp_connection's name and log ( #10295 )
2021-11-01 19:11:15 +00:00
Kaushik B
1127b28bbf
Update docs for devices flag ( #10293 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-01 18:39:00 +00:00
Kaushik B
10edc6de6b
Add missing deprecation notes for deprecated Trainer flags ( #10296 )
2021-11-01 18:38:41 +00:00
I-iBot
6fd6283e07
update outdated links in examples ( #10127 )
...
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-01 17:05:08 +00:00
Kaushik B
45c45dc7b0
Deprecate `ProgressBar` and rename it to `TQDMProgressBar` ( #10134 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-01 11:42:21 +00:00
Rohit Gupta
a1fe5ba0aa
attach model parallelism video inside docs ( #10274 )
2021-11-01 11:17:51 +00:00
Tobias Fischer
305a42c32e
Link to arxiv summary instead of pdf in pruning docs ( #10282 )
2021-11-01 14:02:11 +05:30
Adrian Wälchli
d33429c1e2
Lightning Lite docs ( #10176 )
2021-10-30 10:25:52 +00:00
Adrian Wälchli
b4f43b1695
Update docs for sync_dist logging option ( #10186 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-10-29 20:44:23 +00:00
Nesqulck
ff2d7e8115
Added advise for num_workers=0 in docs/speed ( #10215 )
2021-10-29 09:58:42 +01:00
Adrian Wälchli
e50b945ccb
Update syntax errors in docs code snippets ( #10036 )
...
Co-authored-by: tchaton <thomas@grid.ai>
2021-10-29 08:31:57 +00:00
Carlos Mocholí
5262b63dff
Pass the scaler as an input to `NativeMixedPrecisionPlugin` ( #10055 )
...
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-10-28 14:13:53 +00:00
Adam J. Stewart
b8ac17624d
Docs: fix mistakes in New Project docs ( #10137 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-28 12:31:02 +00:00
Kaushik B
d1985ebf96
Add Plugins Registry to docs ( #10181 )
2021-10-28 16:44:08 +05:30
Carlos Mocholí
dbe1662dc3
Replace `_TORCH_GREATER_EQUAL_DEV_1_10` with `_TORCH_GREATER_EQUAL_1_10` ( #10157 )
2021-10-27 13:38:39 +01:00
Adrian Wälchli
5ade197580
Update README page in pl_examples folder ( #10114 )
...
Co-authored-by: tchaton <thomas@grid.ai>
2021-10-26 17:38:56 +00:00
Charlie_Tang
84ce1d095c
add 'sanity_checking' to datamodule 'on_after_batch_transfer' docs ( #10067 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-26 11:12:57 +00:00
Adrian Wälchli
21a5867dad
Rename `ClusterEnvironment.creates_processes` ( #10106 )
...
Co-authored-by: tchaton <thomas@grid.ai>
2021-10-25 23:15:41 +00:00
Adrian Wälchli
f1623355bd
Add example table to loop docs ( #10058 )
...
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-25 22:42:15 +00:00
jjenniferdai
6d79184ec5
Unify checkpoint load paths [redo #9693 ] ( #10061 )
2021-10-25 19:05:31 +00:00
Adrian Wälchli
225989363b
update links in callback examples pointing to bolts ( #10117 )
2021-10-25 10:27:14 +00:00
Kaushik B
9b21ecbdf5
Add warning section for `checkpoint_callback` in Trainer docs ( #10041 )
2021-10-25 09:16:44 +00:00
Kaushik B
c3614f1c07
Fix: skip importing DistributedOptimizer for Windows ( #10071 )
2021-10-21 21:01:56 +00:00
Kaushik B
aa1540410f
Add XLACheckpointIO ( #9972 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-21 02:39:16 +05:30
Kaushik B
5b30a65952
Update API references ( #10040 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-20 18:10:39 +00:00
Carlos Mocholí
6aeebf1bd3
Remove unnecessary dependency available checks ( #10050 )
2021-10-20 16:21:37 +00:00
Carlos Mocholí
ef5a12212a
Isolate optimizer step logic to the `PrecisionPlugin` ( #10029 )
2021-10-20 15:43:08 +00:00
Kaushik B
56bc55db71
Update strategy flag in docs ( #10000 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-10-20 21:02:53 +05:30
Kaushik B
4f19a4dabc
Update Trainer flag docs for strategy ( #10042 )
...
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-20 21:02:21 +05:30
Carlos Mocholí
ad8d6c83da
[CLI] Shorthand notation to instantiate datamodules ( #10011 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-10-20 00:49:48 +00:00
Carlos Mocholí
d45897d522
Rename `TPUHalfPrecisionPlugin` to `TPUBf16PrecisionPlugin` ( #10026 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-10-19 21:09:37 +00:00
Carlos Mocholí
e8beceb631
Add `TPUPrecisionPlugin` ( #10020 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-10-19 17:48:57 +00:00
Rohit Gupta
0aa220b46b
Remove deprecated `distributed_backend` from `Trainer` ( #10017 )
...
* rm distributed_backend from Trainer
* unused
* chlog
* internal distributed_backend
* Docstring
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-10-19 13:54:37 +00:00
Danielle Pintz
203737bfce
Don't raise DeprecationWarning for `LoggerConnector.gpus_metrics` ( #9959 )
2021-10-18 22:51:09 +00:00
Adrian Wälchli
65150cdb42
Update docs for base Loop class with examples ( #9993 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-18 15:37:23 +00:00
thomas chaton
86df7dcee7
Add KFold Loop example ( #9965 )
2021-10-18 16:27:12 +01:00
Adrian Wälchli
7a9151637c
loop customization docs ( #9609 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
2021-10-18 09:43:11 +00:00
Danielle Pintz
16213b1635
Deprecate `log_gpu_memory`, `gpu_metrics`, and util funcs in favor of `DeviceStatsMonitor` callback ( #9921 )
...
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-14 22:45:44 +02:00
Oliver Borchert
afbf703684
Single-process multi-node CPU training ( #9603 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-10-14 22:21:41 +02:00
Danielle Pintz
940b910d27
[2/4] Add DeviceStatsMonitor callback ( #9712 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-10-13 18:29:36 +00:00
Rohit Gupta
23e8b59ae7
Add `configure_gradient_clipping` hook in `LightningModule` ( #9584 )
...
* init hook
* docs
* dep train args
* update tests
* doc
* doc
* .gitignore
* not dep
* add trainer args
* add & update tests
* fix tests
* pre-commit
* docs
* add docs
* add exception
* code review
* deepspeed
* update tests
* not
* try fix
* Apply suggestions from code review
* update deepspeed
* disable some tests
* disable some tests
* enable all tests
2021-10-13 20:15:13 +05:30
ananthsub
28fc8d2016
Add `enable_model_summary` flag and deprecate `weights_summary` ( #9699 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
2021-10-13 17:20:54 +05:30
Rohit Gupta
0f8fd20443
Remove epoch from `trainer.logged_metrics` ( #9904 )
2021-10-13 11:30:27 +02:00
Przemyslaw K. Joniak
dc27c72dc1
CombinedLoader example fix ( #9906 )
2021-10-12 19:48:06 +02:00
Rohit Gupta
7eff00317d
update docs ( #9903 )
2021-10-12 15:37:08 +05:30
Rohit Gupta
db322f4bbb
Deprecate `checkpoint_callback` from the `Trainer` constructor in favour of `enable_checkpointing` ( #9754 )
...
* enable_chekpointing
* update codebase
* chlog
* update tests
* fix warning
* Apply suggestions from code review
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Apply suggestions from code review
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* Apply suggestions from code review
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-12 07:55:07 +00:00
Sean Naren
66ce4436c6
[docs] Add Torch Distributed Run ( #9890 )
2021-10-11 12:15:46 +00:00
Boris Dayma
2db9ea3500
feat(wandb): support media logging ( #9545 )
2021-10-11 10:15:36 +01:00
Franz Rieger
2f313285b9
Correct function name ( #9859 )
2021-10-09 06:41:05 +00:00
Tobias
9317fbfc25
Make DDP and Horovod batch_size scaling examples explicit ( #9813 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-05 09:12:26 +02:00
Adrian Wälchli
9e11d97af6
Merge pull request #9690 from PyTorchLightning/feature/codeowners-rohit
...
add Rohit Gupta to default codeowners
2021-09-30 09:13:48 -04:00
Carlos Mocholí
0ddd6a8c19
Remove `_NATIVE_AMP_AVAILABLE` checks ( #9747 )
2021-09-29 15:34:26 +02:00
Danielle Pintz
b3a5c7f442
Add `enable_progress_bar` to Trainer constructor ( #9664 )
2021-09-24 22:53:31 -07:00
Carlos Mocholí
3f7872d93a
[CLI] Shorthand notation to instantiate models ( #9588 )
2021-09-22 14:19:02 +00:00
LaserBit
2e17b471f8
Fix missing url ( #9602 )
2021-09-20 23:20:40 +05:30
thomas chaton
1bb5fccb71
[CLI] Shorthand notation to instantiate callbacks [3/3] ( #8815 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-17 17:54:06 +00:00
Carlos Mocholí
bbcb977851
[CLI] Shorthand notation to instantiate optimizers and lr schedulers [2/3] ( #9565 )
2021-09-17 18:00:46 +01:00
Kaushik B
2ec39e275e
Add `RichModelSummary` callback ( #9546 )
2021-09-17 10:54:16 +00:00
Jirka Borovec
982a9560a5
Update notebooks submodule and add tutorial view to docs ( #9420 )
...
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
2021-09-16 15:14:37 +01:00
Sean Naren
3b34c89703
Add a png image for dark mode support ( #9518 )
2021-09-14 16:28:01 +00:00
Roger Shieh
81ac340248
Add docs for datamodule hparams ( #9428 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-13 11:54:42 +05:30
Danielle Pintz
83bff01595
Add on_exception hook to documentation ( #9365 )
...
* Small doc fixes
* remove space
* small fix
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-09-11 23:25:42 +00:00
Kaushik B
15434a9c35
Update torch_xla wheels installation link ( #9436 )
2021-09-10 20:00:22 +02:00
Jakub Kuszneruk
ee3787216a
Adapt `NeptuneLogger` to new `neptune-client` api ( #6867 )
...
* Initial split to NeptuneLegacyLogger and NeptuneLogger
* Adapt NeptuneLogger to neptune-pytorch-lightning repo version
* Fix stylecheck and tests
* Fix style and PR suggestions
* Expect Run object in NeptuneLogger.init
* Model checkpoint support and restructured tests
* Reformat code - use " instead of '
* Fix logging INTEGRATION_VERSION_KEY
* Update CHANGELOG.md
* Fix stylecheck
* Remove NeptuneLegacyLogger
* updated neptune-related docstrings
* PR suggestions
* update CODEOWERS file
* move import logic to imports.py
* minor neptune.py improvements
* formatting fixes and minor updates
* Fix generation of docs
* formatting fixes and minor updates
* fix
* PR fixes vol. 2
* define return type of _dict_paths method
* bump required version of `neptune-client`
* Enable log_* functions
* Update pytorch_lightning/loggers/neptune.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Revert "Enable log_* functions"
This reverts commit 050a436899b7f3582c0455dc27b171335b85a3a5.
* Make global helper lists internal
* Logger's `name` and `version` methods return proper results
* Initialize Run and its name and id at logger init level
* Make _init_run_instance static
* Add pre-commit hook code changes.
* Fix blacken-docs check
* Fix neptune doctests and test_all
* added docs comment about neptune-specific syntax
* added docs comment about neptune-specific syntax in the loggers.rst
* fix
* Add pickling test
* added myself to neptune codeowners
* Enable some of deprecated log_* functions
* Restore _run_instance for unpickled logger
* Add `step` parameter to log_* functions
* Fix stylecheck
* Fix checkstyle
* Fix checkstyle
* Update pytorch_lightning/loggers/neptune.py
Co-authored-by: thomas chaton <thomas@grid.ai>
* Fix tests
* Fix stylecheck
* fixed project name
* Fix windows tests
* Fix stylechecks
* Fix neptune docs tests
* docformatter fixes
* De-duplicate legacy_kwargs_msg
* Update .github/CODEOWNERS
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: kamil-kaczmarek <kamil.kaczmarek@neptune.ml>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-09-10 18:48:58 +02:00
Sean Naren
81687aade1
[docs] Clear up default logging, showing you don't need to pass a logger ( #9408 )
2021-09-10 13:24:31 +00:00
Danielle Pintz
160e7e1289
Deprecate LightningModule.get_progress_bar_dict ( #8985 )
...
* Move get_progress_bar_dict from lightning module to progress bar callback
2021-09-09 20:53:47 +00:00
Carlos Mocholí
15d943089d
Enforce that the optimizer closure is executed when `optimizer_step` is overridden ( #9360 )
2021-09-08 12:24:57 +02:00
Jirka Borovec
6e124e7207
CI: precommit - docformatter ( #8584 )
...
* CI: precommit - docformatter
* fix deprecated
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-06 12:49:09 +00:00
Eric Wiener
cf1a589956
Support infinite training ( #8877 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-09-04 23:33:43 +00:00
Gili Tzabari
908e60dc85
Renamed `lr_dict` to `lr_scheduler_config` ( #9313 )
2021-09-04 00:47:43 +00:00
Kaushik B
a7461bfc3b
Add missing callbacks to `callbacks.rst` ( #9223 )
2021-09-03 00:14:36 +00:00
thomas chaton
c86e6cf1c4
[doc] Add Fault Tolerant Documentation Page ( #9256 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
2021-09-02 10:18:03 +00:00
B. Kerim Tshimanga
65b3dc4495
scheduled removal of DeepSpeedPlugin.cpu_offload* parameters ( #9244 )
2021-09-01 12:02:30 +02:00
B. Kerim Tshimanga
07ee8fc9a0
Remove deprecated property `ModelCheckpoint.period` in favor of `ModelCheckpoint.every_n_epochs` ( #9213 )
2021-08-31 10:04:29 +02:00
Sean Naren
3fd77cbde6
[docs] Add activation checkpointing information ( #9165 )
2021-08-28 10:22:56 +00:00
Carlos Mocholí
0dfc6a18bd
Call any trainer function from the `LightningCLI` ( #7508 )
2021-08-28 04:43:14 +00:00
Ethan Harris
b5fb49ac3b
Add tutorial extension to the docs ( #9167 )
2021-08-27 17:14:23 +02:00
ananthsub
6da3a6185f
Fix typo in API evolution ( #9160 )
2021-08-27 08:21:16 +00:00
thomas chaton
fcbfc6b8ab
add note ( #9141 )
2021-08-27 09:59:15 +02:00
Sean Naren
12d076f747
[docs] Add Mixed Precision detailed docs ( #9104 )
2021-08-25 14:44:29 +00:00
Adrian Wälchli
b9443a07b9
[2 / 3] improvements to saving and loading callback state ( #7187 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-08-24 17:35:19 +00:00
Adrian Wälchli
208218b4f9
update warning in docs regarding support of tuner features in DDP ( #9011 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-08-24 10:02:39 +02:00
Surya Prakash Sahu
b74be4b366
Update correct var name, from `step` to `stage` ( #9055 )
2021-08-23 19:37:28 +00:00
Sean Benhur J
c49786bed3
Fixes colab links for lightning in 2steps documentation ( #9038 )
...
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-08-23 19:25:21 +00:00
Adrian Wälchli
495812878d
governance updates in documentation ( #9025 )
...
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-08-23 20:12:05 +05:30
Ethan Harris
6de66eb110
Fix governance references in docs ( #8984 )
2021-08-19 00:10:27 +02:00
Sean Naren
c6b6888387
Add DeepSpeed Stage 1 + doc improvements for model parallel ( #8974 )
...
* Add stage 1 support + small doc improvements
* Add CHANGELOG.md
2021-08-18 19:40:19 +05:30
ananthsub
6992db524b
Update governance.rst ( #8956 )
2021-08-17 11:18:43 -07:00
Sean Naren
32c7cced54
Fix CheckpointIO doc annotations ( #8931 )
2021-08-16 10:02:05 +00:00
Swaroop
6dd3a6c564
A minor syntax correction ( #8925 )
...
Removed an extra quote - "
2021-08-16 02:25:26 +05:30
ananthsub
037a86c873
Remove write_predictions from LightningModule ( #8850 )
...
* Remove write_predictions from LightningModule
2021-08-14 02:00:23 +00:00
Sean Naren
b2973a035e
Introduce CheckpointIO Plugin ( #8743 )
2021-08-13 17:35:31 +01:00
ananthsub
fec4f283bc
Update DataModule docs following property deprecations ( #8864 )
2021-08-12 10:02:26 -07:00
ananthsub
b47e3ab7ce
Remove truncated_bptt_steps from Trainer constructor ( #8825 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-11 03:26:01 +00:00
Carlos Mocholí
cb2a8ed1b8
Add `LightningCLI(run=False|True)` ( #8751 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-10 15:01:36 +02:00
Adrian Wälchli
e541803636
remove deprecation of gpu string parsing behavior ( #8770 )
2021-08-06 15:41:03 +00:00
Carlos Mocholí
4928dc5579
Improve SWA docs ( #8717 )
2021-08-05 16:07:50 +00:00
Sean Naren
49df107bdd
[docs] Update FSDP instructions and add DeepSpeed evaluate/predict example ( #8713 )
2021-08-04 15:21:30 +00:00
Sean Naren
98319f83bf
Reduce title length ( #8709 )
2021-08-03 23:17:10 +02:00
Sean Naren
49d03f87fe
[docs] Update deepspeed docs, add some more information and link to streamlit ( #8691 )
2021-08-03 16:12:36 +00:00
Sean Naren
a1be6217ce
Expand the use cases, move them up for discoverability ( #8692 )
2021-08-03 11:47:20 +00:00
Jirka Borovec
f67892ea96
CI: yesqa ( #8564 )
...
* add yesqa
* fix flake8
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-08-02 16:05:56 +00:00
Adrian Wälchli
16392a7de7
Update links for `zero_grad` to PyTorch docs ( #8618 )
2021-07-30 16:09:36 +02:00
Wei Ji
a78709751a
Reverse width, height to height, width in docs ( #8612 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-30 13:56:17 +00:00
Carlos Mocholí
93784da2c3
Fix pre-commit blacken-docs failures ( #8624 )
2021-07-30 12:10:15 +00:00
Carlos Mocholí
bb4887368c
Docs improvements around hparams ( #8577 )
...
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-07-30 11:06:03 +00:00
Carlos Mocholí
47c47faeae
Remove `outputs` in `on_train_epoch_end` hooks ( #8587 )
2021-07-28 18:27:54 +02:00
Jirka Borovec
0a71fe2859
CI: black docs ( #8566 )
...
* black docs
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-28 18:08:31 +02:00
Sean Naren
aadd2a9d9c
Load ckpt path when model provided in validate/test/predict ( #8352 )
...
* Change trainer loading behaviour for validate/test/predict
* Fix
* Fix/add tests
* remove
* Cleanups
* Space
* cleanups
* Add CHANGELOG.md
* Move after setup
* Cleanups on logic
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Remve
* fix test
* feedback
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update pytorch_lightning/trainer/properties.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Feedback
* Same fix
* Same fix
* Add test for behaviour, modify based on feedback
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Wording
* Apply suggestions from code review
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Cleanup docs
* Update pytorch_lightning/trainer/trainer.py
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
* feedback
* Fixes to test API
* Add carlos description
* Move logic further
* Move checkpoint connector logic
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-07-28 10:12:46 +00:00
Kaushik B
39de7fefeb
Lightning Release v1.4 ( #8579 )
...
* Update Lightning version to v1.4
* update notebooks
* Update release date in Changelog
* docs
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-27 14:00:13 +00:00
edenlightning
c7e5743d54
Update cloud docs ( #8569 )
...
* amp
* amp
* docs
* add guides
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* amp
* amp
* docs
* add guides
* speed guides
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Delete ds.txt
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update conf.py
* Update docs.txt
* remove 16 bit
* remove finetune from speed guide
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* remove early stopping from speed guide
* remove early stopping from speed guide
* remove early stopping from speed guide
* fix label
* fix sync
* reviews
* Update trainer.rst
* Update trainer.rst
* Update speed.rst
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* managing data
* managing data
* amp
* amp
* docs
* sync
* sync
* amp
* amp
* add data guide
* from review
* Apply suggestions from code review
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Apply suggestions from code review
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* from review
* from review
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add data guide
* add data guide
* add data guide
* sync issues
* from reviw
* Update docs/source/guides/data.rst
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
* add info if import fails
* fix cross referencing
* Add Datamodule motivation
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* grid docs
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update cloud_training.rst
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-27 16:22:52 +03:00
Aslı Sabancı
4605e8a4a5
Add missing highlighting for Python snippets ( #8411 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-07-27 13:22:05 +02:00
Max
d90cb7fceb
Bugfix: Scheduler monitor for manual optimization ( #7643 )
...
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-07-27 16:04:14 +05:30
Adrian Wälchli
eaa16c7480
docs: explain how Lightning uses closures for automatic optimization ( #8551 )
2021-07-26 15:40:16 +00:00
Carlos Mocholí
e63968ab88
Add `pyupgrade` to `pre-commit` ( #8557 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 14:38:12 +02:00
Carlos Mocholí
a64cc37394
Replace `yapf` with `black` ( #7783 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
Adrian Wälchli
c519fce6fe
docs: clarify closure usage in gan example ( #8521 )
...
* clarify closure usage in gan example
* Update docs/source/common/optimizers.rst
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* remove empty line
* Update docs/source/common/optimizers.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* do not capitalize if not a sentence
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-26 09:51:21 +02:00
Kaushik B
ef7d41692c
Add `ddp_*_find_unused_parameters_false` to Plugins Registry. ( #8483 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-24 04:02:54 +00:00
William Falcon
54cb009dd3
Update governance.rst
2021-07-23 07:41:18 -04:00
edenlightning
20fc8cf063
[Docs revamp 2/N] New doc for managing data ( #8034 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
2021-07-22 01:42:08 +00:00
Caleb Robinson
0ac9e2ae60
Adding appends to some of the pseudocode blocks ( #8427 )
2021-07-20 10:09:31 +02:00
Ethan Harris
7c07452615
Add LSFEnvironment to API reference ( #8423 )
2021-07-15 17:40:22 +03:00
Jamie
7f19930fe5
Tidy up IPU documentation ( #8401 )
2021-07-14 20:12:42 +05:30
Kaushik B
b069493b15
Add troubleshooting section for tpus ( #8277 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-12 13:29:02 +00:00
Andrew Tritt
3102922647
Add LSF support ( #5102 )
...
* add ClusterEnvironment for LSF systems
* update init file
* add available cluster environments
* clean up LSFEnvironment
* add ddp_hpc as a distributed backend
* clean up SLURMEnvironment
* remove extra blank line
* init device for DDPHPCAccelerator
We need to do this so we don't send the model to the same device from multiple ranks
* committing current state
* add additional methods to ClusterEnvironments
* add NVIDIA mixin for setting up CUDA envars
* remove troubleshooting prints
* cleanup SLURMEnvironment
* fix docstring
* cleanup TorchElasticEnvironment and add documentation
* PEP8 puts a cork in it
* add set_ranks_to_trainer
* remove unused import
* move to new location
* update LSF environment
* remove mixin
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* changelog
* reset slurm env
* add tests
* add licence
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* test node_rank
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add lsf env to docs
* add auto detection for lsf environment
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix is_using_lsf() and test
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-09 16:14:26 +02:00
Dusan Drevicky
1b06edf2f2
Add the `on_before_optimizer_step` hook ( #8048 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-07-09 13:30:52 +02:00
Sean Naren
31fca1658d
[docs] Add NCCL environment variable docs ( #8345 )
...
* Add nccl env variable docs
* Wording
* Update docs/source/guides/speed.rst
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-07-09 11:27:18 +00:00
thomas chaton
1c825a2a9c
Add the `on_before_backward` hook ( #7865 )
...
* Add callback to hook tests and add predict test
* Fix lambda callback test
* Simplify lambda call test
* Use LambdaCallback
* Dynamically append to called for the model
* Remove print
* Consistency
* Consistency
* Prepare args/kwargs testing
* yapf doesn't like dict literals
* Add arguments for fit no val test
* Add arguments for fit no val test
* add before_backward_hook
* add test
* resolve flake8
* resolve tests
* update changelog
* add on_before_backward to LightningModule
* update on comments
* Test arguments
* Datamodule refactor
* Fix eval test
* remove extra file
* resolve bug
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* move to hooks
* update
* resolve flake8
* update on comments
* Update full fit + val test
* Update test
* Remove FIXME
* Remove FIXME
* Undo change
* Fix
* Parametrize fit hook test
* Comment
* Parametrize fit hook test with different precision plugins
* Fix tests
* Parametrize fit hook test with manual optimization
* Unnecessary parenthesis
* WIP
* Comments
* Fix message
* Test CI error
* Revert "Test CI error"
This reverts commit 39c4a85a83
.
* Add ddp training type teardown
* Update CHANGELOG
* Adrian's fix
* Use destructor
* Update CHANGELOG.md
* RPC destructor
* Update pytorch_lightning/plugins/training_type/ddp.py
* Why do you not work :(
* Missing condition
* Fix deepspeed test
* GC collect in conftest
* Do not show warnings for special tests
* Needs to run on 1.8
To avoid: "RuntimeError: NCCL error in: /pytorch/torch/lib/c10d/ProcessGroupNCCL.cpp:32, unhandled cuda error, NCCL version 2.4.8"
* Run torch 1.8
* Skip test due to 'Python bus error'
* Debug NCCL
* shm size
* Disable warnings for special tests
* Remove NCCL_DEBUG statement
* Try smaller shm size
* Revert "Skip test due to 'Python bus error'"
This reverts commit e0a3e8785d
.
* README and adjust versions
* Avoid self.on_gpu call
* empty cache cleanup
* More garbage collection
* Unroll parametrizations
* Do not reuse mock
* Undo changes
* Undo notebooks modification
* resolve test
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* delete file
* Undo
* Fix test
* Revert "WIP"
This reverts commit f5828a8c42
.
* Rename
* Remove optimizers
* Fix bug with LightningOptimizer
* Add optimizers
* update
* update
* Update CHANGELOG
* On after backward refactor
* Do not call super
* Fixes
* Remove should_accumulate
* pre/post backward refactor
* Call the LM backward hook
* Update tests
* Remove dev debug patch
* Fix test
* Remove optimizer arguments and typing
* Docs fixes
* Fix comment
* Undo changes
* Split manual and auto
* Undo change
* Deepsource
* Remove optimizers
* Undo changes
* Call the hook
* Docs
* Docs
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-09 06:15:57 +00:00
Mauricio Villegas
7d3452a000
LightningCLI documentation improvements ( #8303 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-08 12:35:26 +05:30
Ethan Harris
56697dd894
Add logo_light.svg ( #8327 )
2021-07-07 17:24:31 +00:00
Sean Naren
01f594baf4
Add quick docs for deepspeed infinity ( #8323 )
2021-07-07 15:58:27 +02:00
Sean Naren
fc12fe721f
Remove RC candidate install ( #8322 )
2021-07-07 12:21:12 +00:00
Sidhant Sundrani
20df24d2a2
Enables reload of dataloaders on every n epochs from every epoch ( #5043 )
...
* edit arg to reload_dataloaders_every_n_epoch
* init reload_dataloaders_every_n_epoch
* edit logic to reload dl
* update arg to test datamodule
* update arg test dataloader
* edit reload dl logic in eval loop
* fix var name in reset_train_val_dataloaders
* fix error, use current_epoch attribute
* edit every_n_epoch to every_n_epochs
* edit every_n_epoch to every_n_epochs
* edit every_n_epoch to every_n_epochs
* edit every_n_epoch to every_n_epochs
* edit every_n_epoch to every_n_epochs
* edit every_n_epoch to every_n_epochs
* assert reload_dataloaders_every_n_epochs positive
* assert reload_dataloaders_every_n_epochs positive
* add trainer property should reload dl
* update should reload dl in train loop
* condition on should reload dl in eval loop
* pep8
* fix update should reload dl in train loop
* add test case
* replace assertion with misconfig exception
* remove unused variable
* remove unnecessary checks
* replace to BoringModel
* remove unrequired comment
* deprecate _every_epoch
* add deprecated argument to trainer
* test case for deprecated arg
* remove unrequired assertion in train loop
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* modify misconfig exception for int
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* conv bool to int of depreciated _every_epoch
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* update description of deprecated param
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* update deprecation warning
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* modify argument to int only
* fix deprecated test function name
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* merge tests for reload dls
* add propery should reload dl
* removed and added to trainer property
* use property in train loop
* remove deprecated test
* add deprecated test to new file
* test case for exception
* update test datamodule every_n_epochs
* update trainer docs
* update hooks with every_n_epochs
* edit format if statement
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update CHANGELOG.md
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* typo in exception
* pytest check only misconfig exception
* remove unnecessary code in test
* remove unnecessary code in deprec test
* added match in test
* typo in comment
* revert to prev, keep only req in context manager
* Apply suggestions from code review
* docs
* rebase
* Apply suggestions from code review
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix import: model_helpers instead of model_utils
* fix, add reload_dataloaders_every_n_epochs argument to data connector
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add required imports
* move deprecated log
* add missing import rank_zero_warn
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update varname in should_reload_dl_epoch
suggestion from code review
* Fix CHANGELOG. Update deprecation versions
* Minor change
* change property name, mark protected
* update property name
* update property name
* Remove deprecated *_loop.py files
* Rename test func
* Update CHANGELOG.md
* use rank_zero_deprecation
* update deprecation message in trainer api docs
* test deprecation with real arg name in message
* fix typo in trainer docs
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-07 13:10:08 +02:00
William Falcon
e148a1339a
Update governance.rst
2021-07-07 11:39:19 +02:00
Kaushik B
365a9bae33
Update Torch Elastic documentation ( #8248 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-02 03:47:58 +05:30
Guillaume Tauzin
baa7de2d9e
Fix truncated_bptt_steps hiddens detach() and improve docs ( #8145 )
...
* Fix truncated_bptt_steps hiddens detach()
* Improve truncated_bptt_docs
* Add missing import
* Improve documentation wordings
* pep8
* detach typo
* Update test
* Implement comments
* parametrize test
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Signed-off-by: Guillaume Tauzin <guillaumetauzin.ut@gmail.com>
* Remove import
Signed-off-by: Guillaume Tauzin <guillaumetauzin.ut@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-01 22:16:14 +01:00
Ethan Harris
c0caeb3ea9
Update docs for new template ( #8232 )
...
* Update docs for new template
* Fixes
* Fixes
* Drop links
2021-07-01 16:19:09 +01:00
Mauricio Villegas
3c74502919
Add support for optimizers and learning rate schedulers to LightningCLI ( #8093 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-01 12:04:11 +02:00
SATISH J
4af8eff0a1
fix: training_step_end doesn't work as stated in docs ( #8188 )
2021-06-30 00:24:06 +00:00
thomas chaton
24db914093
Support state restoration of logged results 2/2( #7966 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-06-25 19:16:11 +00:00
edenlightning
d4d5418cc4
Fix notebook links ( #8089 )
...
* Fix notebook links
* update
* BERT
* docs
* Update README.md
* Apply suggestions from code review
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-06-23 21:36:31 +00:00
Carlos Mocholí
4d9b72b8a9
Nuke RPC ( #8101 )
2021-06-23 18:31:13 +00:00
Edgar Riba
b378806b6c
Add `add_to_queue`/`get_from_queue` for DDP spawn( #7916 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-23 03:19:37 +02:00
edenlightning
599d6db10f
Fix Grid run commands ( #8021 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
2021-06-18 01:24:15 +00:00
Jirka Borovec
7978a5376d
Ipynb update ( #8004 )
...
* git submodule update --remote
* update notebooks in docs
* prune
* _notebooks
* docs
* path
* path
* ignore
* head
2021-06-17 16:46:05 +02:00
edenlightning
5647087f03
New speed documentation ( #7665 )
...
* amp
* amp
* docs
* add guides
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* amp
* amp
* docs
* add guides
* speed guides
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Delete ds.txt
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update conf.py
* Update docs.txt
* remove 16 bit
* remove finetune from speed guide
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* speed
* remove early stopping from speed guide
* remove early stopping from speed guide
* remove early stopping from speed guide
* fix label
* fix sync
* reviews
* Update trainer.rst
* Update trainer.rst
* Update speed.rst
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-06-16 21:28:51 +00:00
thomas chaton
917cf83638
[doc] Add more reference around predict_step ( #7997 )
...
* add predict examples
* update on comments
2021-06-16 12:23:27 +01:00
Mauricio Villegas
0004216f2f
Easier configurability of callbacks that should always be present in LightningCLI ( #7964 )
...
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-06-16 02:03:37 +02:00
Carlos Mocholí
560b1970af
Standardize positional datamodule and argument names ( #7431 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-06-15 11:50:13 +00:00
Sean Naren
0974d66c6c
Add docs for IPUs ( #7923 )
...
* Added base docs for IPUs
* Fix
* Add details around poptorch profiler and model parallelism
* more description
* Add image
* Clearer messaging
* Cleanup
* Better name
* Add note
* Add some details around device iterations and model parallelism
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Add a small install comment
* Add clip gradients not supported
* Update docs/source/advanced/ipu.rst
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
* Add note
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-06-15 10:16:47 +00:00
Eugene Huang
898fb56b16
added on_test_start() documentation ( #7962 )
...
Co-authored-by: ehuang68 <>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-06-14 14:19:48 +00:00
Adrian Wälchli
20a5e09e33
fix myst-parser warning blocking docs ci ( #7967 )
2021-06-14 11:17:53 +00:00
Mauricio Villegas
cdd01f32da
LightningCLI support for argument links applied on instantiation ( #7895 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-12 13:13:14 +02:00
Carlos Mocholí
ec4f8856af
Enable logger connector re-design ( #7891 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-06-09 14:24:45 +00:00
Jirka Borovec
0fda862274
Refactor notebooks ( #7752 )
...
* drop notebooks
* add submodule
* copy notebooks
* docs include ipynb
* fix headers
* CI
* readthedocs
* manifest
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* req
* workdir
* pandoc
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* pandoc
* manifest
* Apply suggestions from code review
* fix versions
* checkout
* `git submodule update --init --recursive --remote`
* notebooks @docs
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-06-08 16:30:13 +00:00
thomas chaton
ea71cf4a5f
[Test] Add extra test for val_check_interval in distributed scenario ( #7863 )
...
* add extra test
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add computation
* Update docs/source/common/trainer.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update docs/source/common/trainer.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update tests/trainer/test_dataloaders.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* use tmpdir
* update on comments
* update
* Update tests/callbacks/test_progress_bar.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-06-07 10:37:32 +00:00
Adrian Wälchli
acd38dd406
update docs example with sharded eval step ( #7748 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-06-07 09:49:41 +01:00
Guillaume Tauzin
1da1898d41
[docs] Fix truncated_bptt_steps docs ( #7846 )
2021-06-06 18:31:14 +00:00
thomas chaton
51d370f4c2
[doc] Move each profiler to its own file + Add missing PyTorchProfiler to the doc ( #7822 )
2021-06-04 21:08:29 +05:30
Sean Naren
0a72fd2284
Add FSDP docs ( #7791 )
...
* Add FSDP docs
* Address reviews
* Add note about how FSDP can replace pipe parallelism
* Add import
* Remove sentence
2021-06-02 09:52:48 +00:00
Kaushik B
e4ba06c70f
Replace deprecated distributed_backend by acc in examples ( #7795 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-06-02 07:43:24 +02:00
Boris Dayma
9097347ea8
feat(wandb): log models as artifacts ( #6231 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-27 20:15:02 +02:00
Carlos Mocholí
906c067b07
Update hooks pseudocode ( #7713 )
2021-05-27 12:27:26 +02:00
Kaushik B
b1a7b7e9bf
Add `tpuvm` section in TPU docs ( #7714 )
2021-05-26 12:41:00 +00:00
Aki Nitta
71c1017092
Update sphinx version to 4.0 or later ( #7716 )
2021-05-26 11:33:24 +02:00
Carlos Mocholí
110e49dc99
De-duplicate `DistributedSampler` mentions ( #7636 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-05-21 23:01:13 +02:00
Nik
751975e39f
fix flag name to flush_logs_every_n_steps in logging doc ( #7633 )
...
* fix method name to flush_logs_every_n_steps in logging doc
* apply corrections in comments
2021-05-21 10:50:13 +00:00
deng-cy
03ea68f8a2
removed hparams assignment example ( #7639 )
2021-05-21 11:15:38 +01:00
Fernando Pérez-García
485554c8b0
Add link to TorchIO tutorial in PyTorch Ecosystem examples ( #7612 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-05-19 21:06:26 +00:00
Jensun Ravichandran
922c0a607b
Fix incorrect code-snippet in optimizers doc ( #7598 )
...
`training_step(...)` should take `self` as the first argument. It's a simple but necessary fix.
2021-05-19 19:33:09 +00:00
Nic Eggert
f4f51e0dcf
Add kubeflow cluster environment ( #7300 )
...
* Add kubeflow cluster environment
* Add KubeflowEnvironment to docs
* Add KubeflowEnvironment to the changelog
* break up a long line
* Add method to detect kubeflow environment
* Select Kubeflow environment when available
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Run pre-commit
* task_idx == 0
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-17 09:05:24 +01:00
Loic Beheshti
e126649d19
add missing punctuation in lightning_cli.rst ( #7554 )
2021-05-15 00:26:47 +00:00
Jirka Borovec
53f8d9a800
update alumni ( #7545 )
2021-05-14 19:06:12 +02:00
Jirka Borovec
233f252bb4
update logo 48px ( #7530 )
2021-05-13 22:33:12 +02:00
Rohit Gupta
7ca41734da
Add `dataloader_idx` to batch transfer hooks ( #6241 )
...
* replace with kwargs
* chlog
* fix
* add test
* fix
* device
* deepspeed
* pep
* optional
* docs
* bc
* comments
* pep
* mypy
* pep
* Apply suggestions from code review
* kwargs
* docs
* .
* .
* 1.3 -> 1.4
* kwargs -> step_kwargs
2021-05-13 23:03:55 +05:30
Carlos Mocholí
a584196abf
Default `seed_everything(workers=True)` in the `LightningCLI` ( #7504 )
2021-05-13 12:18:03 +02:00
Carlos Mocholí
b65ae79478
Automatically check `DataModule.has_{setup,teardown,prepare_data}` [2/2] ( #7238 )
...
* Automatically check `DataModule.has_{setup,teardown,prepare_data}`
* Use variable
* Spacing
* Docs
* Update CHANGELOG
* Remove `_DataModuleWrapper`
* Add test
* Update docs/source/extensions/datamodules.rst
* Bad merge
* add test for invalid name
* Remove ValueError
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-11 10:53:00 +02:00
Justus Schock
f6fe715e73
Fix Sphinx argument deprecation ( #7464 )
2021-05-10 17:30:23 +02:00
edenlightning
3ec54203bb
Fix slack link ( #7452 )
...
* Update README.md
* Update Slack link
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2021-05-10 08:50:14 +00:00
edenlightning
159308e4ef
Update introduction_guide.rst ( #7453 )
2021-05-10 08:49:54 +00:00
ananthsub
f9e050c5e5
Move DP warning suppression to the DataParallel Plugin ( #7421 )
2021-05-07 23:02:44 +02:00
Carlos Mocholí
8208c330eb
Use `torch.nn.utils.clip_grad_norm_` and add `clip_grad_by_value` support for TPU ( #7025 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-05-07 16:41:39 +00:00
Carlos Mocholí
9ba76ce60c
Unify `configure_optimizers` docs ( #7399 )
2021-05-07 16:10:24 +02:00
Sean Naren
94f6c3e160
Advanced GPU Documentation ( #7259 )
...
* Added advanced gpu section
* Small changes
* Better documentation
* Address code review
* Add warning about using trainer.model, clean up some of the examples
* Add section for ddp, remove references and old sequential documentation
* Remove Fully Sharded documentation for now
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
* Address code review
* Address code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-05-06 13:53:20 +01:00
Martin Kristiansen
c3fc0313ef
Updating docs and error message: half precision not available on CPU ( #7384 )
...
* Updating docs and error message to specify that half precission not available on CPU
* update messages
Co-authored-by: Martin Kristiansen <martinkristiansen@sixgill.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: jirka <jirka.borovec@seznam.cz>
2021-05-06 09:05:50 +00:00
Adrian Wälchli
49c8740338
update docs about transfer_batch_to_device hook while using DP ( #7343 )
...
* update
* clarify
* update
2021-05-05 13:51:16 +00:00
ananthsub
98670c83a9
Deprecate`truncated_bptt_steps` flag on Trainer in favor of same setting on the LightningModule ( #7323 )
...
* deprecate-tbptt-trainer
* Update CHANGELOG.md
* Update lightning.py
* test
* Update lightning.py
* Update training_loop.py
* Update training_loop.py
* Update lightning.py
* Update training_loop.py
* Update training_loop.py
* update docs
* Update accelerator.py
* Update accelerator.py
* more docs
* tweaks
* chlog
* comments
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-05-05 11:21:00 +01:00
Adrian Wälchli
a6aa1a0f82
make gpus=str in Trainer consistent with command line parsing of string ( #6388 )
...
* string gpu input
* update docs
* deprecation warning
* Revert "update docs"
This reverts commit c5f3893413
.
* deprecation
* add changelog
* update parser
* update warning
* implement v1.5 behavior ahead of time
* formatting
* set accelerator in test to avoid different warning
* add warning
* remove todo warn
* Update pytorch_lightning/utilities/device_parser.py
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
* resolve flake8
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: tchaton <thomas@grid.ai>
2021-05-04 09:56:27 +00:00
SpontaneousDuck
f135debb6a
Clarify logger flag ( #7190 )
...
* Clarify logger flag
Clarify behavior of boolean values on the logger flag for Trainer.
* Update docs/source/common/trainer.rst
* doc
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-05-04 00:21:28 +00:00
Daniel Mesejo-León
6da747e775
Deprecate `LightningModule.datamodule` reference in favor of the trainer one ( #6929 ) ( #7168 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-05-04 00:01:41 +00:00
Mauricio Villegas
78a6fd5588
Example and documentation for LightningCLI linking model and data arguments ( #7299 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-03 20:45:46 +00:00
Carlos Mocholí
5af086ab9f
Attach data refactor and tuner bugs [4/n] ( #7258 )
...
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-30 13:54:58 +00:00
PythicCoder
8bffa4f0ca
Updated docs to fix typo and update grid status ( #7270 )
...
* Updated docs to fix typo and update grid status
* Update docs/source/starter/new-project.rst
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* Update docs/source/starter/new-project.rst
* Update docs/source/starter/new-project.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-30 12:45:17 +01:00
Ethan Harris
7a48db591e
Fixes a potential bug on pip install ( #7256 )
...
* Fix install bug
* Better fix
* Fix
* Fix
* Remove unused import
* Update docs conf.py
* Updates
2021-04-29 03:15:09 +05:30
Mauricio Villegas
78d45a1134
Improve `LightningCLI` documentation and tests ( #7156 )
...
* - Added cli unit tests for help, print_config and submodules.
- Added to cli documentation use of subclass help and print_config, submodules and other minor improvements.
- Increased minimum jsonargparse version required for new documented features.
* Improvements to lightning_cli.rst
* Add check for all trainer parameters in test_lightning_cli_help
* Increased minimum jsonargparse version
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-28 09:34:32 +01:00
Adrian Wälchli
bfac0e899f
warn about dp + manual optimization in docs ( #7230 )
...
* add warning
* typo
* add link
2021-04-28 09:01:06 +01:00
thomas chaton
e76ebd640e
[feat] Add BasePredictionWriter 3/3 ( #7127 )
...
* wip
* update
* update
* update
* update
* update
* typo
* update on comments
* update
* update
* update
* update
* update changelog
* update
* Fix merge
* Fix merge
* move code
* resolve test
* add extra test
* add an extra test
* update on comments
* add typing
* resolve flake8
* Refactor and Docs
* Fix tests
* Fix tests
* Fix tests
* Duplicate
* Fix tests
* resolve bug
* update
* update on comments
* Update pytorch_lightning/utilities/imports.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/utilities/device_parser.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* update
* update
* update
* update on comments
* resolve flkae8
* update test
* Apply suggestions from code review
* update on comments
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* update on comments
* update
* update on comment
* Apply suggestions from code review
* update
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-04-27 20:23:55 +00:00
Kaushik B
5cf9afa176
Add fairscale install msg for Sharded Plugins ( #7213 )
2021-04-27 08:22:44 +00:00
Adrian Wälchli
d534e53ec4
add missing predict docs ( #7150 )
...
* update docs
* add datamodule predict
* fix docs
* typo
2021-04-23 10:38:44 +00:00
Carlos Mocholí
d6470bf193
Delete unused CI scripts ( #7152 )
2021-04-22 03:07:48 +02:00
Carlos Mocholí
345e9a0245
Fix argparse docs ( #7148 )
2021-04-22 02:13:00 +02:00
Adrian Wälchli
d902181b50
Update `ClusterEnvironment` docs ( #7120 )
...
* update cluster
* update index
* update references
* update grid docs
* update duplicated title
* Update docs/source/clouds/cloud_training.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* fix doctest
* Remove self-balancing section
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-22 01:38:16 +02:00
Adrian Wälchli
e4f3a8d3dd
Update `EarlyStopping` docs ( #7121 )
2021-04-21 01:23:36 +02:00
edenlightning
1a68dcd9a2
Update governance.rst ( #7111 )
2021-04-20 16:55:49 +02:00
Akihiro Nitta
0302b8be32
Disable `lr_scheduler.step()` in manual optimization ( #6825 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-04-20 13:00:45 +02:00
Adrian Wälchli
24248d6dd4
Update community example links ( #7087 )
...
Co-authored-by: tchaton <thomas@grid.ai>
2021-04-20 06:56:59 +00:00
Adrian Wälchli
60c1c8fe83
Auto-set `DataLoader.worker_init_fn` with `seed_everything` ( #6960 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-04-19 16:28:37 +02:00
Akihiro Nitta
d1529c28a1
Optimization docs ( #6907 )
...
* .
* .
* Fix link to the section
* Fix link to the section
* Consistent indent
* Update docs
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Add note for optimizer.optimizer
* .
* Update hooks
* Update closure docstring
* Update optimizer methods
* Update optimizer
* Remove manopt + grad clipping (by @flukeskywalker)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-04-19 10:08:49 -04:00
Carlos Mocholí
a5e356adb1
Deprecate `@auto_move_data` in favor of `trainer.predict` ( #6993 )
...
* Deprecated `@auto_move_data` in favor of `trainer.predict`
* Update CHANGELOG
2021-04-19 14:53:21 +01:00
Adrian Wälchli
e9fca760ac
Set `DistributedSampler` seed if `seed_everything` was called ( #7024 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-19 14:50:31 +01:00
Adrian Wälchli
67d21609c9
Add Trainer max_time argument + Callback ( #6823 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2021-04-16 13:38:57 +02:00
Matthew Sarmiento
402a258705
[docs]: pass parser to Trainer.add_argparse_args() ( #7029 )
2021-04-16 01:52:47 +02:00
Sean Naren
7b0b6c3112
Update DeepSpeed docs after single saving PR ( #7036 )
2021-04-15 08:56:04 -07:00
Mauricio Villegas
f852a4f592
Changed basic_examples to use `LightningCLI` ( #6862 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-04-15 15:01:16 +00:00
Jirka Borovec
895bea1ad3
rename about ( #7002 )
...
* rename about
* .
* ..
2021-04-14 18:56:40 -04:00
Adrian Wälchli
d3f73a0a74
Plugin Docs ( #6952 )
...
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-04-14 20:53:21 +00:00
shuyingsunshine21
03a73b37bc
Train End Error Handling Fix ( #6864 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
2021-04-14 20:35:42 +02:00
Daniele Acquaviva
fb02972dde
Fixed wrong on_fit_start callback reference in documentation ( #7001 )
...
Co-authored-by: Daniele Acquaviva <danieleacquaviva@Danieles-MacBook-Pro.local>
2021-04-14 01:19:27 +02:00
Jirka Borovec
4cf6bfac48
update notebooks ( #6968 )
2021-04-13 23:04:46 +00:00
Jirka Borovec
f2021ed225
docs: lightning-bolts ( #6967 )
2021-04-13 18:49:48 +00:00
Ethan Harris
b9bc77293b
Fix inconsistent outputs in `on_*_end` and `*_end` ( #6969 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-13 15:16:21 +01:00
Adrian Wälchli
20ff50caa6
Accelerator API docs ( #6936 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-04-10 12:25:07 +05:30
Jirka Borovec
3baac71252
v1.3.0rc1 ( #6925 )
...
* v1.3.0rc1
* .
2021-04-09 10:36:06 -04:00
Carlos Mocholí
128f6ab508
Add separators to performance docs ( #6882 )
2021-04-08 08:22:50 +01:00
Carlos Mocholí
19e67d18c4
Docs fixes ( #6870 )
2021-04-07 16:57:22 +01:00
Anthony Kim
7f6154fcad
Add `Trainer(gradient_clip_algorithm='value'|'norm')` ( #6123 )
...
* add changelog
* add clip by value
* fix bug in training tricks.rst
* fix bug in trainer.rst
* Update trainer.rst
* Update trainer.rst
* Update CHANGELOG.md
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/precision/deepspeed_precision.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/utilities/enums.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* yapf formatting
* update training tricks
* update based on comment
* update based on comment
* Update pytorch_lightning/trainer/trainer.py
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* update based on comment
* pep8
* mypy
* mypy
* Update docs/source/advanced/training_tricks.rst
Co-authored-by: thomas chaton <thomas@grid.ai>
* Update sharded_native_amp.py
* Update test_sharded_parity.py
* update test codes
* Update test_tpu.py
* Update pytorch_lightning/trainer/connectors/training_trick_connector.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update test_trainer.py
* Update enums.py
* Update enums.py
* add super-class initialization to precision plugins.
* add clip_grad horovod cpu test
* add clip_grad horovod cpu test
* use subprocess check_call
* change order of horovod tests
* set max_epochs 2 in horovod test
* remove clip_grad_val test from horovod-cpu
* remove "type: ignore"
* divide clip grad val test in horovod
* update based on comments
* add super-class initialization to precision plugins.
* bugfix
* bugfix
* revert some changes
* revert some changes
* Update tests/models/test_horovod.py
* merge master
* Delete signature test
No point in testing a signature
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-04-06 08:27:37 -05:00
Mauricio Villegas
b7f3a3c421
Simple reproducibility with minimum boilerplate CLI training with `LightningCLI` ( #4492 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-06 14:19:11 +01:00
Kaushik B
22a266d8b8
Update TPU docs for installation ( #6794 )
2021-04-04 00:19:43 +05:30
Elizaveta Logacheva
f8a379830d
Remove extinct parameters from lightning_module.rst ( #6801 )
...
Fixes #6800
2021-04-02 20:49:20 +02:00
Carlos Mocholí
0dd2deebea
Remove legacy support for the magic `log`/`progress_bar` keys in dict returns ( #6734 )
2021-03-31 00:28:04 +02:00
Sean Naren
f9bb7c641a
DeepSpeed ZeRO Docs update ( #6752 )
...
* Added base docs
* Add more information
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-30 21:52:02 +00:00
Akihiro Nitta
9876df16a2
[docs] Update Bolts link ( #6743 )
...
* Update Bolts link
* Update Bolts link
* formt
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-30 22:52:59 +05:30
Carlos Mocholí
f0c5479de9
Remove legacy `Result` parameters ( #6016 )
2021-03-28 11:55:08 +02:00
Carlos Mocholí
bc613611e2
Do not add return dict items to callback_metrics ( #6682 )
2021-03-26 14:05:20 +01:00
Jirka Borovec
217c12a4e7
Simplify deprecations ( #6620 )
...
* use external deprecate
* simplify
* simplify
* simplify
* flake8
* .
* others
* .
2021-03-25 15:26:38 +01:00
Rohit Gupta
9be092dbdb
Add on_epoch_start to run at the beginning of every loop irrespective of train/val/test ( #6498 )
...
* update docs
* add hook and update docs
* update tests
* chlog
* Update CHANGELOG.md
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* chlog
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-25 14:20:49 +01:00
ananthsub
40976e4eba
Support teardown hook on DataModule ( #4673 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
2021-03-25 07:51:55 -05:00
Ethan Harris
d02fe342c1
Feature/double precision ( #6595 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-03-24 15:47:58 +05:30
Jirka Borovec
5733889203
Docs/robots ( #6658 )
2021-03-24 10:46:56 +01:00
Eric Rubiel
b1e3dcc607
Use `pl.LightningModule` in new-project docs ( #6656 )
2021-03-24 00:08:57 +01:00
thomas chaton
0995d30fab
Flash predict step ( #6577 )
...
* add predict_step
* Update predict_loop.py
* Update trainer.py
* Update trainer.py
* resolve bugs
* update
* update
* update
* resolve bug
* resolve some failing tests
* udpate tests
* update
* resolve tests
* add a test
* remove typo
* add a test for attachement
* update
* changed to on_train_dataloader
* remove __flash_special_attr__
* resolve tests
* update
* update
* update
* update on comments
* Update pytorch_lightning/trainer/data_loading.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-23 11:13:13 -04:00
Jirka Borovec
8cd75a4dd5
fix comparing versions ( #6434 )
...
* fix comparing versions
* chlog
* .
* ...
* datasets
2021-03-23 07:51:45 +00:00
Jirka Borovec
1fae10a2dc
refactoring setup ( #6590 )
...
* refactoring setup
* .
* docs
* flake8
2021-03-22 08:39:19 -04:00