Commit Graph

1417 Commits

Author SHA1 Message Date
Andres Algaba 4fc8275cc3
Remove the deprecated `trainer.call_hook` (#14869) 2022-09-26 15:56:44 +02:00
jsr-p abb6049fa3
Update documentation for the basic skills tutorial level 2 on how to validate and test a model (#14874) 2022-09-24 10:34:06 +00:00
dconathan 633d14e67a
fixed comet -> mlflow typo in visualize/experiment_managers docs (#14843)
fixed comet -> mlflow typo

Co-authored-by: Devin Conathan <devin.conathan@libertymutual.com>
2022-09-24 00:13:28 +02:00
Adrian Wälchli dd2a1c5d29
Integrate Lite Precision into PL (#14798)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-22 14:51:04 +00:00
Laverne Henderson d1303cf628
Updated the structure and applied feedback (#14734) 2022-09-22 11:40:12 +02:00
Laverne Henderson da0ccb11a6
Updates links to components in the Gallery (#14807) 2022-09-21 22:22:05 +00:00
Mauricio Villegas 3064c28ce1
Added args parameter to LightningCLI to ease running from within Python (#14596)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-09-19 17:38:30 +00:00
Laverne Henderson 8c4e17f359
Removes the old HPO content (#14754)
* Removes the old HPO content

* Remove source-lit symlinks for HPO

* drop ref

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-09-19 09:25:57 -04:00
Gilad a5b0f8bd5c
Fix TQDMProgressBar usage in logging.rst (#14768) 2022-09-19 01:07:19 +02:00
Laverne Henderson 9ea4ab6b19
Update installation (#14732)
* Update installation

Updates to use python -m pip install -U lightning and adds troubleshooting note

* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 15:30:32 -04:00
Yurij Mikhalevich 09f50b4295
Fix Google Tag Manager for the Lightning App docs (#14731)
- updates the Lightning App docs theme to the one without Pytorch Lightning docs Google Tag Manager hardcoded
- sets the GTM id in the conf.py for Lightning App docs
2022-09-15 18:35:16 +00:00
Akihiro Nitta 3c5e03e035
docs: Clarify versioning and API stability (#14549)
* mv releases to a standalone page

* Include release_policy in index

* Update policy

* mv releases to a standalone page

* Include release_policy in index

* Update policy

* Update title

* remove release_policy.rst

* Update versioning

* syntax

* simplify wording

* Include examples that don't follow X+2 rule

* syntax

* update

* consistency

* rm noninformative statement

* .

* Reduce redundancy in the deprecation process

* grammar?

* consistency

* Update docs/source-pytorch/versioning.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-15 09:16:14 -04:00
Alec Merdler 71719b9960
Support Injecting Secrets into Apps Running in the Cloud (#14612)
Adds a new '--secret' flag to 'lightning run app':

lightning run app --cloud --secret MY_SECRET=my-secret-name app.py

When the Lightning App runs in the cloud, the 'MY_SECRET'
environment variable will be populated with the value of the
referenced Secret. The value of the Secret is encrypted in the
database, and will only be decrypted and accessible to the
Flow/Work processes in the cloud.

Co-authored-by: Sherin Thomas <sherin@grid.ai>
Co-authored-by: Noha Alon <nohalon@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2022-09-15 09:15:59 -04:00
Laverne Henderson 692f0f3d5d
Resolve minor formatting issue (#14706) 2022-09-15 08:37:50 +00:00
Benjamin Krala c2378bd3b1
Add documentation for trainer.datamodule and dataloaders of a trainer object (#14600)
* Update trainer.rst
* Update datamodule.rst
2022-09-14 15:46:34 +00:00
Krishna Kalyan 14b36f8109
Fix incorrect imports in lightning docs (#14678) 2022-09-14 00:23:31 +02:00
Carlos Mocholí 313c338da1
Remove legacy examples from logging docs (#14686) 2022-09-13 13:47:51 -04:00
Laverne Henderson b24f5f164a
Content for Lightning with iOS and Android (#14038)
* Content for Lightning with iOS and Android

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* make link clickable

* Update docs/source-app/glossary/ios_and_android.rst

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-13 11:04:50 -04:00
Max Ehrlich e5998e6bf2
Make the SLURM Preemption/Timeout Signal Configurable (#14626)
* Add parameter to change the preemption signal
* Make the signal connector use the custom signal from SLURMEnvironment

Signed-off-by: Max Ehrlich <max.ehr@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-12 19:24:35 +00:00
Adrian Wälchli 925edbca07
Remove the deprecated `weights_save_path` Trainer argument (#14424)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-09-12 19:02:38 +00:00
Adrian Wälchli 4f3c47294e
Add troubleshooting section to MPS docs (#14642)
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-09-12 17:35:18 +00:00
Vasilis Vryniotis 7e9e441843
Use TorchVision's Multi-weight Support and Model Registration API on Lightning (#14567)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-09-09 20:04:57 +00:00
Laverne Henderson 3a66798a6c
Update content for S3 persistent storage (#14060)
* Update content for S3 persistent storage
* Updates based on feedback
* Fix unstructured validation issue
* Updates based on feedback

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-09 20:59:03 +02:00
Adrian Wälchli d2459df2ff
Standalone Lite: Remaining Utilities (#14492)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
2022-09-07 15:25:23 +00:00
Kushashwa Ravi Shrimali 6de2b0b528
Docs [Fix]: use bytes instead of strings while writing (#14505)
* Fix doc examples: use bytes instead of strings while writing

* Add a note (comment)

* nit

* Update any_server.rst

* Update docs/source-app/workflows/add_server/any_server.rst

* Update docs/source-app/workflows/add_server/any_server.rst

* Update docs/source-app/workflows/add_server/any_server.rst

* Apply suggestions from code review

Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2022-09-07 09:05:58 -04:00
Dan Nissenbaum 7ada52e33c
Typo in major heading seen by newcomers (#14501)
* Typo in major heading seen by newcomers

Correct typo in one of the first major headings newcomers to Lightning see when they are considering migrating their code to use Lightning.

I know this is a trivial change in terms of the text change itself, but I really think it's valuable for one of the most important landing pages that users first investigating Lightning see - to have rock-solid, professional text without obvious typos. Here was a typo in the main heading itself. I suggest fixing it straightaway via this PR.

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-07 09:06:30 +00:00
Carlos Mocholí 44216fdd69
Integrate `lightning_utilities.core.imports` (#14475)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-06 12:56:20 +00:00
Carlos Mocholí 8a4a3b6766
Mark the lite `DeviceDtypeModuleMixin` as protected (#14548) 2022-09-06 14:17:15 +02:00
Rohit Gupta 8c6119fbce
Add auto wrapping support for `DDPFullyShardedStrategy` (#14383) 2022-09-05 19:07:26 +00:00
Laverne Henderson b19b15546b
Updated basic debugging (#14488)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-02 14:23:29 +05:30
Benjamin Krala cce55b6cd3
Precise description of reload_dataloaders_every_n_epochs (#14245) 2022-09-01 10:06:28 -04:00
Adrian Wälchli 28e18881a9
Mark stage argument in hooks as required (#14064)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2022-09-01 15:47:40 +02:00
thomas chaton a7c01c4754
Introduce lightning connect (#14452)
* update

* update

* update

* update

* Review of content

* Formatting updates

* Fomatting updates

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Updates based on new commits

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

* update

* Introduce lightning connect (#14183)


Co-authored-by: Luca Antiga <luca.antiga@gmail.com>

Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-08-31 15:59:03 -04:00
Carlos Mocholí 10adcd5d12
Remove the unused pyDeprecate dependency (#14472)
* Remove the unused pyDeprecate dependency
* CHANGELOG
2022-09-01 03:30:18 +09:00
Jirka Borovec 208bf6faa8
prepare space for fused docs (#14160)
* copy app conf

* ci + req.

* script symlink

* wip

* keep only App

* add also PL

* lightning

* artifact
2022-08-30 09:25:05 -04:00
Marc Skov Madsen 18e2a8eecd
PanelFrontend and Panel Web UI Intermediate docs (#13531)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Marc Skov Madsen <masma@orsted.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Mansy <ahmed.mansy156@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-08-30 00:33:21 +00:00
Rohit Gupta f3574176e2
Change `trainer.should_stop` to not stop in between an epoch and run until `min_steps/min_epochs` only (#13890) 2022-08-27 12:12:24 +00:00
Adrian Wälchli 250c06e406
Remove deprecated HPC model hooks (#14315)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-26 20:59:32 +00:00
Tianshu Wang 8950613552
save checkpoints and profiler output to the first logger (#14325)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-26 17:23:54 +00:00
Rohit Gupta 6d00f31f0c
Add auto wrapping for `DDPFullyShardedNativeStrategy` (#14252) 2022-08-26 09:01:48 +00:00
Jerome Anand 424e78d5b3
Add document to showcase scaleout on hpu (#14357)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-25 14:15:01 +05:30
Laverne Henderson 8ff2e01025
Update for M1 Mac installations (#14350)
* Update for M1 Mac installations

* Apply suggestions from code review

* Update PL installation

* Update based on feedback

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 13:31:18 -04:00
Laverne Henderson 2265bd85c9
Bring back access app state (#14258)
* Recreated the access_app_state file

* Update the site's TOC to include the file

* Update code sample file path

* Minor formatting update

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Sherin Thomas <sherin@grid.ai>
2022-08-23 13:06:46 -04:00
Carlos Mocholí 7a617ec90e
Add back support for logging in the gradient clipping hooks (#14298)
* Add back support for logging in the gradient clipping hooks

* Docs and CHANGELOG

* Fix tests
2022-08-22 09:19:53 -04:00
Rohit Gupta e949362a6b
Enable `on_before_batch_transfer` for `DPStrategy` and `IPUAccelerator` (#14023)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-18 12:12:29 +00:00
Laverne Henderson 8ab65ffade
Fixes note formatting and more (#14264)
Fixes formatting for a note and makes headings for arguments and parameters stand out
2022-08-18 13:55:49 +02:00
Laverne Henderson 1745d192f9
Remove incorrect "template" information (#13911)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-17 14:35:23 -04:00
Adam Bobowski 79fc6afa89
[App] Moved app.py to root dir for `lightning init app <app_name>` template (#13853)
* Moved app.py to main app directory

* updated docs

* updated changelog

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-17 10:15:52 -04:00
Laverne Henderson 61132837f2
Docs BYOC content (#13976)
* BYOC content

Content for the upcoming BYOC feature

* First DRAFT of BYOC content

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update docs/source-app/index.rst

Co-authored-by: thomas chaton <thomas@grid.ai>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: thomas chaton <thomas@grid.ai>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: thomas chaton <thomas@grid.ai>

* Updates based on feedback

* Updates based on feedback

* Update external ID with note

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Raphael Randschau <nicolai86@users.noreply.github.com>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Raphael Randschau <nicolai86@users.noreply.github.com>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Raphael Randschau <nicolai86@users.noreply.github.com>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Raphael Randschau <nicolai86@users.noreply.github.com>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Raphael Randschau <nicolai86@users.noreply.github.com>

* Updates for terraform mod

Updates for terraform mod and arg pram split

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update index.rst

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update docs/source-app/workflows/byoc/index.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update content with table

Changed bullets into table based on feedback

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Raphael Randschau <nicolai86@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-17 10:15:41 -04:00
Sherin Thomas deaadc157b
(app) Documentation fix for Work resources (#14182) 2022-08-15 09:35:10 -04:00