Commit Graph

8609 Commits

Author SHA1 Message Date
Adrian Wälchli 96b7ed77e6
Enable more shorthand strategy names in the Fabric CLI (#16485) 2023-01-25 09:52:03 +00:00
Jirka Borovec 3f365c8997
docs: move `assets_lightning` to pl-public-data (#16419) 2023-01-24 22:55:53 +00:00
Adrian Wälchli c87bb71fa8
Add `Fabric.all_reduce` (#16459) 2023-01-24 22:35:00 +00:00
Adrian Wälchli 7603dd09cb
Fabric checkpointing 2/n: DeepSpeed implementation (#16452)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-24 18:53:26 +01:00
Ethan Harris 4a802e00a8
[App] Add `lightning open` command (#16482) 2023-01-24 15:58:15 +00:00
Akihiro Nitta d6b62da4d5
[App] Wrap LightningClient methods with retry wrapper by default (#16382)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-01-23 18:30:23 +00:00
Carlos Mocholí 5891cdc940
Mark the loop classes as protected (#16445) 2023-01-23 16:30:13 +00:00
thomas chaton 48e1c9c99c
Add support for async method and remove context PythonServer (#16453)
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-01-23 15:44:36 +00:00
thomas chaton 404fc0c8b7
[App] Resolved root_folder not parsed properly (#16454)
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-01-23 15:03:54 +00:00
Carlos Mocholí 39b7cb80ca
Remove the FairScale integration (#16400)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-23 13:39:04 +00:00
Seppo Enarvi 9346151359
Two fixes for handling edge cases in MLflow logging (#16451)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-01-23 14:29:58 +01:00
Adrian Wälchli 3611fcd152
Update Fabric docs based on user feedback (#16460)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-01-23 14:28:20 +01:00
Ethan Harris 04886ed7f1
[App] Refactor cloud dispatch and update to new API (#16456)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-23 12:41:33 +00:00
Adrian Wälchli b30e948ba4
Test DeepSpeed in Fabric CI (#16458)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-23 11:40:56 +00:00
Adrian Wälchli 9faa25f86f
Test that connector defaults match the ones in Trainer/Fabric (#16463) 2023-01-23 05:09:45 -05:00
dependabot[bot] ba3ab2f9db
Update numpy requirement from <1.24.1,>=1.17.2 to >=1.17.2,<1.24.2 in /requirements (#16473)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-23 03:59:05 +00:00
dependabot[bot] d155ecc7ca
Update pandas requirement from <1.5.2,>1.0 to >1.0,<1.5.4 in /requirements (#16472)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-23 04:44:51 +01:00
Nikhil Shenoy 81914c7167
LightningFabric: Error handling for accelerator="mps" and ddp strategy pairing (#16455)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-01-22 17:57:24 +00:00
Nash cc56539cd3
fixing typos reported by community user (#16457) 2023-01-21 01:21:45 +01:00
Adrian Wälchli ee11a34382
Update link to new forum (#16449) 2023-01-20 08:01:16 +01:00
Peutlefaire 6fd914f40b
Solved minor bug with MLFlow logger (#16418)
Resolves https://github.com/Lightning-AI/lightning/issues/16411
2023-01-20 00:15:32 +00:00
Carlos Mocholí d3de5c64d7
Remove the deprecated code in `pl.utilities.data` (#16440) 2023-01-20 01:03:55 +01:00
Adrian Wälchli 39acb81b9b
Fabric checkpointing 1/n: base implementation (#16434)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-19 20:40:12 +00:00
Carlos Mocholí 8f736372ed Loop flattening: reduce base interface (#16429)
* Loop flattening: remove the default `.run()` implementation

* None return

* mypy

* Loop flattening: reduce base interface

* Fix

* DOcs

* Bad merge

* Fix

* Fix
2023-01-19 18:39:36 +01:00
Carlos Mocholí da82d490f3 Remove the deprecated code in `pl.utilities.optimizer` (#16439) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 0cf0e90e4a Remove the deprecated code in `pl.utilities.cloud_io` (#16438) 2023-01-19 18:39:36 +01:00
Carlos Mocholí d7760819dc Remove the deprecated `Accelerator.setup_environment` method (#16436) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 48a407cc86 Remove the deprecated `pl.strategies.utils.on_colab_kaggle` function (#16437) 2023-01-19 18:39:36 +01:00
Carlos Mocholí df795b45c0 Remove the deprecated code in `pl.utilities.seed` (#16422) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 37f672d968 Remove the deprecated code in `pl.core.mixins` (#16424) 2023-01-19 18:39:36 +01:00
Carlos Mocholí fd9a3803b8 Loop flattening: remove the default `.run()` implementation (#16427) 2023-01-19 18:39:36 +01:00
Carlos Mocholí f031f1e453 Remove the `HivemindStrategy` (#16407)
Remove the collaborative strategy
2023-01-19 18:39:36 +01:00
Carlos Mocholí 04b929c2af Remove the deprecated code in `pl.utilities.apply_func` (#16413) 2023-01-19 18:39:36 +01:00
Adrian Wälchli da675d69bf Remove deadlock detection / process reconciliation logic (#16204)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-19 18:39:36 +01:00
Carlos Mocholí 172be3653f Remove the deprecated code in `pl.utilities.device_parser` (#16412) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 003937246a Remove the deprecated code in `pl.utilities.xla_device` (#16404) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 256199ff7c Remove support for logging multiple metrics together (#16389) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 47c38c75ba Remove deprecated code in `pl.utilities.distributed` (#16390) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 886ad49a55 Mark forward_module as required (#16386) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 46246c3336 Loop flattening: remove `.connect()` (#16384) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 3cc376e240 Remove the deprecated tuning property and enums (#16379) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 67eb931cdf Remove the deprecated `LightningCLI` arguments (#16380) 2023-01-19 18:39:36 +01:00
Carlos Mocholí bf75a1758c Remove support for `PL_INTER_BATCH_PARALLELISM` (#16355) 2023-01-19 18:39:36 +01:00
Carlos Mocholí e9a5c7489a Loop flattening: remove `.replace()` (#16361) 2023-01-19 18:39:36 +01:00
Carlos Mocholí caa82d8600 Remove `Trainer(move_metrics_to_cpu=True)` (#16358) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 14933592f4 Remove the deprecated `pytorch_lightning.profiler` module (#16359) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 5d648e4d77 Remove the deprecated `AllGatherGrad` class (#16360) 2023-01-19 18:39:36 +01:00
Adrian Wälchli cf0952b25e Remove special handling of loss in progress bar (#16192)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-19 18:39:36 +01:00
Adrian Wälchli 83f6d93895 Remove the redundant precision attribute from LightningModule (#16203)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-19 18:39:36 +01:00
Adrian Wälchli 03a699693b Remove truncated backpropagation from loops (#16337)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-19 18:39:36 +01:00