Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,644 Commits 59 Branches 217 Tags 356 MiB
Commit Graph

2949 Commits

Author SHA1 Message Date
Adrian Wälchli 6333caabb0
Standalone Lite: Strategy base classes and registry (#14662) 
* add accelerator implementations to lite

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix imports

* rename registry argument

* fix test

* fix tests

* remove duplicated test

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix tests

* deprecation

* deprecations

* flake8

* fixes

* add mps to runif

* fix tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove more

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* local import

* undo device stats :(

* fix import

* stupid typehints

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* more refactors :(

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* rename init_device to setup_device

* remove unused import

* make uppercase to differentiate from class

* trick test after moving import locally

* add base classes and registry

* reg

* registry

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* tests

* update to other branches

* resolve todo(lite)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add very basic unit tests

* fix name assignment

* Update src/lightning_lite/strategies/parallel.py

Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>

* remove deprecated property

* remove pre- and post backward for now

* protecting the registry utility function

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unused import

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
 2022-09-14 09:15:21 -04:00
Sherin Thomas d579733b08
Lightning cloud client call with key word arguments (#14685) 2022-09-14 08:44:59 +02:00
thomas chaton c81a71c908
Lightning App Fixes from Training Studio App dev (#14532) 
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
 2022-09-13 11:43:15 -04:00
otaj 616304831a
Remove deprecated `BaseProfiler` and `AbstractProfiler` (#14404) 
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
 2022-09-13 14:52:09 +00:00
thomas chaton 96cc288f53
(hot fix) Resolve Boring App (#14684) 
* resolve_boring_app

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
 2022-09-13 10:50:36 -04:00
Pritam Soni 16b4644e06
feat: LAI2-10296 check if user has sufficient credits to run an app from the cli (#14285) 2022-09-13 19:19:09 +05:30
Adrian Wälchli 19a1274093
Better error message when dataloader and datamodule is None (V2) (#14637) 2022-09-13 12:26:03 +00:00
Adrian Wälchli 1ee3d1eb72
Avoid warning when cloning tensor in self.log (#14599) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-13 16:23:46 +05:30
Dmitry Frolov 6e21f46fe8
[CLI] Move storage from app prefix to project/app prefix (#14583) 
* Move storage from app prefix to project/app prefix: checking and legacy support

* Changelog message

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-12 20:11:00 -04:00
Adrian Wälchli 4bd135a6f6
Remove deprecated `LoggerCollection` (#14283) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-12 21:46:46 +00:00
Max Ehrlich e5998e6bf2
Make the SLURM Preemption/Timeout Signal Configurable (#14626) 
* Add parameter to change the preemption signal
* Make the signal connector use the custom signal from SLURMEnvironment

Signed-off-by: Max Ehrlich <max.ehr@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-12 19:24:35 +00:00
Adrian Wälchli 925edbca07
Remove the deprecated `weights_save_path` Trainer argument (#14424) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-09-12 19:02:38 +00:00
thomas chaton 80e2f097e0
(app): Add load_state_dict and state_dict (#14100) 
Co-authored-by: manskx <ahmed.mansy156@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2022-09-12 18:29:23 +00:00
Mauricio Villegas 1680a76819
Removed from_argparse_args tests in test_cli.py (#14597) 2022-09-12 18:25:29 +00:00
Noha Alon 9769f57fc6
Removes timeout from streamlit e2e test (#14667) 
* Removes timeout from streamlit e2e test
We have a timeout on the app view which waits for the button but it causes a refresh on the page which causes playwright to miss the button on each refresh.
we can remove the timeout altogether since we have a time limit on the test itself in the CI setup

Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2022-09-12 18:00:46 +00:00
thomas chaton b679fc2922
(app) Resolve a bug where the state changes isn't detected properly (#14465) 
Co-authored-by: Mansy <ahmed.mansy156@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-12 16:54:14 +00:00
Adrian Wälchli d013bcc5bf
Standalone Lite: Accelerators (#14578) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-12 16:00:14 +00:00
Adrian Wälchli 85ada5191d
Standalone Lite: Precision Plugins (#14547) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
 2022-09-12 10:47:44 -04:00
thomas chaton 86fd5b22d4
(app) Make Logging DEBUG mode lazy (#14464) 2022-09-12 14:47:24 +00:00
Carlos Mocholí cf3428784f
Set `running_torchscript` recursively (#14657) 
* Set `running_torchscript` recursively

* CHANGELOG
 2022-09-12 14:39:40 +00:00
Adrian Wälchli 8f0a64dab6
Standalone Lite: Launchers (#14555) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-12 14:15:42 +00:00
Carlos Mocholí e859546b96
Integrate lightning_utilities `is_overridden` (#14620) 2022-09-12 15:16:57 +02:00
awaelchli cbbd148089 Add back-compatibility for checkpoint io plugins in pl/plugins/io (#14519) 2022-09-12 08:28:46 -04:00
awaelchli 463439e624 Move checkpoint io plugins from pl/plugins/io to lite/plugins/io (#14519) 2022-09-12 08:28:46 -04:00
Adrian Wälchli 024e7b8204
Standalone Lite: Cluster Environments (#14509) 2022-09-12 12:20:08 +02:00
Vasilis Vryniotis 7e9e441843
Use TorchVision's Multi-weight Support and Model Registration API on Lightning (#14567) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-09-09 20:04:57 +00:00
Adrian Wälchli 95374440ce
Move device parser tests inside Lite (#14586) 2022-09-07 21:22:46 +00:00
Rick Izzo 12d4b2a5f5
Fix(ci) ONC-114: reduce the ci load by only installing lmdb in tests (#14581) 
reduce the ci load by only installing lmdb in tests
 2022-09-07 11:55:03 -04:00
Adrian Wälchli d2459df2ff
Standalone Lite: Remaining Utilities (#14492) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
 2022-09-07 15:25:23 +00:00
Carlos Mocholí bcad90141a
Remove old test artifacts (#14574) 2022-09-07 10:09:59 -04:00
Carlos Mocholí 8c4184c105
Integrate with `lightning_utilities.core.enums` (#14558) 2022-09-07 15:14:14 +02:00
Carlos Mocholí 5216c51096
Integrate `lightning_utilities.core.rank_zero` (#14556) 2022-09-07 09:21:48 +00:00
Carlos Mocholí 273a9ed8c1
Integrate `lightning_utilities.core.apply_func` (#14537) 2022-09-06 13:52:54 +00:00
Carlos Mocholí 44216fdd69
Integrate `lightning_utilities.core.imports` (#14475) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-06 12:56:20 +00:00
Carlos Mocholí 8a4a3b6766
Mark the lite `DeviceDtypeModuleMixin` as protected (#14548) 2022-09-06 14:17:15 +02:00
Rohit Gupta 8c6119fbce
Add auto wrapping support for `DDPFullyShardedStrategy` (#14383) 2022-09-05 19:07:26 +00:00
awaelchli 7f148b2c47 Deprecate pl/utilities/apply_func (#14516) 2022-09-05 20:30:42 +02:00
awaelchli 9fea2ed9d5 move pl/utilities/apply_func.py to pl/utilities/apply_func.py (#14516) 2022-09-05 20:30:42 +02:00
awaelchli cfea2be137 Deprecate pl/utilities/cloud_io.py (#14515) 2022-09-05 18:30:31 +02:00
awaelchli def6548596 move pl/utilities/cloud_io.py to lite/utilities/cloud_io.py (#14515) 2022-09-05 18:30:31 +02:00
awaelchli 165427a506 Deprecate pl/utilities/xla_device (#14514) 2022-09-05 17:36:02 +02:00
awaelchli 75d5a2d046 move pl/utilities/xla_device.py to lite/utilities/xla_device.py (#14514) 2022-09-05 17:36:02 +02:00
awaelchli c2879c20da Deprecate pl/core/mixins/device_dtype_mixin and update imports (#14511) 2022-09-05 16:31:00 +02:00
awaelchli cefe2fa123 Move test_dtype_device_mixin to lite (#14511) 2022-09-05 16:31:00 +02:00
Rohit Gupta ce702fd40e
Squeeze tensor while logging (#14489) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-05 14:01:51 +00:00
Tianshu Wang 23f0e20209
Fixed `WandbLogger` `save_dir` is not set after creation (#12748) (#14326) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-05 10:12:43 +00:00
Roberto de Moura Estevão Filho ed0164a3d2
Estimate stepping batches with max_steps if max_epochs is not set (#14317) 
Co-authored-by: Roberto Estevão <robertode@microsoft.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-05 09:05:21 +00:00
Carlos Mocholí 4235eff712
Use a standalone test symlink for Lite (#14502) 2022-09-04 20:57:28 +02:00
Adrian Wälchli 291dc1b615
Standalone Lite CI setup (#14451) 
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-01 22:13:12 +00:00
Carlos Mocholí e0c2c3e677
Clean up fairscale imports (#14476) 2022-09-01 18:08:40 +02:00