Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
lightning/docs/source-app
History
Akihiro Nitta 64b19fb16f
[App] Introduce auto scaler (#15769) 
* Exlucde __pycache__ in setuptools

* Add load balancer example

* wip

* Update example

* rename

* remove prints

* _LoadBalancer -> LoadBalancer

* AutoScaler(work)

* change var name

* remove locust

* Update docs

* include autoscaler in api ref

* docs typo

* docs typo

* docs typo

* docs typo

* remove unused loadtest

* remove unused device_type

* clean up

* clean up

* clean up

* Add docstring

* type

* env vars to args

* expose an API for users to override to customise autoscaling logic

* update example

* comment

* udpate var name

* fix scale mechanism and clean up

* Update exampl

* ignore mypy

* Add test file

* .

* update impl and update tests

* Update changlog

* .

* revert docs

* update test

* update state to keep calling 'flow.run()'

Co-authored-by: Aniket Maurya <theaniketmaurya@gmail.com>

* Add aiohttp to base requirements

* Update docs

Co-authored-by: Luca Antiga <luca.antiga@gmail.com>

* Use deserializer utility

* fake trigger

* wip: protect /system/* with basic auth

* read password at runtime

* Change env var name

* import torch as optional

* Don't overcreate works

* simplify imports

* Update example

* aiohttp

* Add work_args work_kwargs

* More docs

* remove FIXME

* Apply Jirka's suggestions

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean example device

* add comment on init threshold value

* bad merge

* nit: logging format

* {in,out}put_schema -> {in,out}put_type

* lowercase

* docs on seconds

* process_time -> processing_time

* Dont modify work state from flow

* Update tests

* worker_url -> endpoint

* fix exampl

* Fix default scale logic

* Fix default scale logic

* Fix num_pending_works

* Update num_pending_works

* Fix bug creating too many works

* Remove up/downscale_threshold args

* Update example

* Add typing

* Fix example in docstring

* Fix default scale logic

* Update src/lightning_app/components/auto_scaler.py

Co-authored-by: Noha Alon <nohalon@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rename method

* rename locvar

* Add todo

* docs ci

* docs ci

* asdfafsdasdf pls docs

* Apply suggestions from code review

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* .

* doc

* Update src/lightning_app/components/auto_scaler.py

Co-authored-by: Noha Alon <nohalon@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

This reverts commit 24983a0a5a.

* Revert "Update src/lightning_app/components/auto_scaler.py"

This reverts commit 56ea78b45f.

* Remove redefinition

* Remove load balancer run blocker

* raise RuntimeError

* remove has_sent

* lower the default timeout_batching from 10 to 1

* remove debug

* update the default timeout_batching

* .

* tighten condition

* fix endpoint

* typo in runtimeerror cond

* async lock update severs

* add a test

* {in,out}put_type typing

* Update examples/app_server_with_auto_scaler/app.py

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

* Update .actions/setup_tools.py

Co-authored-by: Aniket Maurya <theaniketmaurya@gmail.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Noha Alon <nohalon@gmail.com>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
Co-authored-by: Akihiro Nitta <aki@pop-os.localdomain>
Co-authored-by: thomas chaton <thomas@grid.ai>
 		2022-12-07 14:27:44 +01:00
..
_static Docs for LAI (#13312) 2022-06-16 23:07:30 -04:00
_templates Add `lightning_app` docs (#13656) 2022-07-15 08:45:50 -04:00
api_reference Docs 4/n (#15628) 2022-11-10 14:48:48 -05:00
cloud docs updates 1/n (#15473) 2022-11-03 10:55:30 -04:00
code_samples [App] Reduce import depths and add test (#15330) 2022-10-28 13:57:35 +00:00
core_api Added note about custom base images (#14125) 2022-11-26 21:58:38 +00:00
examples Fix the `examples/app_dag` App (#14359) 2022-11-22 09:39:44 +01:00
get_started Docs 2/n (#15521) 2022-11-04 08:31:27 -04:00
glossary Added note about custom base images (#14125) 2022-11-26 21:58:38 +00:00
install Docs 2/n (#15521) 2022-11-04 08:31:27 -04:00
levels [App] Fix multi-node pytorch example CI (#15753) 2022-11-21 16:02:30 +00:00
workflows [CLI] drop name column from cluster list (#15721) 2022-12-02 19:27:24 -08:00
Makefile CI: Update docs-related workflows (#13547) 2022-07-15 13:19:18 -04:00
api_references.rst [App] Introduce auto scaler (#15769) 2022-12-07 14:27:44 +01:00
basics.rst Add `lightning_app` docs (#13656) 2022-07-15 08:45:50 -04:00
conf.py Update myst-parser requirement from <0.17,>=0.15 to ==0.18.1 in /requirements (#14417) 2022-11-09 18:55:16 +00:00
contribute_app.rst Add `lightning_app` docs (#13656) 2022-07-15 08:45:50 -04:00
index.rst Docs 4/n (#15628) 2022-11-10 14:48:48 -05:00
intro.rst Add `lightning_app` docs (#13656) 2022-07-15 08:45:50 -04:00
landing_app.py docs updates 1/n (#15473) 2022-11-03 10:55:30 -04:00
landing_app_run.bash Docs 4/n (#15628) 2022-11-10 14:48:48 -05:00
make.bat Add `lightning_app` docs (#13656) 2022-07-15 08:45:50 -04:00
moving_to_the_cloud.rst Add `lightning_app` docs (#13656) 2022-07-15 08:45:50 -04:00
quickstart.rst Docs 2/n (#15521) 2022-11-04 08:31:27 -04:00
testing.rst [App] Reduce import depths and add test (#15330) 2022-10-28 13:57:35 +00:00
ui_and_frontends.rst Add `lightning_app` docs (#13656) 2022-07-15 08:45:50 -04:00