Akihiro Nitta
|
64b19fb16f
|
[App] Introduce auto scaler (#15769)
* Exlucde __pycache__ in setuptools
* Add load balancer example
* wip
* Update example
* rename
* remove prints
* _LoadBalancer -> LoadBalancer
* AutoScaler(work)
* change var name
* remove locust
* Update docs
* include autoscaler in api ref
* docs typo
* docs typo
* docs typo
* docs typo
* remove unused loadtest
* remove unused device_type
* clean up
* clean up
* clean up
* Add docstring
* type
* env vars to args
* expose an API for users to override to customise autoscaling logic
* update example
* comment
* udpate var name
* fix scale mechanism and clean up
* Update exampl
* ignore mypy
* Add test file
* .
* update impl and update tests
* Update changlog
* .
* revert docs
* update test
* update state to keep calling 'flow.run()'
Co-authored-by: Aniket Maurya <theaniketmaurya@gmail.com>
* Add aiohttp to base requirements
* Update docs
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
* Use deserializer utility
* fake trigger
* wip: protect /system/* with basic auth
* read password at runtime
* Change env var name
* import torch as optional
* Don't overcreate works
* simplify imports
* Update example
* aiohttp
* Add work_args work_kwargs
* More docs
* remove FIXME
* Apply Jirka's suggestions
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* clean example device
* add comment on init threshold value
* bad merge
* nit: logging format
* {in,out}put_schema -> {in,out}put_type
* lowercase
* docs on seconds
* process_time -> processing_time
* Dont modify work state from flow
* Update tests
* worker_url -> endpoint
* fix exampl
* Fix default scale logic
* Fix default scale logic
* Fix num_pending_works
* Update num_pending_works
* Fix bug creating too many works
* Remove up/downscale_threshold args
* Update example
* Add typing
* Fix example in docstring
* Fix default scale logic
* Update src/lightning_app/components/auto_scaler.py
Co-authored-by: Noha Alon <nohalon@gmail.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* rename method
* rename locvar
* Add todo
* docs ci
* docs ci
* asdfafsdasdf pls docs
* Apply suggestions from code review
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* .
* doc
* Update src/lightning_app/components/auto_scaler.py
Co-authored-by: Noha Alon <nohalon@gmail.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"
This reverts commit 24983a0a5a.
* Revert "Update src/lightning_app/components/auto_scaler.py"
This reverts commit 56ea78b45f.
* Remove redefinition
* Remove load balancer run blocker
* raise RuntimeError
* remove has_sent
* lower the default timeout_batching from 10 to 1
* remove debug
* update the default timeout_batching
* .
* tighten condition
* fix endpoint
* typo in runtimeerror cond
* async lock update severs
* add a test
* {in,out}put_type typing
* Update examples/app_server_with_auto_scaler/app.py
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
* Update .actions/setup_tools.py
Co-authored-by: Aniket Maurya <theaniketmaurya@gmail.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Noha Alon <nohalon@gmail.com>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
Co-authored-by: Akihiro Nitta <aki@pop-os.localdomain>
Co-authored-by: thomas chaton <thomas@grid.ai>
|
2022-12-07 14:27:44 +01:00 |