Commit Graph

80 Commits

Author SHA1 Message Date
dependabot[bot] c43764971d
Update fsspec requirement from <=2022.7.1,>=2022.5.0 to >=2022.5.0,<=2023.6.0 in /requirements (#17925)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-01 15:35:26 -04:00
Yurij Mikhalevich 60f2e3ae47
feat(plugin): store source app (#17892) 2023-06-22 15:57:13 +00:00
dependabot[bot] 28e86d8a73
Update beautifulsoup4 requirement from <4.11.2,>=4.8.0 to >=4.8.0,<4.12.3 in /requirements (#17864)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-19 14:28:43 +02:00
dependabot[bot] 04db6b4e86
Update requests requirement from <2.28.3 to <2.31.1 in /requirements (#17867)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-19 14:28:01 +02:00
dependabot[bot] 9de94e45bf
Update rich requirement from <=13.0.1,>=12.3.0 to >=12.3.0,<=13.4.2 in /requirements (#17834)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-16 12:11:37 +00:00
Jirka Borovec 0079b6d1d8
bump starlette & fastapi req. (#17615) 2023-06-16 12:28:56 +01:00
dependabot[bot] fd68c6c316
Update websocket-client requirement from <1.5.2 to <1.5.3 in /requirements (#17752)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-15 20:36:50 -04:00
dependabot[bot] 1a5ec05101
Update urllib3 requirement from <=1.26.13 to <=2.0.2 in /requirements (#17753)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-15 20:35:36 -04:00
dependabot[bot] 420e7aa427
Update fastapi requirement from <0.89.0,>=0.69.0 to >=0.69.0,<0.98.0 in /requirements (#17808)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-06-15 10:22:10 +00:00
dependabot[bot] bd53b0350b
Update deepdiff requirement from <6.2.4,>=5.7.0 to >=5.7.0,<6.3.1 in /requirements (#17631)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-29 14:44:25 +00:00
dependabot[bot] 3ebca67faa
Update uvicorn requirement from <0.21.2 to <0.22.1 in /requirements (#17586)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-09 17:50:46 +02:00
Ethan Harris 8d310b89ea
[App] Add missing python-multipart dependency (#17244)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-04-27 10:21:04 +00:00
dependabot[bot] d8234c5003
Update traitlets requirement from <5.9.0,>=5.3.0 to >=5.3.0,<5.10.0 in /requirements (#17398)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-24 19:59:52 +00:00
dependabot[bot] cae1888ae5
Update inquirer requirement from <=3.1.2,>=2.10.0 to >=2.10.0,<=3.1.3 in /requirements (#17258)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-24 18:51:51 +00:00
dependabot[bot] 09ae070d2d
Update uvicorn requirement from <0.19.1 to <0.21.2 in /requirements (#17314)
Updates the requirements on [uvicorn](https://github.com/encode/uvicorn) to permit the latest version.
- [Release notes](https://github.com/encode/uvicorn/releases)
- [Changelog](https://github.com/encode/uvicorn/blob/master/CHANGELOG.md)
- [Commits](https://github.com/encode/uvicorn/compare/0.0.1...0.21.1)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-24 18:28:14 +00:00
Ethan Harris e82672414e
App: Fix AppState, streamlit example (#17452) 2023-04-24 07:27:35 -04:00
Jirka Borovec 44ce386135
req: formatting (#17335) 2023-04-24 09:19:20 +01:00
Carlos Mocholí 05b481e3ae
[TPU] Add testing matrix with PJRT (#17368)
* Replace GKE in CI with manual gcloud usage

* Fix XRT test

* Reduce timeout to 35 minutes

* [TPU] Run tests with PJRT

* runtime as part of the job name

* CHANGELOG

* Update for app too
2023-04-14 16:39:13 +02:00
Carlos Mocholí 04fb30bd97
Update fastapi dependency pins (#17173)
* Update fastapi dependency pins

* Apply suggestions from code review

* Update test.txt

* Update requirements/app/base.txt

* Revert "Update requirements/app/base.txt"

This reverts commit 59918ffc6c.

* cloud update

* Bad merge

* fastapi 0.69.0 which pins starlette 0.15.0

* https://github.com/pydantic/pydantic/issues/1985

* Avoid CVE: https://github.com/tiangolo/fastapi/pull/3213

* Strict trio

* Skip windows test

---------

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-12 17:33:56 +02:00
Adrian Wälchli c93952cb2c
Make BYOT imports forward compatible (#16997) 2023-03-13 21:55:32 -04:00
Dmitry Frolov 35d15621c7
Data connection mounts for jobs running from CloudSpaces (#17006)
* Data connection mounts for jobs running from CloudSpaces

* Tests

* Tests fix

* Bump Lightning Cloud
2023-03-11 13:17:18 -05:00
janEbert dd02397720
Allow frozen data classes in optimizer state dict (#16656)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-03-10 15:37:18 +00:00
Luca Furst 77e1cc92d4
[App] Add --zip option to cp command (#16798)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-07 08:04:38 +01:00
dependabot[bot] 8646822c7a
Update requests requirement from <=2.28.1 to <2.28.3 in /requirements (#16547)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-02 23:35:55 +00:00
Ethan Harris beced48904
[App] Add support for plugins to return actions (#16832) 2023-02-22 17:12:04 +00:00
thomas chaton 7e8400d277
[App] Add support for private data (#16738)
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-02-14 12:34:44 +00:00
thomas chaton 88e089ea4e
[App] Enable to register data connections (#16670)
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-02-08 18:41:05 +00:00
dependabot[bot] cd02f3ac78
Update websocket-client requirement from <=1.3.3 to <1.5.2 in /requirements (#16640)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-06 16:02:10 +00:00
thomas chaton 55a0caacb5
[App] Enable uploading files to a project. (#16631)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-02-05 06:35:19 -05:00
thomas chaton f5d148d901
[App] Introduce Lightning Storage Commands (#16606)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

* update

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

---------

Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-02-03 04:28:24 -05:00
Jirka Borovec e59685e5f8
align lit-utils version to post0 (#16593) 2023-02-01 15:00:04 +05:30
Adrian Wälchli 961fa6a0ea
Fix strict torch_xla availability check (#16476)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-01-25 18:52:33 +00:00
dependabot[bot] ba7407fb23
Update starlette requirement from <=0.22.0 to <0.24.0 in /requirements (#16471)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-25 16:14:18 +00:00
dependabot[bot] b6371aacf2
Update traitlets requirement from <=5.4.0,>=5.3.0 to >=5.3.0,<5.9.0 in /requirements (#16470)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-25 11:55:37 +00:00
Ethan Harris 04886ed7f1
[App] Refactor cloud dispatch and update to new API (#16456)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-23 12:41:33 +00:00
dependabot[bot] 6f31d68e73
Update lightning-utilities requirement from <0.5.0,>=0.4.2 to >=0.4.2,<0.6.0 in /requirements (#16371)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-17 01:35:09 +00:00
dependabot[bot] 596494b719
Update psutil requirement from <5.9.4 to <5.9.5 in /requirements (#16372)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-16 12:49:48 +00:00
dependabot[bot] 0b94d1da11
Update deepdiff requirement from <6.2.3,>=5.7.0 to >=5.7.0,<6.2.4 in /requirements (#16292)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-14 12:58:19 +00:00
Jirka Borovec b195b7c116
app: adding silent dependencies (#16302)
* adding silent dependencies

* versions

* strict

* freeze

* client
2023-01-09 13:37:59 +01:00
Carlos Mocholí 53ceb156c4
Integrate lightning_utilities==0.4.2 (#15817)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-12-13 13:13:51 +00:00
dependabot[bot] 5e705fa0df
Update deepdiff requirement from <=5.8.1,>=5.7.0 to >=5.7.0,<6.2.3 in /requirements (#16006)
Update deepdiff requirement in /requirements

Updates the requirements on [deepdiff](https://github.com/seperman/deepdiff) to permit the latest version.
- [Release notes](https://github.com/seperman/deepdiff/releases)
- [Changelog](https://github.com/seperman/deepdiff/blob/master/docs/changelog.rst)
- [Commits](https://github.com/seperman/deepdiff/compare/5.7.0...6.2.2)

---
updated-dependencies:
- dependency-name: deepdiff
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-12 12:04:52 +00:00
Akihiro Nitta 346e936651
App: Move AutoScaler dependency to extra requirements (#15971)
* Make autoscaler dependency optional
* update chglog
* dont directly import aiohttp
2022-12-09 10:42:52 +00:00
Ethan Harris 12832263b9
[App] Fix bug when using structures with works (#15911)
* Fix bug when using structures with works
* Add test
* Update CHANGELOG.md
2022-12-08 00:54:15 +00:00
Akihiro Nitta 64b19fb16f
[App] Introduce auto scaler (#15769)
* Exlucde __pycache__ in setuptools

* Add load balancer example

* wip

* Update example

* rename

* remove prints

* _LoadBalancer -> LoadBalancer

* AutoScaler(work)

* change var name

* remove locust

* Update docs

* include autoscaler in api ref

* docs typo

* docs typo

* docs typo

* docs typo

* remove unused loadtest

* remove unused device_type

* clean up

* clean up

* clean up

* Add docstring

* type

* env vars to args

* expose an API for users to override to customise autoscaling logic

* update example

* comment

* udpate var name

* fix scale mechanism and clean up

* Update exampl

* ignore mypy

* Add test file

* .

* update impl and update tests

* Update changlog

* .

* revert docs

* update test

* update state to keep calling 'flow.run()'

Co-authored-by: Aniket Maurya <theaniketmaurya@gmail.com>

* Add aiohttp to base requirements

* Update docs

Co-authored-by: Luca Antiga <luca.antiga@gmail.com>

* Use deserializer utility

* fake trigger

* wip: protect /system/* with basic auth

* read password at runtime

* Change env var name

* import torch as optional

* Don't overcreate works

* simplify imports

* Update example

* aiohttp

* Add work_args work_kwargs

* More docs

* remove FIXME

* Apply Jirka's suggestions

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean example device

* add comment on init threshold value

* bad merge

* nit: logging format

* {in,out}put_schema -> {in,out}put_type

* lowercase

* docs on seconds

* process_time -> processing_time

* Dont modify work state from flow

* Update tests

* worker_url -> endpoint

* fix exampl

* Fix default scale logic

* Fix default scale logic

* Fix num_pending_works

* Update num_pending_works

* Fix bug creating too many works

* Remove up/downscale_threshold args

* Update example

* Add typing

* Fix example in docstring

* Fix default scale logic

* Update src/lightning_app/components/auto_scaler.py

Co-authored-by: Noha Alon <nohalon@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rename method

* rename locvar

* Add todo

* docs ci

* docs ci

* asdfafsdasdf pls docs

* Apply suggestions from code review

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* .

* doc

* Update src/lightning_app/components/auto_scaler.py

Co-authored-by: Noha Alon <nohalon@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

This reverts commit 24983a0a5a.

* Revert "Update src/lightning_app/components/auto_scaler.py"

This reverts commit 56ea78b45f.

* Remove redefinition

* Remove load balancer run blocker

* raise RuntimeError

* remove has_sent

* lower the default timeout_batching from 10 to 1

* remove debug

* update the default timeout_batching

* .

* tighten condition

* fix endpoint

* typo in runtimeerror cond

* async lock update severs

* add a test

* {in,out}put_type typing

* Update examples/app_server_with_auto_scaler/app.py

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

* Update .actions/setup_tools.py

Co-authored-by: Aniket Maurya <theaniketmaurya@gmail.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Noha Alon <nohalon@gmail.com>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
Co-authored-by: Akihiro Nitta <aki@pop-os.localdomain>
Co-authored-by: thomas chaton <thomas@grid.ai>
2022-12-07 14:27:44 +01:00
Ethan Harris 32cf1faa07
[App] Support for headless apps (#15875)
* Add `is_headless` when dispatching in the cloud

* Bump cloud version

* Add tests

* Dont open app page for headless apps locally

* Refactor

* Update CHANGELOG.md

* Support dynamic UIs at runtime

* Comments

* Fix

* Updates

* Fixes and cleanup

* Fix tests

* Dont open view page for headless apps

* Fix test, resolve URL the right way

* Remove launch

* Clean

* Cleanup tests

* Fixes

* Updates

* Add test

* Increase app cloud tests timeout

* Increase timeout

* Wait for running

* Revert timeouts

* Clean

* Dont update if it hasnt changed

* Increase timeout
2022-12-05 16:58:22 -05:00
Sherin Thomas 58644092d2
Moving `lightning_api_access` out of base requirements (#15844)
* moving the requirements to components extras

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* component requirements to devel

* importing torch in local scope

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* skipping doctest

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-12-01 15:23:01 +05:30
Jirka Borovec ad4bd66df6
hotfix import torch (#15849)
* fix import torch

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* plugin

* fix

* skip

* patch require

* seed

* warn

* .

* ..

* skip True

* 0.0.3

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-11-28 14:58:29 +01:00
dependabot[bot] e150d083c2
Update lightning-utilities requirement from ==0.3.* to ==0.4.* in /requirements (#15420)
Update lightning-utilities requirement in /requirements

Updates the requirements on [lightning-utilities](https://github.com/Lightning-AI/utilities) to permit the latest version.
- [Release notes](https://github.com/Lightning-AI/utilities/releases)
- [Changelog](https://github.com/Lightning-AI/utilities/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Lightning-AI/utilities/compare/v0.3.0...v0.4.0)

---
updated-dependencies:
- dependency-name: lightning-utilities
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-24 16:18:32 +00:00
Luca Antiga dd75906785
Move s3fs to cloud extras (#15729)
Co-authored-by: Luca Antiga <luca@lightning.ai>
2022-11-21 19:57:04 +00:00
dependabot[bot] 1ffbe1bf1e
Update beautifulsoup4 requirement from <=4.8.2 to <4.11.2 in /requirements (#15745)
* Update beautifulsoup4 requirement in /requirements

Updates the requirements on [beautifulsoup4](https://www.crummy.com/software/BeautifulSoup/bs4/) to permit the latest version.

---
updated-dependencies:
- dependency-name: beautifulsoup4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Apply suggestions from code review

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-21 23:22:43 +09:00