Adds a new '--secret' flag to 'lightning run app':
lightning run app --cloud --secret MY_SECRET=my-secret-name app.py
When the Lightning App runs in the cloud, the 'MY_SECRET'
environment variable will be populated with the value of the
referenced Secret. The value of the Secret is encrypted in the
database, and will only be decrypted and accessible to the
Flow/Work processes in the cloud.
Co-authored-by: Sherin Thomas <sherin@grid.ai>
Co-authored-by: Noha Alon <nohalon@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
* Move storage from app prefix to project/app prefix: checking and legacy support
* Changelog message
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* update
* update
* update
* update
* Review of content
* Formatting updates
* Fomatting updates
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Updates based on new commits
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* update
* update
* update
* Introduce lightning connect (#14183)
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
* pinning starsessions
* pinning starsessions
* adding strict back to requirements.txt
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Duplicated
* Basic implementation
* Basic implementation
* Basic implementation
* Basic implementation
* Common things moved to log helpers file
* Decomposing logs reader classes for reusing
* Setting colors for log levels
* Manifest trimming
* Changes added to CHANGELOG
* Prettifications
* Prettifications
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Logs function name change
* Logs function name change
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* attempt to fix the pydanitc import
* Tests + command name fixes
* Extending tests
* Adding limit argument
* Unmerging CI fix
* Unmerging CI fix
* Adding fields for errors
* Adding log level fixed field width
* Adding absent typing + exeptions raising
* Adding socket error logging
* Addressing comments on cluster list function return value
* Addressing comments on adding e2e tests
* Adding version range for arrow package in reqs
* New unit tests
* arrow time parsing callback modified + unit tests
* helpers updated
* helpers updated
* helpers updated
* One more test
* CMD test fix
* CMD test fix
* CMD test fix
* CMD test fix
* CMD test fix
* LightningClient mocking
* Flaky test removed
Co-authored-by: hhsecond <sherin@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* add a warning
* add test
* add test
* add changelog
* remove todo
* clarify http won't work in cloud
* Apply suggestions from code review
Co-authored-by: Sherin Thomas <sherin@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Sherin Thomas <sherin@grid.ai>
* Add S3 protocol and optimization field to the drive object
* Add a list of drives to the work specification
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add only protocol for s3 drives, no optimization arguments, and add tests
* added trailing slash criteria
* allow slash in s3 drives
* fix
* fixed test issues
Co-authored-by: Panos Lantavos-Stratigakis <default-email@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rick Izzo <rick@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rick Izzo <rlizzo@users.noreply.github.com>
fix cluster creation CLI requiring instace-type selection
we've marked `instance_types` as `required=False`, but the CLI calls `split` on the value.
So if nothing is provided, we'll actually receive a runtime error, effectively rendering the flag as required.
Co-authored-by: thomas chaton <thomas@grid.ai>
* add support for listing apps
* update changelog with correct PR number
* add tests for pagination
* fix wrong mock on test_cli
* ensure all enum values are accounted for
* make AppManager and AppList protected, add limit to pagination calls
* add restarting transition /w tests
* add state transition not yet run with tests
Add `--cluster-id` flag which can be passed to `lightning run app` if the `--cloud` flag is present.
This allows you to run your Lightning AI apps on Lightning AI BYOC clusters running on your own cloud provider infrastructure.
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
* tests
* ci
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update tests
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: mansy <mansy@lightning.ai>
Adrian Wälchli