Commit Graph

25 Commits

Author SHA1 Message Date
Raphael Randschau adc8238597
Add SSH key management to CLI (#15291)
* add cli commands for adding/ removing resources

as discussed with Adrian, we want to adopt "lightning add" and "lightning remove" for  ssh-keys,
as the resource already exists.

* implement ssh-key management
* one parameter for public key, optional name
* handle the case where a private key file was provided
* make ssh key-mgmt support classes protected
* re-order add ssh-key args
* change types signatures of add_key
* rename test cases
* update changelog

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-10-28 20:42:26 +02:00
Jirka Borovec 95ae393ca8
LAI: creating mirror package (#15105)
* placeholder

* mirror + prune

* makedir

* setup

* ci

* ci

* name

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci clean

* empty

* py

* parallel

* doctest

* flake8

* ci

* typo

* replace

* clean

* Apply suggestions from code review

* re.sub

* fix UI path

* full replace

* ui path?

* replace

* updates

* regex

* ci

* fix

* ci

* path

* ci

* replace

* Update .actions/setup_tools.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* also convert lightning_lite tests for PL tests to adapt mocking paths

* fix app example test

* update logger propagation for PL tests

* update logger propagation for PL tests

* Apply suggestions from code review

* Revert "update logger propagation for PL tests"

This reverts commit c1a5e119c7.

* playwright

* py

* update import in tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* try edit import in overwrite

* debug code

* rev playwright

* Revert "try edit import in overwrite"

This reverts commit c02f766521.

* ci: adjust examples

* adjust examples cloud

* mock lightning_app

* Install assistant dependencies

* lightning

* setup

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Apply suggestions from code review

* disable cache

* move doctest to install

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* )

* echo ./

* ci

* lru

* revert disabling cache, prints

* ci

* prune ci jobs

* prune ci jobs

* training loop standalone tests

* add sys modules cleanup fixture

* make use of fixture

* revert standalone

* ci e2e

* fix imports in lightning

* fix imports of lightning in tests

* Revert "make use of fixture"

This reverts commit c15efdd205.

* Revert other commits for fixtures

* revert use of fixture

* py3.9

* fix mocking

* fix paths

* hack mocking

* docs

* Apply suggestions from code review

* rev suggestion

* Minor changes to the parametrizations

* Update checkgroup with the new and changed jobs

* include frontend dir

* cli

* fix imports and entry point

* Revert standalone

* rc1

* e2e on staging

* Revert "Revert standalone"

This reverts commit 9df96685b8.

* groups

* to

* ci: pt ver

* docker

* Apply suggestions from code review

* Copy over changes from previous commit to other groups

* Add back changes from bad merge

* Uppercase step name everywhere

* update

* ci

* ci: lai oldest

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Justus Schock <justus.schock@posteo.de>
Co-authored-by: manskx <ahmed.mansy156@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-10-27 12:32:49 +02:00
thomas chaton f98de623fd
Add support for local connect terminal context (#15241)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update .azure/app-cloud-e2e.yml

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* update

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-24 13:27:22 -04:00
Sherin Thomas 129f4fa873
[App/Feature] HTTP Queues (#14978)
[App/Feature] HTTP Queues (#14978)
2022-10-06 16:01:49 +05:30
thomas chaton b936fd4380
[app] Add CloudCompute ID serializable within the flow and works state (#14819) 2022-10-04 19:46:44 +00:00
Pritam Soni 2721a2f06b
feat: option to add custom meta tags to the UI container (#14915) 2022-09-30 18:56:57 +05:30
dependabot[bot] 9bb62d3e67
Update arrow requirement from <=1.2.2,>=1.2.0 to >=1.2.0,<1.2.4 in /requirements (#14770)
Update arrow requirement in /requirements

Updates the requirements on [arrow](https://github.com/arrow-py/arrow) to permit the latest version.
- [Release notes](https://github.com/arrow-py/arrow/releases)
- [Changelog](https://github.com/arrow-py/arrow/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/arrow-py/arrow/compare/1.2.0...1.2.3)

---
updated-dependencies:
- dependency-name: arrow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:13:14 +02:00
Kushashwa Ravi Shrimali 5aaab22fb3
Bump Lightning Cloud to 0.5.7 (#14757)
* Bump Lightning Cloud to 0.5.7 🎉
* Fix link in changelog

Co-authored-by: Sherin Thomas <sherin@grid.ai>
2022-09-16 19:04:21 +00:00
Sherin Thomas 7dbd038a94
Bump lightning cloud for memory leak fix (#14697)
Bump lightning cloud for memory leak fix (#14697)
2022-09-15 17:59:12 +05:30
Kushashwa Ravi Shrimali bdec502f50
Requirements: try Traitlets >= 5.3.0 (#14679)
* Traitlets >= 5.3.0
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-13 09:29:03 +00:00
dependabot[bot] f73b31bf3c
Update traitlets requirement from <5.2.0 as strict in /requirements (#14666)
* Update traitlets requirement from <5.2.0 as strict in /requirements

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-12 20:18:26 +00:00
dependabot[bot] d5b32c3087
Update s3fs requirement from <=2022.7.1,>=2022.5.0 to >=2022.5.0,<2022.8.3 in /requirements (#14585)
Update s3fs requirement in /requirements

Updates the requirements on [s3fs](https://github.com/fsspec/s3fs) to permit the latest version.
- [Release notes](https://github.com/fsspec/s3fs/releases)
- [Changelog](https://github.com/fsspec/s3fs/blob/main/release-procedure.md)
- [Commits](https://github.com/fsspec/s3fs/compare/2022.5.0...2022.8.2)

---
updated-dependencies:
- dependency-name: s3fs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-09 19:58:49 +00:00
Carlos Mocholí 5216c51096
Integrate `lightning_utilities.core.rank_zero` (#14556) 2022-09-07 09:21:48 +00:00
Carlos Mocholí 273a9ed8c1
Integrate `lightning_utilities.core.apply_func` (#14537) 2022-09-06 13:52:54 +00:00
Carlos Mocholí 44216fdd69
Integrate `lightning_utilities.core.imports` (#14475)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-06 12:56:20 +00:00
Adam Bobowski 764b348249
[App] Handling s3 rate limiting in framework (#14411)
bump of fsspec and s3fs to version supporting retry on "SlowDown" response
2022-09-01 11:12:04 +00:00
Sherin Thomas c1a7254b7a
Dependency pinning (#14463)
* deps pinned
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-31 21:24:28 +00:00
Dmitry Frolov 2182d755c4
[CLI] Adding opportunity to see basic cluster logs (#14334)
* pinning starsessions

* pinning starsessions

* adding strict back to requirements.txt

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Duplicated

* Basic implementation

* Basic implementation

* Basic implementation

* Basic implementation

* Common things moved to log helpers file

* Decomposing logs reader classes for reusing

* Setting colors for log levels

* Manifest trimming

* Changes added to CHANGELOG

* Prettifications

* Prettifications

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Logs function name change

* Logs function name change

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* attempt to fix the pydanitc import

* Tests + command name fixes

* Extending tests

* Adding limit argument

* Unmerging CI fix

* Unmerging CI fix

* Adding fields for errors

* Adding log level fixed field width

* Adding absent typing + exeptions raising

* Adding socket error logging

* Addressing comments on cluster list function return value

* Addressing comments on adding e2e tests

* Adding version range for arrow package in reqs

* New unit tests

* arrow time parsing callback modified + unit tests

* helpers updated

* helpers updated

* helpers updated

* One more test

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* LightningClient mocking

* Flaky test removed

Co-authored-by: hhsecond <sherin@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 15:48:22 -04:00
Sherin Thomas 52a4457ae3
Pinning starsessions to 1.x (#14333)
The recent release of starsessions 2.0 has broken lightning app as some of the arguments are removed. This PR also fixes a bug in our setup tools that prevents our internal # strict parameter being considered.

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-21 23:26:52 +00:00
Rick Izzo 7c8c996f6a
Feature GRID-9731: Update Lightning Cloud.py Backend to Accept Drive Specs (2/2) (#14106)
initial work adding drives to create work API from framework cloud dispatcher
2022-08-11 13:22:59 +00:00
Jirka Borovec 5c05719f27
Freeze requirements for CI (#14007)
* free requirements

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* typo

* typo

* ui

* mypy

* todo

* mypy

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-08 06:15:54 +00:00
Jirka Borovec e513638de8
adding explain notes for requirements (#13872)
* adding explain notes for requirements
* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-03 21:43:51 +00:00
Mansy 5f1cb913bb
Relax lightning app dependency requirements (#13998)
* [App] Relax lightning app requirements

Co-authored-by: manskx <ahmed.mansy156@gmail.com>
2022-08-03 20:24:51 +00:00
Jirka Borovec e2ec51a5a2
App: prune requirements duplicity (#13739)
prune requirements

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-23 11:17:23 +00:00
Jirka Borovec d2e4e7e003
create meta package [RFC] (#13327)
* placeholder

* move setup_tools & abstract about

* adjust lightning-app

* notes

* lightning about

* lightning init

* CI check

* ci

* install

* adjust manifest & mv chlog

* manifest

* pkg

* mv __setup__

* parse_requirements

* lit

* ci - pytorch

* wrap func

* ci

* cd draft

* generate lit

* pkg

* utf-8

* root pkg

* req.

* ver

* mypy

* try check

* meta pkg

* meta pkg - vars

* meta pkg - pruning

* meta pkg - fixing

* fix PL for meta

* multi-line wrapper

* hack manifest

* ci

* fix docstr

* fixing

* ci & mypy

* links
2022-06-27 09:34:18 -04:00