Commit Graph

5 Commits

Author SHA1 Message Date
thomas chaton 757413c8e0
[App] Accelerate Multi Node Startup Time (#15650) 2022-11-11 20:08:16 +00:00
Rick Izzo 7a827b09bb
Separate the concept of a Drive from that of a Mount (#15120)
* added mount class and configured it into compute config

* added mount to the cloud runtime dispatcher

* raise error if s3 bucket is passed to a drive telling the user to utilize mounts

* added example for app

* udpated tests

* updated tests

* addressed code review comments

* fix bug

* bugfix

* updates'

* code review comments

* updates

* fixed tests after rename

* fix tests
2022-10-19 23:24:27 -04:00
thomas chaton d11c0d6cc3
Resolve s3 drive issue where the root folder doesn't need to exist locally (#15127) 2022-10-18 14:16:18 +01:00
panos-is 784b60412c
(app) Add s3 drive type (1/2) (#14002)
* Add S3 protocol and optimization field to the drive object

* Add a list of drives to the work specification

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add only protocol for s3 drives, no optimization arguments, and add tests

* added trailing slash criteria

* allow slash in s3 drives

* fix

* fixed test issues

Co-authored-by: Panos Lantavos-Stratigakis <default-email@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rick Izzo <rick@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rick Izzo <rlizzo@users.noreply.github.com>
2022-08-10 20:07:23 +00:00
Sherin Thomas b90525b5b5
adding LAI test (#13321)
* tests

* ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: mansy <mansy@lightning.ai>
2022-06-30 16:43:04 -04:00