Commit Graph

300 Commits

Author SHA1 Message Date
Carlos Mocholí 0cf9d73d28
Drop PyTorch 1.8 support (#13155)
* Drop PyTorch 1.8 support

* Missed update

* Skip profiler test until supported

* Upgrade ipu dockerfile pytorch version

* Update XLA version
2022-06-14 20:46:44 -04:00
Jirka Borovec 78ff201c7e
Update CI setup (#13291)
* drop mamba
* use legacy GPU machines
2022-06-14 17:11:54 +00:00
Akarsha Rao bfa8b7be2d
Create hpu-ci-runner Dockerfile (#13239)
* Create  hpu-ci-runner Dockerfile

* Add ENTRYPOINT script 'start.sh' to hpu-ci-runner

* rename dirs

* ci

* add docker

* Fix build failure

* Fix build failure

* Fix title of nightly ci runner build

* Fix comments

* Fix comments

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-08 16:02:16 -04:00
Akihiro Nitta 56cd883373
Merge pull request #13250 from PyTorchLightning/ci/rm-base
CI: Remove simple test `ci_test-base.yml`
2022-06-08 14:36:52 -04:00
Akihiro Nitta 3c5a8a833e
Decouple pulling legacy checkpoints from existing GHA workflows and docker files (#13185)
* Add pull-legacy-checkpoints action
* Replace pulls with the new action and script
* Simplify
2022-06-02 15:39:14 +02:00
Akihiro Nitta a6e9bc2943
Document CI/CD (#12980)
* Add README.md to .github/workflows/

* Link CI/CD doc page from contributing.md

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-05-28 23:39:01 +00:00
Jirka Borovec fab2ff35ad
CI: Azure - multiple configs (#12984)
* CI: Azure - multiple configs
* names
* benchmark
* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-14 01:59:03 +00:00
Jirka Borovec fec9a09672
add freeze for development and full range for install (#12994)
* freeze versions

* unfreeze

* dependabot

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* fix all req

* ...

* use base

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix refs

* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

* Apply suggestions from code review

* dockers

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-05-12 09:14:18 -04:00
Jirka Borovec 783ec43a85
parse strategies as own extras (#12975)
* parse strategies as own extras

* prune devel

* Update Makefile

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* revert parse_requirements

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-09 09:25:53 -04:00
Jirka Borovec 7ce948edb6
Unpin CUDA docker image for GPU CI (#12373)
* unpin CUDA docker image for GPU CI
* Apply suggestions from code review

Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Akihiro Nitta <akihiro@pytorchlightning.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-05-06 02:56:57 +00:00
Jirka Borovec bb51e2a55b
Merge pull request #12723 from PyTorchLightning/req/strategies
Separate strategies' requirements
2022-05-04 10:06:02 -04:00
Akihiro Nitta ecd135e939
Update nvidia gpg key to fix nightly docker builds (#12930)
* Update gpg key
* Use curl instead of wget
* Install key manually
2022-05-02 09:00:44 +02:00
Wei Ji 6490996b39
Support deterministic="warn" in Trainer for Pytorch 1.11+ (#12588)
Co-authored-by: carmocca <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-04-27 12:05:26 +00:00
Akihiro Nitta ace6a5827b
Update building docker images (#12837)
Co-authored-by: Akihiro Nitta <akihiro@pytorchlightning.ai>
2022-04-21 22:10:42 +00:00
Akihiro Nitta 45f1ffa535
Enable running slow tests on Windows in CI (#12761) 2022-04-18 12:04:35 +00:00
Akihiro Nitta 1a6979ddf1
Workaround for actions/checkout in conda CI jobs (#12758) 2022-04-14 12:29:29 +02:00
Jirka Borovec 16b9580958
build more dockers & slack fails (#12675)
* build dockers
* add slack
* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-04-13 17:24:08 +02:00
Jirka Borovec f9b69ce5b0
CI: check docker requires (#12677)
* check docker requires
* ci update
* bagua
* conda
* cuda
2022-04-12 00:29:54 +09:00
Carlos Mocholí 2e5b3b333d
Allow self-reviewing to rerun gatekeeper (#12672) 2022-04-09 10:41:37 +00:00
Jirka Borovec f6d61cb08a
Update ci_pr-gatekeeper.yml (#12661)
* Update ci_pr-gatekeeper.yml
2022-04-08 18:25:50 +09:00
Jirka Borovec 7988351d88
add PR Gatekeeper (#12646)
* add PR Gatekeeper

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-07 11:02:25 -04:00
Aki Nitta 648cc2d2eb
Update environment variable for cache reset for consistency (#12455) 2022-03-27 17:42:01 +02:00
Aki Nitta 4589f2b4ee
Update hash for caching (#12405)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-03-23 09:14:29 +00:00
Seth Vargo ea7f444167
Pin setup-gcloud to v0 instead of master (#12375)
* Pin setup-gcloud to v0 instead of master.

setup-gcloud will be updating the branch name from master to main in
a future release. Even though GitHub will establish redirects, this
will break any GitHub Actions workflows that pin to master. This PR
updates your GitHub Actions workflows to pin to v0, which is the
recommended best practice.

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-03-23 07:13:19 +00:00
Jirka Borovec fe940e195d
CI: update prune_pkgs (#12382) 2022-03-21 12:50:50 +00:00
Jirka Borovec 7ee690758c
CI: fix running PT 1.11 (#12304)
* fix fire
* horovod
* assistant
* cmake
* u20
* cuda
* -j2
* fix mypy

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-03-12 09:00:20 +00:00
Jirka Borovec bc8172856f
aggregate multiple helper scripts to single CLI (#11147)
* nightly release
* min version
* fire
2022-03-11 11:13:43 +00:00
Jirka Borovec 1144673cd9
CI: sanity check for req. pkgs (#11819)
* CI: sanity check for req. pkgs
* scripts
* rename
* gcsfs ?
* rich !
* install extra
* move
* set -e

Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-03-11 09:20:47 +00:00
Jirka Borovec 3b4061f39a
CI: enable testing for PT 1.11 (#11792)
* enable PT 1.11
* horovod
* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
2022-03-10 18:38:47 +00:00
Kushashwa Ravi Shrimali 821ca7e85d
Drop PyTorch 1.7 testing from the CI (#12191)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
2022-03-08 19:02:32 +01:00
Jirka Borovec 9b0942d731
CI: fix upload-artifact (#11962)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-21 16:03:02 +01:00
Jirka Borovec 7bc87015ea
Unblock GPU CI (#11934)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-16 21:15:44 +01:00
Jirka Borovec 8ddf9f996d
CI: fix valid schema (#11744) 2022-02-05 14:52:44 +00:00
Jirka Borovec 92c22aedb9
CI: use concurrency (#11351) 2022-02-02 19:48:15 +00:00
Rohit Gupta 42fddc371a
Add a direct link to built docs in CI (#11514) 2022-01-19 08:36:39 +08:00
Aki Nitta d95c0d5a44
Upgrade Ubuntu version from `18.04` to `20.04` (#11395)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-01-13 16:01:31 +01:00
Aki Nitta 8e8d4c5fe0
Skip testing with PyTorch 1.7 and Python 3.9 on Ubuntu (#11217)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-01-07 14:09:52 +01:00
Carlos Mocholí f6a6a25810
Remove the "Verify linked issue" bot (#11338) 2022-01-06 17:01:45 +09:00
Carlos Mocholí 3692eba807
Drop Python 3.6 support (#11117) 2021-12-21 17:06:15 +00:00
Carlos Mocholí 26977043bf
Add separate CI job for slow tests (#10830) 2021-12-01 19:58:18 +00:00
Carlos Mocholí e1bf54c944
Tune Conda CI timeout and other minor improvements (#10769) 2021-11-28 17:58:03 +00:00
thomas chaton 412d507a73
Fault Tolerant: move signal to SIGTERM (#10605) 2021-11-26 13:37:27 +00:00
Danielle Pintz 85d7c4dce4
Configure mypy to install dependencies in CI and update pyproject.toml (#10682)
* mypy install deps

* fix deps

* add examples

* fix type errors

* fix type error

* fix

* fix

* update pyproject.toml
2021-11-25 00:19:30 +00:00
Carlos Mocholí 3d2d0f2536
MANIFEST.in and setup.py clean-up (#7614) 2021-11-19 15:38:42 +01:00
Carlos Mocholí c15b84dae7
Simplify hanging queue test (#10591) 2021-11-17 22:29:48 +00:00
Carlos Mocholí ff3443fe42
Use single quotes in action job (#10579) 2021-11-17 15:54:41 +00:00
Carlos Mocholí 247f5aacc2
Tune cc-bot settings (#10544) 2021-11-16 18:23:57 +00:00
Carlos Mocholí 3077886a4f
Enable the auto-cc bot (#10531) 2021-11-15 14:27:42 +00:00
Carlos Mocholí d2aaf6b4cc
Upgrade CI after the 1.10 release (#10075) 2021-11-10 17:59:10 +01:00
Carlos Mocholí 5b90253a53
Drop torch 1.6 support (#10367) 2021-11-08 11:29:39 +00:00