Commit Graph

67 Commits

Author SHA1 Message Date
Jirka Borovec 8cf185a06d
fix: use standalone tests' exit code (#20430) 2024-11-19 09:50:26 +01:00
Jirka Borovec 61a403a512
bump: Torch `2.5` (#20351)
* bump: Torch `2.5.0`

* push docker

* docker

* 2.5.1 and mypy

* update USE_DISTRIBUTED=0 test

* also for pytorch lightning no distributed

* set USE_LIBUV=0 on windows

* try drop pickle warning

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* disable compiling update_metrics

* bump 2.2.x to bugfix

* disable also log in logger connector (also calls metric)

* more point release bumps

* remove unloved type ignore and print some more on exit

* update checkgroup

* minor versions

* shortened version in build-pl

* pytorch 2.4 is with python 3.11

* 2.1 and 2.3 without patch release

* for 2.4.1: docker with 3.11 test with 3.12

---------

Co-authored-by: Thomas Viehmann <tv.code@beamnet.de>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-12 15:59:08 +01:00
awaelchli 2064887b12
Switch to PyTorch 2.4 stable testing (#20126) 2024-07-25 06:59:43 -04:00
awaelchli bf25167bbf
Add testing for PyTorch 2.4 (Trainer) (#20010) 2024-07-11 06:52:56 -04:00
Gilles Peiffer b9f215d7fd
Replace usage of `grep -P` with `perl` in `run_standalone_tests.sh` (#19942) 2024-06-05 12:32:56 -04:00
Adrian Wälchli 49ed2b102b
Add PyTorch 2.3 to CI matrix (#19708) 2024-04-29 07:16:13 -04:00
awaelchli 2e512d4b2e
Remove the Colossal AI integration (#19528) 2024-02-26 10:59:15 +01:00
awaelchli 8d4768f2ae
Remove the Bagua integration (#19445) 2024-02-12 20:58:52 +01:00
awaelchli c7c42dcef3
Update CI to use latest PyTorch 2.2 (#19401) 2024-02-05 12:50:23 -05:00
Jirka Borovec 3bd133b107
CI: enable testing with coming PT 2.2 (#19289)
* ci: build dockers for PT 2.2
* py3.12
* --pre --extra-index-url
* typing-extensions
* bump jsonargparse
* install latest jsonargparse
* Add windows skips for Fabric
* convert to xfail
* add pytorch skips
* skip checkpoint consolidation test
* set max torch

---------

Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-01-26 16:42:09 +01:00
awaelchli 41503fc2ba
Install `bitsandbytes` to run skipped bitsandbytes tests (#19260) 2024-01-11 02:50:43 -05:00
Jirka Borovec 2a8789e1c6
ci/tests: cleaning standalone script (#19141)
* tests: cleaning standalone script

* switch

* from tests

* -m

* collect

* array

* tests_fabric/

* ..

* path prefix

* pl

* cleaning

* test_pytorch_profiler_nested_emit_nvtx

* Apply suggestions from code review

* Apply suggestions from code review

* todo
2023-12-13 13:27:49 -06:00
Carlos Mocholí 4e72dcc8db
Reduce lightning data's dependencies (#19026) 2023-11-17 16:52:14 -05:00
Adrian Wälchli 77eef8aff5
Update GPU CI and docker images for PyTorch 2.1 (#18719)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-10-06 08:12:37 -04:00
Jirka Borovec d579cfed57
precommit: unify formatting with prettier (#18605)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-09-25 14:34:41 +02:00
Jirka Borovec eb8b314f7c
Switch GPU CI from nightly to RC/test (#18485) 2023-09-06 23:34:43 +02:00
Jirka Borovec 57ef88f8fc
ci: drop nightly from required checks (#18250) 2023-08-07 11:26:13 +02:00
Jirka Borovec 14b65941b0
ci: bump CUDA for nightly (#18162)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-07-25 22:30:09 +02:00
Carlos Mocholí 01b82e4fb1
Minor miscellaneous fixes (#18077)
* Various miscellaneous fixes

* Update

* Update

* succeeded

* Comment everywhere

* hasattr
2023-07-20 14:44:51 +02:00
Carlos Mocholí a9269aecdb
Add nightly testing to CUDA CI (#18078) 2023-07-17 20:53:29 +02:00
Jirka Borovec 7f1aa7229c
ci: hotfix for doctests (#17841) 2023-06-15 15:25:59 +00:00
Jirka Borovec 51b0e81105
replace local adjustment script with external (#17582) 2023-05-29 19:34:04 +00:00
Jirka Borovec 56377d9b1f
ci: separate parity/benchmarks (#17502)
* ci: separet benchmarks

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* measure

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* conf

* isort

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci

* parity

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* taska

* name

* ...

* var

* ...

* ...

* ...

* cd

* reset_cudnn_benchmark

* import

* imports

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* models

* xfail

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-24 19:16:41 -04:00
Jirka Borovec b87df54eb4
Adding test for legacy checkpoints (#17562)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-04 20:01:56 +00:00
Jirka Borovec 137837d978
ci: drop secondary pkg for LAI (#17565) 2023-05-04 19:25:46 +01:00
Carlos Mocholí 9627121da7
Simplify strategy installation in CI (#17347) 2023-04-25 01:09:57 +00:00
Carlos Mocholí 039891fb49
Install project specific dependencies (#17376)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-24 23:31:47 +00:00
Carlos Mocholí 856b29fc72
[TPU] Replace GKE in CI with manual gcloud usage (#17362) 2023-04-14 12:47:31 +00:00
Carlos Mocholí 472333c9b8
Replace codecov pip package with codecov uploader (#17349) 2023-04-12 17:24:48 +02:00
Jirka Borovec e04d4fd25e
ci: separate integrations (#17170)
* integrations

* Rename

* Apply suggestions from code review

* cut out

* skip _

* fix

* setup

* 1e-2

* uninstall

* revert

* note
2023-03-24 09:46:45 +01:00
Carlos Mocholí 2b6f0a15e1
Update CI to pull torch 2.0 stable (#17107) 2023-03-21 12:31:05 +00:00
Aniket Maurya da572d7cca
Refactor PL examples to `examples/pytorch/` (#16925)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-03-07 11:24:46 -05:00
Jirka Borovec f2e8059f7f
ci: fix Azure trigger pattern (#16972) 2023-03-06 12:19:50 -05:00
Carlos Mocholí fca69e68da
Fabric: Test PyTorch 2.0 pre-release on CPU and CUDA (#16905)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-03-03 17:48:49 +00:00
Jirka Borovec 70b257c17f
ci/gpu: fix install future & use local cache (#16929) 2023-03-02 22:17:29 +00:00
Jirka Borovec 37d0322dbe
pkg: append PL to lightning (#16921) 2023-03-02 19:11:26 +00:00
Justus Schock b4e29e0c8f
PL: Test PyTorch 2.0 pre-release on CPU and CUDA (#16764)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-02-28 18:38:40 +01:00
Carlos Mocholí d807c003a7
Always run standalone tests (#16705) 2023-02-20 14:58:44 +00:00
Adrian Wälchli 565d3bb8c6
CI: Update colossalai version (#16747)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-02-14 14:07:29 -05:00
Adrian Wälchli c4074419b5
Remove the BaguaStrategy (#16746)
* remove bagua

* remove

* remove docker file entry
2023-02-14 08:58:58 -05:00
Adrian Wälchli 393f7a0949
Update pytorch_lightning imports in examples (#16615)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-02-10 10:30:42 +00:00
Jirka Borovec 4f35c7c356
ci: parameterize GPU testing (#16697) 2023-02-09 13:39:03 +00:00
Jirka Borovec de005321a5
tests: switch imports for pytorch (#16595)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-02-02 10:06:45 +00:00
Jirka Borovec 377210d85d
tests: switch imports for fabric (#16592) 2023-02-01 20:34:38 +00:00
Jirka Borovec 7d4780adb1
move pytorch_lightning >> lightning/pytorch (#16594) 2023-02-01 18:22:42 +00:00
Jirka Borovec fda354a1f1
move lightning_fabric >> lightning/fabric (#16589)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-02-01 17:18:32 +00:00
Carlos Mocholí 59f2d4ce63
Install colossalai==0.1.12 in CI (#16587) 2023-02-01 04:57:22 +00:00
Carlos Mocholí a78412f11d
Remove DataLoader serialization (under fault tolerance) (#16533) 2023-01-30 16:12:01 +01:00
Jirka Borovec 799ced8430
ci: replace flake8 by ruff (#16433)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-01-19 11:48:28 -05:00
Carlos Mocholí c18a0ec819
Remove untested NVIDIA Dali example (#16306) 2023-01-10 14:11:08 +01:00