lightning/.github/checkgroup.yml

394 lines
13 KiB
YAML
Raw Normal View History

custom_service_name: "Lightning CI required checker"
subprojects:
2022-09-08 14:12:58 +00:00
# SECTION: pytorch_lightning
- id: "pytorch_lightning: Tests workflow"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".github/workflows/ci-tests-pytorch.yml"
- "requirements/fabric/**"
- "src/lightning/fabric/**"
- "src/lightning_fabric/*"
- "requirements/pytorch/**"
- "src/lightning/pytorch/**"
- "src/pytorch_lightning/*"
- "tests/tests_pytorch/**"
2023-01-25 12:14:42 +00:00
- "tests/legacy/**"
- "pyproject.toml" # includes pytest config
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "pl-cpu (macOS-11, pytorch, 3.8, 1.11)"
- "pl-cpu (macOS-11, pytorch, 3.9, 1.12)"
- "pl-cpu (macOS-11, pytorch, 3.10, 1.13)"
- "pl-cpu (macOS-11, pytorch, 3.8, 1.11, oldest)"
LAI: creating mirror package (#15105) * placeholder * mirror + prune * makedir * setup * ci * ci * name * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * ci clean * empty * py * parallel * doctest * flake8 * ci * typo * replace * clean * Apply suggestions from code review * re.sub * fix UI path * full replace * ui path? * replace * updates * regex * ci * fix * ci * path * ci * replace * Update .actions/setup_tools.py Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com> * also convert lightning_lite tests for PL tests to adapt mocking paths * fix app example test * update logger propagation for PL tests * update logger propagation for PL tests * Apply suggestions from code review * Revert "update logger propagation for PL tests" This reverts commit c1a5e119c740b5468daac63028de8aa799a177ac. * playwright * py * update import in tests * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * try edit import in overwrite * debug code * rev playwright * Revert "try edit import in overwrite" This reverts commit c02f766521c91454be36b19784c6a3ed2f715109. * ci: adjust examples * adjust examples cloud * mock lightning_app * Install assistant dependencies * lightning * setup * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com> * Apply suggestions from code review * disable cache * move doctest to install * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * ) * echo ./ * ci * lru * revert disabling cache, prints * ci * prune ci jobs * prune ci jobs * training loop standalone tests * add sys modules cleanup fixture * make use of fixture * revert standalone * ci e2e * fix imports in lightning * fix imports of lightning in tests * Revert "make use of fixture" This reverts commit c15efdd205da2353187275a8d3da141d0ec0ec0a. * Revert other commits for fixtures * revert use of fixture * py3.9 * fix mocking * fix paths * hack mocking * docs * Apply suggestions from code review * rev suggestion * Minor changes to the parametrizations * Update checkgroup with the new and changed jobs * include frontend dir * cli * fix imports and entry point * Revert standalone * rc1 * e2e on staging * Revert "Revert standalone" This reverts commit 9df96685b866b1719fcdeb0b2e832255e3a5f8c0. * groups * to * ci: pt ver * docker * Apply suggestions from code review * Copy over changes from previous commit to other groups * Add back changes from bad merge * Uppercase step name everywhere * update * ci * ci: lai oldest Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com> Co-authored-by: Justus Schock <justus.schock@posteo.de> Co-authored-by: manskx <ahmed.mansy156@gmail.com> Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com> Co-authored-by: thomas chaton <thomas@grid.ai> Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-10-27 10:32:49 +00:00
- "pl-cpu (ubuntu-20.04, pytorch, 3.9, 1.11)"
- "pl-cpu (ubuntu-20.04, pytorch, 3.10, 1.12)"
- "pl-cpu (ubuntu-20.04, pytorch, 3.10, 1.13)"
- "pl-cpu (ubuntu-20.04, pytorch, 3.8, 1.11, oldest)"
LAI: creating mirror package (#15105) * placeholder * mirror + prune * makedir * setup * ci * ci * name * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * ci clean * empty * py * parallel * doctest * flake8 * ci * typo * replace * clean * Apply suggestions from code review * re.sub * fix UI path * full replace * ui path? * replace * updates * regex * ci * fix * ci * path * ci * replace * Update .actions/setup_tools.py Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com> * also convert lightning_lite tests for PL tests to adapt mocking paths * fix app example test * update logger propagation for PL tests * update logger propagation for PL tests * Apply suggestions from code review * Revert "update logger propagation for PL tests" This reverts commit c1a5e119c740b5468daac63028de8aa799a177ac. * playwright * py * update import in tests * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * try edit import in overwrite * debug code * rev playwright * Revert "try edit import in overwrite" This reverts commit c02f766521c91454be36b19784c6a3ed2f715109. * ci: adjust examples * adjust examples cloud * mock lightning_app * Install assistant dependencies * lightning * setup * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com> * Apply suggestions from code review * disable cache * move doctest to install * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * ) * echo ./ * ci * lru * revert disabling cache, prints * ci * prune ci jobs * prune ci jobs * training loop standalone tests * add sys modules cleanup fixture * make use of fixture * revert standalone * ci e2e * fix imports in lightning * fix imports of lightning in tests * Revert "make use of fixture" This reverts commit c15efdd205da2353187275a8d3da141d0ec0ec0a. * Revert other commits for fixtures * revert use of fixture * py3.9 * fix mocking * fix paths * hack mocking * docs * Apply suggestions from code review * rev suggestion * Minor changes to the parametrizations * Update checkgroup with the new and changed jobs * include frontend dir * cli * fix imports and entry point * Revert standalone * rc1 * e2e on staging * Revert "Revert standalone" This reverts commit 9df96685b866b1719fcdeb0b2e832255e3a5f8c0. * groups * to * ci: pt ver * docker * Apply suggestions from code review * Copy over changes from previous commit to other groups * Add back changes from bad merge * Uppercase step name everywhere * update * ci * ci: lai oldest Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com> Co-authored-by: Justus Schock <justus.schock@posteo.de> Co-authored-by: manskx <ahmed.mansy156@gmail.com> Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com> Co-authored-by: thomas chaton <thomas@grid.ai> Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-10-27 10:32:49 +00:00
- "pl-cpu (windows-2022, pytorch, 3.9, 1.11)"
- "pl-cpu (windows-2022, pytorch, 3.10, 1.12)"
- "pl-cpu (windows-2022, pytorch, 3.10, 1.13)"
- "pl-cpu (windows-2022, pytorch, 3.8, 1.11, oldest)"
- "pl-cpu (slow, macOS-11, pytorch, 3.8, 1.11)"
- "pl-cpu (slow, ubuntu-20.04, pytorch, 3.8, 1.11)"
- "pl-cpu (slow, windows-2022, pytorch, 3.8, 1.11)"
- "pl-cpu (macOS-11, lightning, 3.8, 1.13)"
- "pl-cpu (ubuntu-20.04, lightning, 3.8, 1.13)"
- "pl-cpu (windows-2022, lightning, 3.8, 1.13)"
2022-09-08 14:12:58 +00:00
- id: "pytorch_lightning: Azure GPU"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".azure/gpu-tests-pytorch.yml"
# only the azure GPU workflow runs the examples
# all examples don't need to be added because they aren't used in CI, but these are
- "examples/run_pl_examples.sh"
- "examples/pl_basics/backbone_image_classifier.py"
- "examples/pl_basics/autoencoder.py"
- "requirements/pytorch/**"
- "src/lightning/pytorch/**"
- "src/pytorch_lightning/*"
- "tests/tests_pytorch/**"
- "pyproject.toml" # includes pytest config
- "requirements/fabric/**"
- "src/lightning/fabric/**"
- "src/lightning_fabric/*"
2022-11-26 01:16:48 +00:00
- "!requirements/docs.txt"
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "pytorch-lightning (GPUs)"
- id: "pytorch_lightning: Benchmarks"
paths:
- ".azure/gpu-benchmark.yml"
- "tests/tests_pytorch/benchmarks/**"
- "requirements/pytorch/**"
2022-11-16 10:07:02 +00:00
- "!requirements/pytorch/docs.txt"
- "!*.md"
- "!**/*.md"
checks:
- "pytorch-lightning.Benchmark"
- id: "pytorch_lightning: Azure HPU"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".azure/hpu-tests.yml"
- "examples/pl_hpu/mnist_sample.py"
- "requirements/fabric/**"
- "src/lightning/fabric/**"
- "src/lightning_fabric/*"
- "requirements/pytorch/**"
- "src/lightning/pytorch/**"
- "src/pytorch_lightning/*"
- "tests/tests_pytorch/**"
- "pyproject.toml" # includes pytest config
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "pytorch-lightning (HPUs)"
- id: "pytorch_lightning: Azure IPU"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".azure/ipu-tests.yml"
- "requirements/fabric/**"
- "src/lightning/fabric/**"
- "src/lightning_fabric/*"
- "requirements/pytorch/**"
- "src/lightning/pytorch/**"
- "src/pytorch_lightning/*"
- "tests/tests_pytorch/**"
- "pyproject.toml" # includes pytest config
2022-11-26 01:16:48 +00:00
- "!requirements/docs.txt"
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "pytorch-lightning (IPUs)"
# TODO: since this job has intermittent availability, it cannot be required
#- id: "pytorch-lightning: TPU workflow"
# paths:
2022-11-26 01:16:48 +00:00
# - ".actions/**"
# - ".github/workflows/tpu-tests.yml"
# - "dockers/base-xla/*"
# - "requirements/fabric/**"
# - "src/lightning_fabric/**"
# - "tests/tests_fabric/**"
# - "requirements/pytorch/**"
# - "src/pytorch_lightning/**"
# - "tests/tests_pytorch/**"
# - "pyproject.toml" # includes pytest config
2022-11-26 01:16:48 +00:00
# - "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
# - "!*.md"
# - "!**/*.md"
# checks:
# - "test-on-tpus"
- id: "pytorch_lightning: Docs"
paths:
- "src/lightning/pytorch/**"
- "src/pytorch_lightning/*"
- "docs/source-pytorch/**"
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".github/workflows/docs-checks.yml"
- "requirements/docs.txt"
- "requirements/pytorch/**"
- "setup.py"
- "pyproject.toml" # includes metadata used in the package creation
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "make-doctest (pytorch)"
- "make-html (pytorch)"
- id: "pytorch_lightning: Docker"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
2022-09-08 14:12:58 +00:00
- ".github/workflows/ci-pytorch-dockers.yml"
2022-11-26 01:16:48 +00:00
- "dockers/**"
- "requirements/pytorch/**"
- "requirements/fabric/**"
- "environment.yml"
- "setup.py"
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "build-cuda (3.9, 1.11, 11.3.1)"
- "build-cuda (3.9, 1.12, 11.6.1)"
- "build-cuda (3.9, 1.13, 11.7.1)"
- "build-hpu (1.5.0, 1.11.0)"
- "build-ipu (3.9, 1.13)"
- "build-NGC"
- "build-pl (3.9, 1.11, 11.3.1)"
- "build-pl (3.9, 1.12, 11.6.1)"
- "build-pl (3.9, 1.13, 11.7.1)"
- "build-xla (3.8, 1.12)"
# SECTION: lightning_fabric
2022-09-08 14:12:58 +00:00
- id: "lightning_fabric: CPU workflow"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- "requirements/fabric/**"
- "src/lightning/fabric/**"
- "src/lightning_fabric/*"
- "tests/tests_fabric/**"
- "pyproject.toml" # includes pytest config
- ".github/workflows/ci-tests-fabric.yml"
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "fabric-cpu (macOS-11, fabric, 3.8, 1.11)"
- "fabric-cpu (macOS-11, fabric, 3.9, 1.12)"
- "fabric-cpu (macOS-11, fabric, 3.10, 1.13)"
- "fabric-cpu (macOS-11, fabric, 3.8, 1.11, oldest)"
- "fabric-cpu (ubuntu-20.04, fabric, 3.9, 1.11)"
- "fabric-cpu (ubuntu-20.04, fabric, 3.10, 1.12)"
- "fabric-cpu (ubuntu-20.04, fabric, 3.10, 1.13)"
- "fabric-cpu (ubuntu-20.04, fabric, 3.8, 1.11, oldest)"
- "fabric-cpu (windows-2022, fabric, 3.9, 1.11)"
- "fabric-cpu (windows-2022, fabric, 3.10, 1.12)"
- "fabric-cpu (windows-2022, fabric, 3.10, 1.13)"
- "fabric-cpu (windows-2022, fabric, 3.8, 1.11, oldest)"
- "fabric-cpu (macOS-11, lightning, 3.8, 1.13)"
- "fabric-cpu (ubuntu-20.04, lightning, 3.8, 1.13)"
- "fabric-cpu (windows-2022, lightning, 3.8, 1.13)"
- id: "lightning_fabric: Azure GPU"
2022-09-08 14:12:58 +00:00
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".azure/gpu-tests-fabric.yml"
- "examples/fabric/**"
- "examples/run_fabric_examples.sh"
- "tests/tests_fabric/run_standalone_*.sh"
- "tests/tests_pytorch/run_standalone_tests.sh" # used by Fabric through a symlink
- "requirements/fabric/**"
- "src/lightning/fabric/**"
- "src/lightning_fabric/*"
- "tests/tests_fabric/**"
- "pyproject.toml" # includes pytest config
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
2022-09-08 14:12:58 +00:00
checks:
- "lightning-fabric (GPUs)"
2022-09-08 14:12:58 +00:00
# SECTION: lightning_app
- id: "lightning_app: Tests workflow"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".github/workflows/ci-tests-app.yml"
- "src/lightning/app/**"
- "src/lightning_app/*"
- "tests/tests_app/**"
- "requirements/app/**"
- "setup.py"
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "app-pytest (macOS-11, lightning, 3.8, latest)"
- "app-pytest (macOS-11, lightning, 3.8, oldest)"
- "app-pytest (macOS-11, app, 3.9, latest)"
- "app-pytest (ubuntu-20.04, lightning, 3.8, latest)"
- "app-pytest (ubuntu-20.04, lightning, 3.8, oldest)"
- "app-pytest (ubuntu-20.04, app, 3.9, latest)"
- "app-pytest (windows-2022, lightning, 3.8, latest)"
- "app-pytest (windows-2022, lightning, 3.8, oldest)"
- "app-pytest (windows-2022, app, 3.8, latest)"
- id: "lightning_app: Examples"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".github/workflows/ci-examples-app.yml"
- "src/lightning/app/**"
- "src/lightning_app/*"
- "tests/integrations_app/**"
- "!tests/integrations_app/flagship/**"
- "examples/app_*/**"
- "requirements/app/**"
- "setup.py"
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "app-examples (macOS-11, lightning, 3.9, latest)"
- "app-examples (macOS-11, lightning, 3.9, oldest)"
- "app-examples (macOS-11, app, 3.9, latest)"
- "app-examples (ubuntu-20.04, lightning, 3.9, latest)"
- "app-examples (ubuntu-20.04, lightning, 3.9, oldest)"
- "app-examples (ubuntu-20.04, app, 3.9, latest)"
- "app-examples (windows-2022, lightning, 3.9, latest)"
- "app-examples (windows-2022, lightning, 3.9, oldest)"
- "app-examples (windows-2022, app, 3.9, latest)"
- id: "lightning: Flagships"
paths:
- ".github/workflows/ci-flagship-apps.yml"
2023-01-26 14:59:10 +00:00
- "github/actions/prep-apps/action.yml"
- "tests/integrations_app/flagship/**"
checks:
2023-01-26 14:59:10 +00:00
- "app-flagships (flashy, Lightning-Universe/Flashy-app)"
2023-01-27 14:01:06 +00:00
- id: "lightning: Store"
paths:
- ".azure/app-cloud-store.yml"
- "src/lightning/store/**"
- "tests/tests_cloud/**"
checks:
- "Store.cloud (test_store Linux)"
- "Store.cloud (test_store Mac)"
- "Store.cloud (test_store Windows)"
- id: "lightning_app: Azure"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- ".azure/app-cloud-e2e.yml"
- "src/lightning/app/**"
- "src/lightning_app/*"
2022-11-26 01:16:48 +00:00
- "requirements/app/**"
- "tests/integrations_app/**"
- "!tests/integrations_app/flagship/**"
- "setup.py"
2022-11-26 01:16:48 +00:00
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "App.cloud-e2e"
- id: "lightning_app: Docs"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
- "src/lightning/app/**"
- "src/lightning_app/*"
- "docs/source-app/**"
- ".github/workflows/docs-checks.yml"
- "requirements/docs.txt"
- "requirements/app/**"
- "setup.py"
- "pyproject.toml" # includes metadata used in the package creation
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "make-doctest (app)"
- "make-html (app)"
2022-09-08 14:12:58 +00:00
# SECTION: common
- id: "mypy"
paths:
2022-11-26 01:16:48 +00:00
- ".actions/**"
2022-09-08 14:12:58 +00:00
- ".github/workflows/code-checks.yml"
- "requirements/**"
- "src/**"
2022-09-08 14:12:58 +00:00
- "pyproject.toml" # includes mypy config
2022-11-26 01:16:48 +00:00
- "!requirements/docs.txt"
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
2022-09-08 14:12:58 +00:00
checks:
- "mypy"
- id: "install"
paths:
- ".actions/**"
- ".github/actions/pkg-check/*"
- ".github/actions/pkg-install/*"
- ".github/workflows/_build-packages.yml"
- ".github/workflows/ci-pkg-install.yml"
- "setup.py"
- "src/**"
- "requirements/**"
2022-11-26 01:16:48 +00:00
- "!requirements/docs.txt"
- "!requirements/*/docs.txt"
2022-11-16 10:07:02 +00:00
- "!*.md"
- "!**/*.md"
checks:
- "install-pkg (ubuntu-22.04, app, 3.8)"
- "install-pkg (ubuntu-22.04, app, 3.10)"
- "install-pkg (ubuntu-22.04, fabric, 3.8)"
- "install-pkg (ubuntu-22.04, fabric, 3.10)"
- "install-pkg (ubuntu-22.04, pytorch, 3.8)"
- "install-pkg (ubuntu-22.04, pytorch, 3.10)"
- "install-pkg (ubuntu-22.04, lightning, 3.8)"
- "install-pkg (ubuntu-22.04, lightning, 3.10)"
- "install-pkg (ubuntu-22.04, notset, 3.8)"
- "install-pkg (ubuntu-22.04, notset, 3.10)"
- "install-pkg (macOS-12, app, 3.8)"
- "install-pkg (macOS-12, app, 3.10)"
- "install-pkg (macOS-12, fabric, 3.8)"
- "install-pkg (macOS-12, fabric, 3.10)"
- "install-pkg (macOS-12, pytorch, 3.8)"
- "install-pkg (macOS-12, pytorch, 3.10)"
- "install-pkg (macOS-12, lightning, 3.8)"
- "install-pkg (macOS-12, lightning, 3.10)"
- "install-pkg (macOS-12, notset, 3.8)"
- "install-pkg (macOS-12, notset, 3.10)"
- "install-pkg (windows-2022, app, 3.8)"
- "install-pkg (windows-2022, app, 3.10)"
- "install-pkg (windows-2022, fabric, 3.8)"
- "install-pkg (windows-2022, fabric, 3.10)"
- "install-pkg (windows-2022, pytorch, 3.8)"
- "install-pkg (windows-2022, pytorch, 3.10)"
- "install-pkg (windows-2022, lightning, 3.8)"
- "install-pkg (windows-2022, lightning, 3.10)"
- "install-pkg (windows-2022, notset, 3.8)"
- "install-pkg (windows-2022, notset, 3.10)"
2023-01-19 16:37:56 +00:00
- id: "link-check"
paths:
- ".github/workflows/md-check-links.yml"
- "**/*.md"
checks:
- "markdown-link-check"