oss-fuzz/.github/workflows/project_tests.yml

75 lines
1.8 KiB
YAML
Raw Normal View History

2020-06-12 21:39:16 +00:00
name: Project tests
Improve Actions hygiene (#5361) 👋 hello there! I'm a fellow Googler who works on projects that leverage GitHub Actions for CI/CD. Recently I noticed a large increase in our queue time, and I've tracked it down to the [limit of 180 concurrent jobs](https://docs.github.com/en/actions/reference/usage-limits-billing-and-administration) for an organization. To help be better citizens, I'm proposing changes across a few repositories that will reduce GitHub Actions hours and consumption. I hope these changes are reasonable and I'm happy to talk through them in more detail. - Only run GitHub Actions for pushes and PRs against the main branch of the repository. If your team uses a forking model, this change will not affect you. If your team pushes branches to the repository directly, this changes actions to only run against the primary branches or if you open a Pull Request against a primary branch. - For long-running jobs (especially tests), I added the "Cancel previous" workflow. This is very helpful to prevent a large queue backlog when you are doing rapid development and pushing multiple commits. Without this, GitHub Actions' default behavior is to run all actions on all commits. There are other changes you could make, depending on your project (but I'm not an expert): - If you have tests that should only run when a subset of code changes, consider gating your workflow to particular file paths. For example, we have some jobs that do Terraform linting, but [they only run when Terraform files are changed](https://github.com/google/exposure-notifications-verification-server/blob/c4f59fee71042cf668747e599e7c769fca736554/.github/workflows/terraform.yml#L3-L11). Hopefully these changes are not too controversial and also hopefully you can see how this would reduce actions consumption to be good citizens to fellow Googlers. If you have any questions, feel free to respond here or ping me on chat. Thank you!
2021-03-11 02:14:23 +00:00
on:
pull_request:
branches:
- master
2020-06-12 21:39:16 +00:00
jobs:
build:
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
engine:
- libfuzzer
sanitizer:
- address
- memory
- undefined
- coverage
2020-06-12 21:39:16 +00:00
architecture:
- x86_64
include:
- engine: afl
sanitizer: address
architecture: x86_64
- engine: honggfuzz
sanitizer: address
architecture: x86_64
- engine: libfuzzer
sanitizer: address
architecture: i386
- engine: none
sanitizer: address
architecture: x86_64
- engine: dataflow
sanitizer: dataflow
architecture: x86_64
env:
ENGINE: ${{ matrix.engine }}
SANITIZER: ${{ matrix.sanitizer }}
ARCHITECTURE: ${{ matrix.architecture }}
steps:
Improve Actions hygiene (#5361) 👋 hello there! I'm a fellow Googler who works on projects that leverage GitHub Actions for CI/CD. Recently I noticed a large increase in our queue time, and I've tracked it down to the [limit of 180 concurrent jobs](https://docs.github.com/en/actions/reference/usage-limits-billing-and-administration) for an organization. To help be better citizens, I'm proposing changes across a few repositories that will reduce GitHub Actions hours and consumption. I hope these changes are reasonable and I'm happy to talk through them in more detail. - Only run GitHub Actions for pushes and PRs against the main branch of the repository. If your team uses a forking model, this change will not affect you. If your team pushes branches to the repository directly, this changes actions to only run against the primary branches or if you open a Pull Request against a primary branch. - For long-running jobs (especially tests), I added the "Cancel previous" workflow. This is very helpful to prevent a large queue backlog when you are doing rapid development and pushing multiple commits. Without this, GitHub Actions' default behavior is to run all actions on all commits. There are other changes you could make, depending on your project (but I'm not an expert): - If you have tests that should only run when a subset of code changes, consider gating your workflow to particular file paths. For example, we have some jobs that do Terraform linting, but [they only run when Terraform files are changed](https://github.com/google/exposure-notifications-verification-server/blob/c4f59fee71042cf668747e599e7c769fca736554/.github/workflows/terraform.yml#L3-L11). Hopefully these changes are not too controversial and also hopefully you can see how this would reduce actions consumption to be good citizens to fellow Googlers. If you have any questions, feel free to respond here or ping me on chat. Thank you!
2021-03-11 02:14:23 +00:00
- name: Cancel previous
uses: styfle/cancel-workflow-action@0.8.0
with:
access_token: ${{ github.token }}
2020-06-12 21:39:16 +00:00
- uses: actions/checkout@v2
- run: | # Needed for git diff to work.
git fetch origin master --depth 1
git symbolic-ref refs/remotes/origin/HEAD refs/remotes/origin/master
- name: Clear unnecessary files
run: |
sudo swapoff -a
sudo rm -f /swapfile
sudo apt clean
docker rmi $(docker images -a -q)
df -h
- name: Setup python environment
uses: actions/setup-python@v2
with:
2020-07-15 16:46:24 +00:00
python-version: 3.8
2020-06-12 21:39:16 +00:00
- name: Install dependencies
2020-07-15 16:46:24 +00:00
run: |
python -m pip install --upgrade pip
pip install -r infra/ci/requirements.txt
2020-06-12 21:39:16 +00:00
- name: Run project tests
run: python infra/ci/build.py