Commit Graph

65 Commits

Author SHA1 Message Date
jonathanmetzman 67e3a77fd7
[NFC][infra][build] Move test data to test_data directory. (#6081)
Do this for consistency.
2021-07-21 10:07:59 -07:00
jonathanmetzman 6c5fffc019
[infra][build] Reset HOME using env instead of bash. (#6079)
Followup on #6069.
2021-07-21 09:09:08 -07:00
jonathanmetzman d66e974cbe
[infra][build] Set HOME=/root on GCB when doing fuzzer builds. (#6069)
[infra][build] Set HOME=/root on GCB when doing fuzzer builds.
GCB passes HOME as env var to the docker container. It sets
HOME to /builder/home which is persisted accross builds.
This issue causes build breakages in
https://github.com/google/oss-fuzz/issues/6035
and possibly https://github.com/google/oss-fuzz/issues/5317.
Perhaps more insidiuosly it can cause fuzzers to be built with
the wrong instrumentation.
2021-07-20 06:56:50 -07:00
Oliver Chang 3022776970
Revert "Bring back build status page fix until quota issues are resolved. (#5997)" (#6008)
This reverts commit e10f1658fa.
2021-07-08 10:32:36 +10:00
Abhishek Arya e10f1658fa
Bring back build status page fix until quota issues are resolved. (#5997) 2021-07-05 10:15:45 -07:00
jonathanmetzman 535597b038
[build/infra] Build engines in alphabetical order. (#5987)
* [build/infra] Build engines in alphabetical order.

Previously, a project fuzz targets were usually built in the order:
libfuzzer, afl, honggfuzz. This can bias results if one is looking
at which engine finds bugs first.

* fix tests

* lnt
2021-07-01 11:17:18 -07:00
DavidKorczynski d6970e868f
infra: Remove unused import from update_build_status (#5981)
In this commit 0370821e39 the use of the `time` import was removed. This causes the CI to complain about `infra/build/functions/update_build_status.py:21:0: W0611: Unused import time (unused-import)` here https://github.com/google/oss-fuzz/pull/5980/checks?check_run_id=2941631092
2021-06-29 12:29:35 +00:00
Abhishek Arya 0370821e39
Revert rate limits in update_build_status. 2021-06-28 21:30:04 -07:00
Abhishek Arya 53eff02879
Update update_build_status.py 2021-06-25 17:43:38 -07:00
Abhishek Arya a5822bb2ff
Update update_build_status.py 2021-06-25 17:09:42 -07:00
Abhishek Arya 00bbfdb5e1
Update update_build_status.py 2021-06-25 16:56:01 -07:00
Abhishek Arya 7d93e152de
Update update_build_status.py 2021-06-25 13:19:33 -07:00
Abhishek Arya ea06882e92
Update update_build_status.py 2021-06-25 13:16:47 -07:00
Abhishek Arya 77211e836c
Update update_build_status.py 2021-06-25 12:46:09 -07:00
Abhishek Arya 3096b90ca2
Update update_build_status.py 2021-06-25 12:04:37 -07:00
Abhishek Arya ba0a288c6e
Update update_build_status.py 2021-06-25 11:40:44 -07:00
Abhishek Arya 7e61f5509e
Update update_build_status.py 2021-06-25 11:06:47 -07:00
Abhishek Arya 3680920a30
Update update_build_status.py 2021-06-25 10:38:19 -07:00
Abhishek Arya 5fcb499c68
Decrease number of build logs to avoid rate limits. (#5973) 2021-06-25 10:18:38 -07:00
Abhishek Arya 867646da2d
Update update_build_status.py 2021-06-25 09:43:11 -07:00
Abhishek Arya 3b19d9fc18
Update update_build_status.py 2021-06-25 09:29:33 -07:00
Abhishek Arya f367531263
Reduce memory requirement in cloud functions to 2gb 2021-06-25 09:24:34 -07:00
Abhishek Arya db33cc2c38
Update update_build_status.py 2021-06-25 09:04:31 -07:00
Abhishek Arya 13a076b275
Reduce build status workers to see if quota issue resolve. 2021-06-25 08:42:43 -07:00
Abhishek Arya dbe6bd6fd3
Try fix for memory exceeded (#5969)
* Try fix for memory exceeded

Should fix https://github.com/google/oss-fuzz/issues/5968

* Update deploy.sh
2021-06-25 08:02:31 -07:00
Fabian Meumertzheim fee51cc181
[infra] Run JVM coverage builds (#5770) 2021-05-14 17:07:48 -07:00
dependabot[bot] 54f0985f8e
Bump pyyaml from 5.2 to 5.4 in /infra/build/functions (#5512)
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.2 to 5.4.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/5.2...5.4)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-03-25 20:44:10 -07:00
Fabian Meumertzheim 6ca344a446
Generate badges for projects without coverage (#5459)
Generate badges also for projects with no coverage builds at all (e.g.
JVM and Python projects). For these projects, the badge only has the two
possible states "build passing" and "build failing".
2021-03-21 18:52:02 -07:00
Catena cyber c41e46ffc8
Rust coverage report (for Suricata) (#4697)
* Rust coverage test

* Workaround to get rust coverage for Suricata
2021-03-08 07:05:35 -08:00
jonathanmetzman 0ac841a1a4
Replace terms that are uninclusive. (#5045) 2021-01-25 08:41:34 -08:00
Oliver Chang 8fcb4659e3
Add a missing requirement for CI. (#5036) 2021-01-22 12:45:11 +11:00
jonathanmetzman 648242fdb4
[pylint] Enable no-member check (#5034) 2021-01-21 16:21:17 -08:00
Oliver Chang 5b51cfb00f
Fix build functions tests when invoked from unittest.TestSuite. (#5027) 2021-01-21 07:43:42 -08:00
Abhishek Arya 588336d665
s/test_all/test_all.py for google cloud build. (#4783)
Fixes https://github.com/google/oss-fuzz/issues/4781
2020-12-04 08:26:34 -08:00
Oliver Chang 5da57c9128
Fix requirements.txt for GCB functions. (#4670) 2020-11-20 12:07:09 +11:00
Max Moroz b97f6e296a
[infra] Allow coverage for Go project on GCB (#2817, #2714). (#4668) 2020-11-19 16:07:35 -08:00
Oliver Chang 8b10d4b705
Fix incorrect OSS-Fuzz build project deletion. (#4623) 2020-11-10 11:10:43 +11:00
Oliver Chang 0987ddf994
even more fixes. (#4297) 2020-08-11 18:27:18 +10:00
Oliver Chang ade417ba20
Fix typo in project_sync.py (#4296)
* Fix typo in project_sync.py

* line length

* format
2020-08-11 16:25:08 +10:00
Oliver Chang 65a83e2125
Split up builds status function. (#4261)
- Split into separate invocations for fuzzing, coverage, and badges.
- Also use threads to speed things up.
2020-08-06 13:59:08 +10:00
Oliver Chang 909db51a15
More build infra cleanup. (#4252)
- Deleted unused code.
- Consolidate some modules.
2020-08-06 09:36:47 +10:00
Oliver Chang 3f1d43115f
Clean up build infra. (#4251)
- Remove gcb folder. Move the files that we still need into the
  build/functions dir.
- Remove badge_images. They are now stored on GCS.
- Remove jenins configs.
2020-08-05 11:20:48 +10:00
kabeer27 21cd8de8dc
Skipping fuzzing build when project is disabled (#4239)
* Skipping fuzzing build when project is disabled

* Removing skip build and making it better
2020-07-31 17:20:09 +10:00
Oliver Chang 47b57ca1dd
Fix a typo from previous MSan function addition. (#4241) 2020-07-31 16:58:28 +10:00
kabeer27 8e4c7b92fd
Adding msan builder to gcp (#4234)
* Adding msan builder to gcp

* Formatting changes

* Refactoring and reducing redundancy

* Moving msan builder entry point into base_images
2020-07-31 14:42:09 +10:00
Oliver Chang 5e3348cdb9
Create individual schedulers for requesting coverage builds. (#4237)
The single function for requesting all coverage builds was timing out.
2020-07-31 10:56:18 +10:00
kabeer27 341b3d836a
Display historical logs ui change (#4197)
* Initial UI Change to display historical logs

* Minor changes

* More formatting changes

* Adding license header

* Changes, take a look Oliver

* Changes for handling empty build history/ no last successful build

* Reverting the logs folder path from /logs/log to /log

* Merged to latest master and other chnages to template

* Changing backend to reflect build history

* Fixing order of query

* Removed last build status

* More changes

* Adding unit tests and fixes found by unit testing

* Fixing lint errors

* Added more unit tests and fixed typos and formatting

* Fixing comment caps

* Minor formatting issue

Co-authored-by: Oliver Chang <oliverchang@users.noreply.github.com>
2020-07-30 16:20:22 +10:00
Oliver Chang ccb5821f51
Fix build status update. (#4224)
Check for valid statuses rather than only excluding the WORKING status.
There are other failure statuses that need to be accounted for (e.g.
EXPIRED).
2020-07-30 15:10:52 +10:00
Oliver Chang 689f3500a2
Add missing dash to build tag. (#4221) 2020-07-30 08:31:01 +10:00
Oliver Chang ac4af2436f
build: Add queueTtl argument to one more place. (#4219) 2020-07-30 08:21:49 +10:00