Commit Graph

136 Commits

Author SHA1 Message Date
jonathanmetzman 7073fb976c
[i386] Do i386 builds of projects that have opted-in (#2416) 2019-05-15 14:00:57 -07:00
jonathanmetzman 3976a002af
[i386] Improve linking and bad build check (#2410)
Improve linking by copying i386 libs instead of adding `-L` to `CXXFLAGS`
Get bad_build_check working for i386 binaries and add architecture check.
2019-05-14 10:18:02 -07:00
Abhishek Arya 047eb4be4f
Update requirements.txt 2019-05-02 07:26:36 -07:00
Max Moroz 946d0603ba
[infra] Enabling DataFlow build configuration (#1632). (#2292)
* [infra] Enabling DataFlow build configuration (#1632).

* Copy all data flow scripts from the libFuzzer repo.
2019-04-09 07:25:14 -07:00
Oliver Chang 23a5f44b29
Address comments from https://github.com/google/oss-fuzz/pull/2285. (#2287) 2019-04-03 15:29:23 +11:00
Oliver Chang 994900ab47
Fix builds status script (#2285)
Get a batch of the last 2000 builds, and filter on those ourselves
instead of calling the cloudbuild API to filter for us. The cloudbuild
API filtering API does not work with our number of builds.

Fixes #2263
2019-04-02 12:00:55 +08:00
Oliver Chang 7bf55a11df
Use a single tag for builds. (#2284)
Filtering on multiple tags doesn't seem to work.
2019-04-02 08:19:58 +08:00
Max Moroz 497cd398d0 [infra] Fix code coverage builder script (regressed after #2264). 2019-03-31 11:33:07 -07:00
Oliver Chang aa231dc801
Add a project tag to builds for filtering (#2263). (#2264) 2019-03-26 17:02:05 +11:00
Oliver Chang 66008885e9
Remove image pushing step from build (#2232)
They aren't used and pushing them appears to be flaky.
2019-03-13 09:48:12 +11:00
Max Moroz 322b86a848 [infra] Disable honggfuzz builds by default (follow up for #2227). 2019-03-12 14:56:09 -07:00
Max Moroz 65037d2ea8
[infra] Bump build timeout from 10h to 12h. (#2227) 2019-03-11 07:38:14 -07:00
Oliver Chang 3d662e1bec
Add support for tags field in project.yaml (#1974) (#1980)
* Add support for tags field in project.yaml (#1974)

Also add "sundew" label to libxml2_xml_reader_for_file_fuzzer.

These add additional labels in filed bugs.
2018-11-27 16:46:26 +11:00
Abhishek Arya d29c322809
Revert "Update requests version 2.2.0" (#1921)
* Revert "Update requests version (#1913)"

This reverts commit 96fce46d4a.
2018-11-03 07:40:30 -07:00
jonathanmetzman 96fce46d4a
Update requests version (#1913) 2018-10-30 13:16:15 -07:00
Max Moroz fdd28c42e9
[infra] Add srcmap step to code coverage job (follow-up #1547). (#1868) 2018-10-11 13:52:49 -07:00
Abhishek Arya 4afcfab869
Revert "[infra] Remove srcmap related commands from gcb script (follow-up #1839)." (#1848)
This reverts commit f132eaf19c.
2018-10-01 22:34:05 -07:00
Max Moroz f132eaf19c [infra] Remove srcmap related commands from gcb script (follow-up #1839). 2018-10-01 08:02:38 -07:00
Max Moroz 7703e360de
[infra] Remove sancov and rename "profile" to "coverage". (#1839)
* [infra] Remove sancov and rename "profile" to "coverage".

* Bring coverage flags back.

* Update projects files that rely on SANITIZER="profile".
2018-10-01 06:43:21 -07:00
Max Moroz 4867091719 [infra] Code Coverage: fix build_and_run_coverage.py. 2018-09-12 07:01:21 -07:00
Max Moroz 8f687dfdad [infra] Code Coverage: update download_corpus script and revert #1798. 2018-09-11 12:26:59 -07:00
Max Moroz e6e71d0a92 [infra] Do not fail coverage job if corpus download failed (#1798, follow-up #1547). 2018-09-06 13:19:20 -07:00
Max Moroz 60f9023008
[infra] Add report date to the latest report info + fix format strings (follow-up #1547). (#1791) 2018-09-04 18:13:18 -07:00
pdknsk 6ed5fe8ed5 allow folded style for coverage_extra_args (#1786) 2018-09-05 09:27:57 +10:00
Max Moroz 2d09a7e80f
[infra] Code Coverage latest report info to be picked up by CF (follow-up #1547). (#1781)
* [infra] Code Coverage latest report info to be picked up by CF (follow-up #1547).

* Remove unintentional change.

* Remove unnecessary empty lines.
2018-09-03 10:40:23 -07:00
Max Moroz 733c896ce5
[infra] Support extra coverage args in project.yaml (fix #1726, follow-up #1547). (#1774)
* [infra] Support extra coverage args in project.yaml (fix #1726, follow-up #1547).

* Update the documentation page.

* Fix review comments by Jonathan.
2018-08-30 09:46:14 -07:00
Max Moroz c5a9204ae7
[infra] Code Coverage: copy /usr/include headers and upload logs to GCS (follow-up #1547). (#1764) 2018-08-27 08:25:29 -07:00
Max Moroz 1bc9bb0b65
[infra] Update build_status to support two build types + cleanup (#1743, #1547). (#1758)
* [infra] Update build_status to support two build types + cleanup (#1743, #1547).

* Minor fixes.

* Remove default value for status_filename argument.
2018-08-27 06:46:17 -07:00
Max Moroz 23a04ab280
[infra] Use 'coverage' and 'fuzzing' tags to filter builds (follow-up #1547). (#1751)
* [infra] Use 'coverage' and 'fuzzing' tags to filter builds (follow-up #1547).

* Remove unintentional print call.

* Remove a variable that is not used anympre.
2018-08-23 19:14:09 -07:00
Max Moroz 7c476809f3
[infra] Skip code coverage job for projects that are disabled (#1743, #1547). (#1745)
* [infra] Skip code coverage job for projects that are disabled.

* Remove unintentional change.

* Address review feedback.
2018-08-22 14:14:02 -07:00
Max Moroz 204110f6bb
[infra] Skip coverage job for projects w/o fuzz targets (fix #1743, follow-up #1547). (#1744)
* [infra] Skip coverage job for projects w/o fuzz targets (fix #1743, follow-up #1547).

* Use build_id=0 and a more generic message.
2018-08-22 08:55:59 -07:00
Max Moroz e4d8b665f5 [infra] Add missing targets_list_filename calculation in build_project.py (follow-up #1547). 2018-08-20 12:29:35 -07:00
Max Moroz 113274a890 [infra] Fix check for qualified target name: include "_" (follow-up #1547). 2018-08-20 10:35:10 -07:00
Max Moroz ab17c5f915 [infra] Do not mark coverage job as failed when there are no targets list (follow-up for #1547). 2018-08-20 10:26:27 -07:00
Max Moroz 696c46cedd [infra] Use correct directory name for coverage jobs (follow-up for #1738). 2018-08-20 07:22:24 -07:00
Max Moroz 903c07ae69
[infra] Set up project dir for coverage job properly. (#1738)
* [infra] Set up project dir for coverage job properly.

* Fix weird typo.
2018-08-20 07:15:54 -07:00
Max Moroz 4574ff8bdb
[infra] Add the build configuration and other pieces for clang code coverage. (#1547)
* [infra] Add the build configuration and other pieces for clang code coverage.

* Address the initial feedback, still a draft with some pieces missing.

* Trying to test things locally.

* Work in progress, now able to test the build process.

* Rebase and fix a comment.

* Figure out how to upload report, but still have issues with GCS access.

* Remove unnecessary debug prints.

* WIP: adding targets list reading + minor clean up.

* WIP

* WIP: now it works end to end but is very dirty and has limitations.

* WIP: use rsync -r -d to overwrite older reports (if any)

* WIP: trying to use a helper script for bulk corpus download.

* WIP: download corpus in batches passed via args.

* WIP: testing corpus downloading in batches.

* WIP: woohoo, now it works!

* Some cleanup for a high level review.

* Address review comments and add FAQ entry.

* Update FAQ.md as per comments by Oliver.
2018-08-20 06:42:45 -07:00
Max Moroz dbe2731d93
[infra] Print logs URL for base images and msan libs. (#1666) 2018-07-27 10:07:54 -07:00
Oliver Chang 180c87f194 gcb: add env to targets_list step 2018-07-27 15:34:24 +10:00
Oliver Chang bf75778262 pyformat python code in gcb dir. 2018-07-27 13:32:39 +10:00
Oliver Chang 60fb6a8d7b
Generate and upload targets list during build. (#1660) 2018-07-27 13:29:51 +10:00
Abhishek Arya c328ff7518
Speculative fix for firefox build fix. (#1661)
* Speculative fix for firefox build fix.

* Use a yaml attribute.
2018-07-26 19:49:56 -07:00
Oliver Chang 2920beb131 Freeze gcb requirements. 2018-06-01 11:48:42 +10:00
Oliver Chang 5d11b552e8
Update requirements.txt 2018-06-01 11:30:50 +10:00
Oliver Chang d9470966b8
Update builds_status.py 2018-05-30 18:40:19 +10:00
Oliver Chang 24aaf6015a
Update builds_status.py 2018-05-30 18:34:57 +10:00
Max Moroz 69ffa9bfdf
[infra] Invoke run_fuzzer from bad_build_check for regression testing (fixes #1355). (#1357)
* [infra] Invoke run_fuzzer from bad_build_check for regression testing (fixes #1355).

* Address review comments.
2018-04-26 07:17:44 -07:00
Max Moroz 4df2262466
[infra] Enable bad build checks once again. (#838)
* [infra] Enable bad build checks once again.

* Minor typo.

* [bad_example] Update build flags for reproducing bad instrumentation scenario.

* [bad_example] split bad/no instrumentation case into two different ones.

* Use new approach for partial instrumentation detection + do that only for libFuzzer.

* Rename bad_example_bad_instrumentation into bad_example_partial_instrumentation.

* Calculate number of broken targets and fail if 10+% are broken.

* Multiprocess madness.

* Always run all checks and store all errors + clean up the code and add comments

* Add special handling for the projects with very small fuzz targets.

* Remove unnecessary semicolon.

* Address review comments.

* Address more review comments, small refactoring.
2018-04-17 09:31:53 -07:00
Kevin Lubick 33bc7ae7e2 Add timezone and mouseover to build-status page (#1235)
* Add timezone and mouseover to build-status page
2018-03-12 13:25:29 -07:00
Oliver Chang b86f335e6c fix pixman msan blacklist. 2018-02-27 15:35:41 +11:00