Commit Graph

168 Commits

Author SHA1 Message Date
Abhishek Arya 3afd1707bf
Remove unused MSan and UBSan from Honggfuzz configurations. (#3667) 2020-04-17 12:12:06 -07:00
Max Moroz 8ed2f7af34
[infra] Improve srcmap support for Go projects (#3355, #2714). (#3664)
* [infra] Improve srcmap support for Go projects (#3355, #2714).

* address review feedback
2020-04-16 22:44:01 -07:00
Max Moroz e3bb988d8a
[infra] Add build retry logic inside wait_for_build.py (#419). (#3585)
* [infra] Add build retry logic inside wait_for_build.py (#419).

* typo

* address comments by Oliver
2020-04-06 18:58:09 -07:00
Max Moroz 130710d518
[infra] Change language attribute from "cpp" to "c++" in build scripts. (#3493)
* [infra] Change language attribute from "cpp" to "c++" in coverage job runner.

Should've done this in https://github.com/google/oss-fuzz/pull/3477. Good news is that nothing failed, the coverage job was just skipped for pretty much all projects.

* also remove default value from build_project script
2020-03-12 09:06:46 -07:00
Max Moroz dd5ad3b20e
[infra] Loose the limits for dataflow traces collection (#1632). (#3411)
* [infra] Loose the limits for dataflow traces collection (#1632).

* format
2020-02-19 16:40:23 -08:00
Max Moroz 6cd7db7758
[infra] GSB: ignore failing "gsutil rm -rf" step. (#3412) 2020-02-19 10:43:21 -08:00
Max Moroz a0ade7d8e5
[infra] Perform "gsutil rm -rf" if we need to overwrite coverage data. (#3404)
* [infra] Perform "gsutil rm -rf" if we need to overwrite coverage data.

* format
2020-02-18 09:25:16 -08:00
Max Moroz 6e8232078a
[infra] Use wildcard in gsutil cp command as it lacks -T option. (#3396) 2020-02-14 13:23:20 -08:00
Max Moroz dfaf951f35
[infra] Upload latest.version metadata file for most recent build. (#3379)
* [infra] Upload latest.version metadata file for most recent build.

* move common functionality into build_lib

* pass content_type to get_signed_url

* format
2020-02-13 07:31:12 -08:00
Max Moroz 4092bebcb5
[infra] Fix broken batching in the corpora download helper (#3351). (#3353)
* [infra] Fix broken batching in the corpora download helper (#3351).

* one more
2020-02-06 15:44:36 -08:00
Max Moroz 8d3d290c61
[infra] Generate full coverage JSONs for dataflow enabled targets (#1632). (#3325) 2020-02-04 17:42:25 -08:00
Max Moroz 7751ab5a87
[infra] Introduce "language" attribute in the project.yaml (#3297). (#3299)
* [infra] Introduce "language" attribute in the project.yaml (#3297).

* follow up

* enable the attribute for more projects

* trailing newline
2020-01-30 15:36:44 -08:00
Max Moroz 5dd3f4cebe
[infra] Add env variable to the DF collection GCB step (#1632). (#3250)
* [infra] Add env variable to the DF collection GCB step (#1632).

* format
2020-01-17 13:06:27 -08:00
Max Moroz f6002f6139
[infra] Collect dataflow traces on the builder (#1632). (#3238)
* [infra] Skeleton of the changes needed for collecting DFT on the builder (#1632).

* move ENGINE_INFO to the helper as well

* make collect_dft +x

* syntax fixes

* add actual dataflow tracer script

* format

* more refactoring and cleanup

* format

* address Oliver's feedback

* format

* more fixes

* format

* do not redirect stderr to stdout

* add exit at the end of main

* address feedback from Oliver
2020-01-17 06:24:15 -08:00
Max Moroz 3a9d7381e7
[infra] Print exact reproduction commands in build failures (#3104). (#3236)
* [infra] Print exact reproduction commands in build failures (#3104).

* syntax fixes

* remove redundant &&

* fix a typo

* use named arguments in format strings

* format
2020-01-15 14:12:22 -08:00
Oliver Chang 08c7c706bf
Build honggfuzz by default. (#3228) 2020-01-14 12:35:31 +11:00
Max Moroz 12b5811ad0
[infra] Add parens to ensure correct execution order (#3104). (#3213) 2020-01-09 10:34:08 -08:00
Max Moroz cfe13cb116
[infra] Print additional information for build/coverage failures on GCB (#3104). (#3208)
* [infra] Explicily print failing build config in the GCB log (#3104).

* add trailing "false" command + add a message for misisng coprus backups in code coverage build

* improve the coverage message and behavior

* fix exit command

* use .format() for a single argument format string too

* fix typo
2020-01-09 09:41:58 -08:00
Max Moroz 1463a2c523
[infra] Do not skip coverage build if there is no build.sh file (#3185). (#3189) 2020-01-06 07:45:45 -08:00
Max Moroz 3dd03528b7
[infra] Use more generic approach to skip code coverage for Go projects. (#2953)
* [infra] Use more generic approach to skip code coverage for Go projects.

* address review comments
2019-10-16 07:35:22 -07:00
Max Moroz ccfb73427f
[infra] Skip code coverage job for gofuzz projects (#2714). (#2818) 2019-09-09 08:47:58 -07:00
Abhishek Arya e4bcc79247
Update builds_status.py 2019-08-23 13:44:21 -07:00
Abhishek Arya 32dd91bc40
Create storage client only once for build status updates. (#2756)
Should fix https://github.com/google/oss-fuzz/issues/2755.
2019-08-23 13:43:10 -07:00
Oliver Chang 018d80ed71
Fix build links on builds status page. (#2732)
Setting routeData does not work if there is no existing route set.

Also fix deploy to not cache files.
2019-08-21 11:36:18 +10:00
Ammar Askar 92d5ba8f9e [infra] Allow perma-links to project logs. Fixes #2690 (#2725) 2019-08-20 16:40:56 -07:00
jonathanmetzman c4202c2f48
Revert "Use "x86" instead of "i386" for better name recognition. (#2685)" (#2687)
This reverts commit 0c6cc5cae8.
2019-08-12 10:54:18 -07:00
jonathanmetzman 0c6cc5cae8
Use "x86" instead of "i386" for better name recognition. (#2685)
It seems more people understand x86 than i386, use this term instead.
2019-08-12 10:35:16 -07:00
Abhishek Arya 6dd54f6381
Fix exception in updating badges on build status page 2019-08-12 09:39:42 -07:00
Ammar Askar 8776ec2327 [infra] Publish build badges on status page (#2513)
* [infra] Publish build badges on status page

* Address feedback from github PR

* Change success badge to 'fuzzing' and failing badge to 'build failing'
2019-08-12 09:25:22 -07:00
Max Moroz 12d6d31e44
[infra] Use gsutil "cp" instead of "rsync" for coverage job (#2585). (#2625) 2019-07-23 10:12:37 -07:00
Max Moroz 7250d70833
[infra] Run tests on the builder after patching MSan libraries. (#2497)
* [WORK IN PROGRESS] Debug Travis failure when doing build check for MSan build.

* Change order of "MSan patch libraries" and "build check" steps.
2019-06-10 11:18:59 -07:00
jonathanmetzman bdd9519f44
[i386] Use different bucket for i386 builds. (#2435) 2019-05-17 12:47:11 -07:00
jonathanmetzman 7073fb976c
[i386] Do i386 builds of projects that have opted-in (#2416) 2019-05-15 14:00:57 -07:00
jonathanmetzman 3976a002af
[i386] Improve linking and bad build check (#2410)
Improve linking by copying i386 libs instead of adding `-L` to `CXXFLAGS`
Get bad_build_check working for i386 binaries and add architecture check.
2019-05-14 10:18:02 -07:00
Abhishek Arya 047eb4be4f
Update requirements.txt 2019-05-02 07:26:36 -07:00
Max Moroz 946d0603ba
[infra] Enabling DataFlow build configuration (#1632). (#2292)
* [infra] Enabling DataFlow build configuration (#1632).

* Copy all data flow scripts from the libFuzzer repo.
2019-04-09 07:25:14 -07:00
Oliver Chang 23a5f44b29
Address comments from https://github.com/google/oss-fuzz/pull/2285. (#2287) 2019-04-03 15:29:23 +11:00
Oliver Chang 994900ab47
Fix builds status script (#2285)
Get a batch of the last 2000 builds, and filter on those ourselves
instead of calling the cloudbuild API to filter for us. The cloudbuild
API filtering API does not work with our number of builds.

Fixes #2263
2019-04-02 12:00:55 +08:00
Oliver Chang 7bf55a11df
Use a single tag for builds. (#2284)
Filtering on multiple tags doesn't seem to work.
2019-04-02 08:19:58 +08:00
Max Moroz 497cd398d0 [infra] Fix code coverage builder script (regressed after #2264). 2019-03-31 11:33:07 -07:00
Oliver Chang aa231dc801
Add a project tag to builds for filtering (#2263). (#2264) 2019-03-26 17:02:05 +11:00
Oliver Chang 66008885e9
Remove image pushing step from build (#2232)
They aren't used and pushing them appears to be flaky.
2019-03-13 09:48:12 +11:00
Max Moroz 322b86a848 [infra] Disable honggfuzz builds by default (follow up for #2227). 2019-03-12 14:56:09 -07:00
Max Moroz 65037d2ea8
[infra] Bump build timeout from 10h to 12h. (#2227) 2019-03-11 07:38:14 -07:00
Oliver Chang 3d662e1bec
Add support for tags field in project.yaml (#1974) (#1980)
* Add support for tags field in project.yaml (#1974)

Also add "sundew" label to libxml2_xml_reader_for_file_fuzzer.

These add additional labels in filed bugs.
2018-11-27 16:46:26 +11:00
Abhishek Arya d29c322809
Revert "Update requests version 2.2.0" (#1921)
* Revert "Update requests version (#1913)"

This reverts commit 96fce46d4a.
2018-11-03 07:40:30 -07:00
jonathanmetzman 96fce46d4a
Update requests version (#1913) 2018-10-30 13:16:15 -07:00
Max Moroz fdd28c42e9
[infra] Add srcmap step to code coverage job (follow-up #1547). (#1868) 2018-10-11 13:52:49 -07:00
Abhishek Arya 4afcfab869
Revert "[infra] Remove srcmap related commands from gcb script (follow-up #1839)." (#1848)
This reverts commit f132eaf19c.
2018-10-01 22:34:05 -07:00
Max Moroz f132eaf19c [infra] Remove srcmap related commands from gcb script (follow-up #1839). 2018-10-01 08:02:38 -07:00