Commit Graph

4488 Commits

Author SHA1 Message Date
Abhishek Arya 55a4e1d88a
Add CIFuzz documentation on how to run jobs on certain branches, paths (#4113) 2020-07-13 14:50:16 -07:00
Gabriel Rasskin 7b9a3a895c
[tensorflow] Add assert compilation flag (#4119) 2020-07-13 13:41:19 -07:00
Max Moroz 820e252dfa
[infra] Fix a typo in collect_dft bash script. 2020-07-13 10:19:57 -07:00
Max Moroz 2fe0d878ae
Revert "Refactoring gcb libraries for external use by Cloud functions (#4103)" (#4117)
This reverts commit 9ed73c1cd7.
2020-07-13 09:47:11 -07:00
kabeer27 9ed73c1cd7
Refactoring gcb libraries for external use by Cloud functions (#4103)
* Refactoring gcb libraries for external use

* Few changes done, a couple more left

* Fixed linting/formatting issues + other changes requested

* Fixing import order

* Fixing import order

* license header change

* Undo

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-13 14:45:39 +10:00
kabeer27 9413d10e08
[Sync cloud function] Cache file contents (#4104)
* Storing contents of project.yaml and dockerfile, to reduce api calls

* Fixing comment indentation

* Requested changes

* Minor changes

* Importing projectmetadata

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-13 14:21:56 +10:00
neildhar 83451151b4
Pass a flag to enable fuzzing (#4114) 2020-07-11 09:59:06 -07:00
werdnaH c8a9c08c09
[Skia] Add SkRuntimeEffect Fuzzer (#4108)
* Add SkRuntimeEffect Fuzzer

* fixed typo

* fixed the zip name

* fixed zip name

* fixed zip name

Co-authored-by: Zepeng Hu <zepenghu@google.com>
2020-07-10 19:26:35 -07:00
Ravi Jotwani 07fbdfb29b
[lcms] Add new fuzzer (#4109)
* added new cms_transform_fuzzer, getting code instrumentation error

* build working, renamed new fuzzer
2020-07-10 19:26:12 -07:00
Alex Crichton cd665e2a82
Add wasm-tools repository to wasmtime project (#4111)
* Add wasm-tools repository to wasmtime project

This commit expands the fuzzers run under the Wasmtime project to
include those in the https://github.com/bytecodealliance/wasm-tools
repository. This includes various parsing for utilities used by Wasmtime
itself but also generally useful for other Rust projects! The
maintainers of the wasm-tools repository are also all currently all on
the notification list for Wasmtime fuzz bugs as well.

* Load all corpuses from wasmtime-libfuzzer-corpus
2020-07-10 19:25:01 -07:00
Danny Halawi 58e519a8f2
[jsoncpp] Integrate json protocol buffer and libprotobuf-mutator to fuzz jsoncpp (#4047)
* fixing Dockerfile for libpng-proto

* adding json proto, LPM, and fuzz target for jsoncpp

* adding vanilla fuzzer back in

* fixing weird spacing in build script + taking out unneedef header file

* adding settings field and passing all of json_str

* adding license headers

* refactoring settings field

* fixing compile issue

* fixing MSan issue, changing license to 2020, and using iterator instead of pointers

* passing pointers more understandably to parse

* taking out unecessary assign

Co-authored-by: Danny Halawi <dhalawi@google.com>
2020-07-10 17:17:32 -07:00
Max Moroz 33295d69f7
[infra] Do not pass empty port value to docker. (#4110) 2020-07-10 15:49:46 -07:00
Max Moroz 47484451d5
[infra] Build honggfuzz with -D_HF_LINUX_NO_BFD (#3886). (#4107)
* [infra] Build honggfuzz with -D_HF_LINUX_NO_BFD (#3886).

* dummy edit to trigger CI
2020-07-10 14:50:39 -07:00
kabeer27 2201c8f46c
Missing hyphen (#4106)
* Missing hyphen

* Testing infra-tests

* Testing ingra-tests

* Testing infra-tests

* Undoing license header changes

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-10 05:55:36 -07:00
Evgeny Vereshchagin c22a5b6db9
utils: ignore subprocess-run-check (#4102)
"check" is omitted intentionally there.

A follow-up to https://github.com/google/oss-fuzz/pull/4101
2020-07-09 14:18:21 -07:00
Oliver Chang 2816e8729c
Fix infra tests. (#4097) 2020-07-10 07:00:02 +10:00
Evgeny Vereshchagin ec269ac72f
CIFuzz: switch to systemd-detect-virt to detect docker (#4101)
Closes https://github.com/google/oss-fuzz/issues/4093
2020-07-09 12:51:34 -07:00
kabeer27 bbb5d82fc9
Test fix pip installs (#4099) 2020-07-09 11:13:30 -07:00
Oliver Chang 662260da6e
bisector: try older commits if old_commit has the same result as new_commit (#4096) 2020-07-09 20:04:13 +10:00
jonvolfson 9c5d905646
Dockerfile and build.sh modifications to get successful build (#4025)
* Add spanner emulator project

* Adding auto_css for Sneha and myself

* Adding dockerfile and build.sh files

* Further fixes for OSS-Fuzz integration

* Update build.sh

* Cleaning up commented code in build.sh

* Fuzzing branch merged with main in the emulator repo, modified dockerfile to clone main now instead of the branch.

* Updating build.sh to copy the binaries to out

* Cleaning up build.sh by removing Envoy specific comments, removed dictionary code as no corpus exists yet

* Updating yaml to include the memory sanitizer

* Build.sh should now copy fuzzing binaries properly to , adding fuzzing_enginers parameter to yaml to bypass AFL timeout for now.

Co-authored-by: Jonathan Volfson <volfson@google.com>
Co-authored-by: Oliver Chang <oliverchang@users.noreply.github.com>
2020-07-08 14:41:15 -07:00
Ebrahim Byagowi 5735c8b723
[harfbuzz] Enable testing of experimental APIs also (#4090) 2020-07-08 11:57:35 -07:00
kabeer27 600c514958
Renaming schedule variable to builds_per_day for new feature (#4091)
* Renaming schedule variable to builds_per_day for new feature

* Minor formatting change

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-08 17:19:59 +10:00
kabeer27 0a712bb5d4
Base image builder (#4080)
* Base image builder

* Forgot to run formatter

* Fixing lint issues and removing unused imports

* Adding missing newline

* Refactoring code

* Fixing linting errors and changing name of cloud function entry

* Adding license header to build_base_images

* Changed logging and print_function

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-08 14:16:01 +10:00
kabeer27 277886dee9
Resetting emulators (#4079)
* Resetting datastore emulator

* Resetting datastore emulator

* setUp class

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-08 11:41:54 +10:00
Michael Jezierny c8279e2c2d
[openexr] Initial integration of OpenEXR fuzzers. (#4060)
* Add a working skeleton for OpenEXR fuzzers.

* added openexr fuzzers, updated build script to include them

* cleaned up bash loop

* replace "/work" with  in build.sh

* Reformat CMake settings, and also prevent building utils and examples.

* Reformat and change names in build.sh.

* Omit the version prefix when building OpenEXR and IlmBase libraries.

* Correct the contact addresses for OpenEXR.

Co-authored-by: Ravi Jotwani <rjotwani@google.com>
2020-07-07 14:28:37 -07:00
Ebrahim Byagowi 2c664877af
[harfbuzz] Use meson port (#4076)
* [harfbuzz] Use meson port

* [harfbuzz] workaround single quotes in fuzzer_ldflags
2020-07-07 14:27:40 -07:00
Ravi Jotwani 930720f048
[flac] Additional fuzzer (#4073)
* added draco integration files

* wrote build file and Dockerfile for Draco

* added new fuzzer, build failing

* fuzzer_exo build working
2020-07-07 13:24:02 -07:00
Max Moroz bc2ae2ba51
[docs] Add FAQ entry regarding forked repos + bump the bundler version. (#4078)
* [docs] Add FAQ entry regarding forked repos + bump the bundler version.

* format
2020-07-07 09:22:05 -07:00
Randy 0c21b09b36
[miniz] add Dockerfile, build.sh (#4085)
* [miniz] add Dockerfile, build.sh

* [miniz] update Dockerfile
2020-07-07 08:31:39 -07:00
Abhishek Arya 811add4dbf
Don't traverse symlinks in patch_build.py (#4086)
Should fix https://github.com/google/oss-fuzz/issues/4003
2020-07-07 08:11:23 -07:00
Guido Vranken 11a0f516cd
[cryptofuzz] Build script updates (#4072)
* [cryptofuzz] Build script updates

- Update mbed TLS repository location
- mbed TLS: Enable components disabled by default
- wolfCrypt: Build AES key wrap ciphers

* [cryptofuzz] Add Marina Polubelovam to CC list
2020-07-06 13:53:50 -07:00
Catena cyber ecc80ba613
[ndpi] excludes builds artifacts from ndpi project (#4077) 2020-07-06 13:35:00 -07:00
devtty1er d561c49ae5
Update Dockerfiles (#4070)
* Use LABEL in place of MAINTAINER

* Remove LABEL maintainer from Dockerfiles
2020-07-06 13:18:23 -07:00
Abhishek Arya b74211ecf9
Skip coverage build in CI for non C/C++ projects. (#4075)
* Skip coverage build in CI for non C/C++ projects.

Fixes https://github.com/google/oss-fuzz/issues/4074

* Test wasmtime.
2020-07-06 13:13:02 -07:00
Nick Fitzgerald 82252c22ef
wasmtime: Only zip the seed corpus if it exists (#4065)
This will prevent build failures like
https://oss-fuzz-build-logs.storage.googleapis.com/log-5a0b58fe-4a35-46d5-b4d2-221905e7d208.txt
in the future.
2020-07-06 10:46:47 -07:00
asraa ba72f0b7fc
fixup coverage build (#4071)
Signed-off-by: Asra Ali <asraa@google.com>
2020-07-06 10:14:53 -07:00
rbehjati 88c5e76798
Update the build script for project oak to disable it temporarily (#4068) 2020-07-06 07:59:44 -07:00
Abhishek Arya a966c122ec
Fix sentencepience build failure 2020-07-06 07:53:15 -07:00
kabeer27 e49a126000
Feature addition: Individual schedulers for projects (#4066)
This PR, integrates the new feature that allows users to specify their own schedules via project.yaml.
Parameter 'schedule : value' will dictate how many times a day should the project be built, i.e if value = 2
Then project will be built twice a day starting at 6 and interval 24/2 = 12 so 6:00 and 18:00
if parameter is unavailable DEFAULT_SCHEDULE = '0 6 * * *' i.e 6:00 will be used.

The cloud functions creates individual scheduler jobs for each project, with the name project_name + '-scheduler', and subscribes it to the topic 'request_build' with payload message 'project_name' which will be used by the next cloud function to request build for this project.

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-06 17:52:24 +10:00
Robert Löhning 2264f7915f
[qt] Don't clone AFL (#4067)
Now that stable caught up with master, we
can use the clone from base-builder image.
2020-07-05 08:30:57 -07:00
Randy 3c7ab8e850
[libspng] extract zlib to separate directory (#4064)
CIFuzz is overwriting $SRC/libspng after executing the Dockerfile before running build.sh which means $SRC/libspng/zlib is lost:
https://github.com/randy408/libspng/runs/830380355#step:4:549
2020-07-02 19:00:39 -07:00
Evgeny Vereshchagin 7667c8fe08
[util-linux] move the fuzz target to the OSS-Fuzz repository (#4063) 2020-07-01 19:37:07 -07:00
Teju Nareddy f8c7f158f7
[ESPv2] Attempt to fix coverage build (#4062)
Currently, coverage builds fail on step 3 with:
```
Step #3: + rsync -avLkR --include '*.h' --include '*.cc' --include '*.hpp' --include '*.cpp' --include '*.c' --include '*/' --exclude '*' /tmp /workspace/out/coverage
Step #3: sending incremental file list
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_build.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_dns.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_rules.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_version.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/include/sha1.c"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/include/gcm_nohw.c"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/include/digests.c"
...
```

Just exclude these files. Doubt they matter to us.

Ref: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=23621&q=esp-v2&can=2
Signed-off-by: Teju Nareddy <nareddyt@google.com>
2020-07-01 16:56:39 -07:00
Dmitry Vyukov fa5b4dbd9a
[syzkaller] update go get invocation and fix the build (#3754)
* syzkaller: update go get invocation

The way to checkout the repo has changed.
Fixes: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=21994

* [syzkalle] Fix paths passed to `compile_fuzzer` function.

Co-authored-by: Max Moroz <mmoroz@chromium.org>
2020-07-01 15:04:40 -07:00
werdnaH df0ea93918
Add SkSVGCanvas api Fuzzer (#4061)
* add svg api fuzzer

* fixed build.sh

Co-authored-by: Zepeng Hu <zepenghu@google.com>
2020-07-01 14:59:11 -07:00
Randy 584b967a69
[libspng] Fetch zlib in Dockerfile (#4050)
* [libspng] Fetch zlib in Dockerfile

This step has been moved from the build script: c35e509f04

* Update Dockerfile

* Update Dockerfile

* dummy commit

* Update Dockerfile

* dummy commit

* dummy commit
2020-07-01 11:00:08 -07:00
kabeer27 09c7ea778b
Added deploy file and restructured cloud function directory (#4057)
* Adding deploy.sh and restructuring directory

* Integrating review changes

* Passed project id as an argument to each command

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-01 16:13:08 +10:00
asraa 468f932b7d
[envoy] lower CPU more (#4056)
* try

Signed-off-by: Asra Ali <asraa@google.com>

* fix build

Signed-off-by: Asra Ali <asraa@google.com>

* fix script

Signed-off-by: Asra Ali <asraa@google.com>

* use HOST_CPU*0.5

Signed-off-by: Asra Ali <asraa@google.com>
2020-06-30 15:45:08 -07:00
Luca Boccassi 0a7380a80a
[libzmq] use build script from upstream repository (#4054)
* libzmq: use build script from upstream repository

In order to avoid having to send PRs every time we change something, simply
maintain the build script in the upstream repository, and change build.sh
to a one-line call.

* libzmq: clone corpora and dictionary repository
2020-06-30 13:22:33 -07:00
Max Moroz 05063afd88
Revert "Don't create empty corpus archive as it wont unpack. (#3903)" (#4048)
This reverts commit cb156403e9.
2020-06-30 13:03:44 -07:00