Commit Graph

4472 Commits

Author SHA1 Message Date
Evgeny Vereshchagin ec269ac72f
CIFuzz: switch to systemd-detect-virt to detect docker (#4101)
Closes https://github.com/google/oss-fuzz/issues/4093
2020-07-09 12:51:34 -07:00
kabeer27 bbb5d82fc9
Test fix pip installs (#4099) 2020-07-09 11:13:30 -07:00
Oliver Chang 662260da6e
bisector: try older commits if old_commit has the same result as new_commit (#4096) 2020-07-09 20:04:13 +10:00
jonvolfson 9c5d905646
Dockerfile and build.sh modifications to get successful build (#4025)
* Add spanner emulator project

* Adding auto_css for Sneha and myself

* Adding dockerfile and build.sh files

* Further fixes for OSS-Fuzz integration

* Update build.sh

* Cleaning up commented code in build.sh

* Fuzzing branch merged with main in the emulator repo, modified dockerfile to clone main now instead of the branch.

* Updating build.sh to copy the binaries to out

* Cleaning up build.sh by removing Envoy specific comments, removed dictionary code as no corpus exists yet

* Updating yaml to include the memory sanitizer

* Build.sh should now copy fuzzing binaries properly to , adding fuzzing_enginers parameter to yaml to bypass AFL timeout for now.

Co-authored-by: Jonathan Volfson <volfson@google.com>
Co-authored-by: Oliver Chang <oliverchang@users.noreply.github.com>
2020-07-08 14:41:15 -07:00
Ebrahim Byagowi 5735c8b723
[harfbuzz] Enable testing of experimental APIs also (#4090) 2020-07-08 11:57:35 -07:00
kabeer27 600c514958
Renaming schedule variable to builds_per_day for new feature (#4091)
* Renaming schedule variable to builds_per_day for new feature

* Minor formatting change

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-08 17:19:59 +10:00
kabeer27 0a712bb5d4
Base image builder (#4080)
* Base image builder

* Forgot to run formatter

* Fixing lint issues and removing unused imports

* Adding missing newline

* Refactoring code

* Fixing linting errors and changing name of cloud function entry

* Adding license header to build_base_images

* Changed logging and print_function

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-08 14:16:01 +10:00
kabeer27 277886dee9
Resetting emulators (#4079)
* Resetting datastore emulator

* Resetting datastore emulator

* setUp class

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-08 11:41:54 +10:00
Michael Jezierny c8279e2c2d
[openexr] Initial integration of OpenEXR fuzzers. (#4060)
* Add a working skeleton for OpenEXR fuzzers.

* added openexr fuzzers, updated build script to include them

* cleaned up bash loop

* replace "/work" with  in build.sh

* Reformat CMake settings, and also prevent building utils and examples.

* Reformat and change names in build.sh.

* Omit the version prefix when building OpenEXR and IlmBase libraries.

* Correct the contact addresses for OpenEXR.

Co-authored-by: Ravi Jotwani <rjotwani@google.com>
2020-07-07 14:28:37 -07:00
Ebrahim Byagowi 2c664877af
[harfbuzz] Use meson port (#4076)
* [harfbuzz] Use meson port

* [harfbuzz] workaround single quotes in fuzzer_ldflags
2020-07-07 14:27:40 -07:00
Ravi Jotwani 930720f048
[flac] Additional fuzzer (#4073)
* added draco integration files

* wrote build file and Dockerfile for Draco

* added new fuzzer, build failing

* fuzzer_exo build working
2020-07-07 13:24:02 -07:00
Max Moroz bc2ae2ba51
[docs] Add FAQ entry regarding forked repos + bump the bundler version. (#4078)
* [docs] Add FAQ entry regarding forked repos + bump the bundler version.

* format
2020-07-07 09:22:05 -07:00
Randy 0c21b09b36
[miniz] add Dockerfile, build.sh (#4085)
* [miniz] add Dockerfile, build.sh

* [miniz] update Dockerfile
2020-07-07 08:31:39 -07:00
Abhishek Arya 811add4dbf
Don't traverse symlinks in patch_build.py (#4086)
Should fix https://github.com/google/oss-fuzz/issues/4003
2020-07-07 08:11:23 -07:00
Guido Vranken 11a0f516cd
[cryptofuzz] Build script updates (#4072)
* [cryptofuzz] Build script updates

- Update mbed TLS repository location
- mbed TLS: Enable components disabled by default
- wolfCrypt: Build AES key wrap ciphers

* [cryptofuzz] Add Marina Polubelovam to CC list
2020-07-06 13:53:50 -07:00
Catena cyber ecc80ba613
[ndpi] excludes builds artifacts from ndpi project (#4077) 2020-07-06 13:35:00 -07:00
devtty1er d561c49ae5
Update Dockerfiles (#4070)
* Use LABEL in place of MAINTAINER

* Remove LABEL maintainer from Dockerfiles
2020-07-06 13:18:23 -07:00
Abhishek Arya b74211ecf9
Skip coverage build in CI for non C/C++ projects. (#4075)
* Skip coverage build in CI for non C/C++ projects.

Fixes https://github.com/google/oss-fuzz/issues/4074

* Test wasmtime.
2020-07-06 13:13:02 -07:00
Nick Fitzgerald 82252c22ef
wasmtime: Only zip the seed corpus if it exists (#4065)
This will prevent build failures like
https://oss-fuzz-build-logs.storage.googleapis.com/log-5a0b58fe-4a35-46d5-b4d2-221905e7d208.txt
in the future.
2020-07-06 10:46:47 -07:00
asraa ba72f0b7fc
fixup coverage build (#4071)
Signed-off-by: Asra Ali <asraa@google.com>
2020-07-06 10:14:53 -07:00
rbehjati 88c5e76798
Update the build script for project oak to disable it temporarily (#4068) 2020-07-06 07:59:44 -07:00
Abhishek Arya a966c122ec
Fix sentencepience build failure 2020-07-06 07:53:15 -07:00
kabeer27 e49a126000
Feature addition: Individual schedulers for projects (#4066)
This PR, integrates the new feature that allows users to specify their own schedules via project.yaml.
Parameter 'schedule : value' will dictate how many times a day should the project be built, i.e if value = 2
Then project will be built twice a day starting at 6 and interval 24/2 = 12 so 6:00 and 18:00
if parameter is unavailable DEFAULT_SCHEDULE = '0 6 * * *' i.e 6:00 will be used.

The cloud functions creates individual scheduler jobs for each project, with the name project_name + '-scheduler', and subscribes it to the topic 'request_build' with payload message 'project_name' which will be used by the next cloud function to request build for this project.

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-06 17:52:24 +10:00
Robert Löhning 2264f7915f
[qt] Don't clone AFL (#4067)
Now that stable caught up with master, we
can use the clone from base-builder image.
2020-07-05 08:30:57 -07:00
Randy 3c7ab8e850
[libspng] extract zlib to separate directory (#4064)
CIFuzz is overwriting $SRC/libspng after executing the Dockerfile before running build.sh which means $SRC/libspng/zlib is lost:
https://github.com/randy408/libspng/runs/830380355#step:4:549
2020-07-02 19:00:39 -07:00
Evgeny Vereshchagin 7667c8fe08
[util-linux] move the fuzz target to the OSS-Fuzz repository (#4063) 2020-07-01 19:37:07 -07:00
Teju Nareddy f8c7f158f7
[ESPv2] Attempt to fix coverage build (#4062)
Currently, coverage builds fail on step 3 with:
```
Step #3: + rsync -avLkR --include '*.h' --include '*.cc' --include '*.hpp' --include '*.cpp' --include '*.c' --include '*/' --exclude '*' /tmp /workspace/out/coverage
Step #3: sending incremental file list
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_build.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_dns.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_rules.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/ares/include/ares_version.h"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/include/sha1.c"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/include/gcm_nohw.c"
Step #3: symlink has no referent: "/tmp/tmp.BOH6TAB62E/include/digests.c"
...
```

Just exclude these files. Doubt they matter to us.

Ref: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=23621&q=esp-v2&can=2
Signed-off-by: Teju Nareddy <nareddyt@google.com>
2020-07-01 16:56:39 -07:00
Dmitry Vyukov fa5b4dbd9a
[syzkaller] update go get invocation and fix the build (#3754)
* syzkaller: update go get invocation

The way to checkout the repo has changed.
Fixes: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=21994

* [syzkalle] Fix paths passed to `compile_fuzzer` function.

Co-authored-by: Max Moroz <mmoroz@chromium.org>
2020-07-01 15:04:40 -07:00
werdnaH df0ea93918
Add SkSVGCanvas api Fuzzer (#4061)
* add svg api fuzzer

* fixed build.sh

Co-authored-by: Zepeng Hu <zepenghu@google.com>
2020-07-01 14:59:11 -07:00
Randy 584b967a69
[libspng] Fetch zlib in Dockerfile (#4050)
* [libspng] Fetch zlib in Dockerfile

This step has been moved from the build script: c35e509f04

* Update Dockerfile

* Update Dockerfile

* dummy commit

* Update Dockerfile

* dummy commit

* dummy commit
2020-07-01 11:00:08 -07:00
kabeer27 09c7ea778b
Added deploy file and restructured cloud function directory (#4057)
* Adding deploy.sh and restructuring directory

* Integrating review changes

* Passed project id as an argument to each command

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-07-01 16:13:08 +10:00
asraa 468f932b7d
[envoy] lower CPU more (#4056)
* try

Signed-off-by: Asra Ali <asraa@google.com>

* fix build

Signed-off-by: Asra Ali <asraa@google.com>

* fix script

Signed-off-by: Asra Ali <asraa@google.com>

* use HOST_CPU*0.5

Signed-off-by: Asra Ali <asraa@google.com>
2020-06-30 15:45:08 -07:00
Luca Boccassi 0a7380a80a
[libzmq] use build script from upstream repository (#4054)
* libzmq: use build script from upstream repository

In order to avoid having to send PRs every time we change something, simply
maintain the build script in the upstream repository, and change build.sh
to a one-line call.

* libzmq: clone corpora and dictionary repository
2020-06-30 13:22:33 -07:00
Max Moroz 05063afd88
Revert "Don't create empty corpus archive as it wont unpack. (#3903)" (#4048)
This reverts commit cb156403e9.
2020-06-30 13:03:44 -07:00
rbehjati c1404e9b62
[oak] Temporarily disable fuzzing for project Oak (#4053) 2020-06-30 11:38:36 -07:00
Nikita Popov 26af5e0e25
[php] Enable unserializehash fuzzer (#4049) 2020-06-30 09:54:25 -07:00
asraa d4b88fc4e1
[envoy] envoy build resource adjustment (#4052)
Signed-off-by: Asra Ali <asraa@google.com>
2020-06-30 09:52:22 -07:00
Abhishek Arya a31e58fb5c
Fix build due to missing liblzma-dev 2020-06-29 21:52:08 -07:00
Danny Halawi 8b6899cfb9
Fixing Dockerfile for fuzzers that use LPM (#4044)
* fixing Dockerfile for libpng-proto

* Fixing Dockerfile so the LPM for giflib works

* Fixing Dockerfile so the LPM for xerces-c works

* taking out unneeded installations

Co-authored-by: Danny Halawi <dhalawi@google.com>
2020-06-29 21:48:37 -07:00
Google AutoFuzz Team 1f9ec264a8
Add sentencepiece (#4035)
* add sentencepiece project

* change the architectures

* change indentations
2020-06-29 12:45:50 -07:00
Robert Löhning 7da55877b6
[qt] Move build.sh to own repository (#4042) 2020-06-29 12:43:17 -07:00
kabeer27 d15dc2a88f
Renaming infra/build/functions files (#4031)
Renamed main.py to sync.py
and test_sync.py to sync_test.py

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-06-29 11:10:47 +10:00
binaryFate eaae983c73
Monero: fix coverage, don't enable asan, add new fuzz test (#4040)
Co-authored-by: binaryFate <binaryfate@users.noreply.github.com>
2020-06-27 15:42:29 -07:00
Abhishek Arya c2df30abb5
Update project.yaml 2020-06-26 20:31:54 -07:00
pierwill cd9ee7ca4c
Add influxdb project for review (#4028)
Co-authored-by: pierwill <pierwill@users.noreply.github.com>
2020-06-26 11:36:10 -07:00
Abhishek Arya ff4f38e772
Fix memory leak in libevent parse_query_fuzzer 2020-06-25 19:39:14 -07:00
Nathan Moinvaziri e32b716754
Added fuzzer for c-blosc2 (#3989) 2020-06-25 16:56:26 -07:00
Evgeny Vereshchagin 25cff8db8e
[util-linux] cover mnt_table_parse_stream (#4032)
* [util-linux] cover mnt_table_parse_stream

Waiting for https://github.com/karelzak/util-linux/pull/1068

* temporarily point OSS-Fuzz to evverx/util-linux

* make sure it can be built with sanitizer=coverage
2020-06-25 15:35:44 -07:00
Ravi Jotwani f8c9eec4cf
E2fsprogs integration (#4006)
* added draco integration files

* wrote build file and Dockerfile for Draco

* split security-research-pocs fuzzer into four

* added project build to build.sh

* added more fuzzers

* fixed sanitizer flags

* removed commented code, combined fuzzers, fized build script

* changed to singular filenames, converted usage of random int to enum, changed buffer name, and fixed build script

* placed test files in memory instead of on disk, added asserts
2020-06-25 11:42:17 -07:00
kabeer27 181812050d
Cloud function for syncing OSS-Fuzz projects (#3538). (#4023)
Integrating the first cloud function i implemented which syncs the project list from github and uploads the list to cloud datastore, which will be used by another cloud function to request builds.

Co-authored-by: Kabeer Seth <kabeerseth@google.com>
2020-06-25 13:41:04 +10:00