Commit Graph

4892 Commits

Author SHA1 Message Date
Abhishek Arya e7921e7795
Python fuzzing fixes - disable leak checking, remove flags in atheris. (#4681)
* Python fuzzing fixes - disable leak checking, remove flags in atheris.

* Fix flags printing.

* Dont export, use directly.

* Try unset.

* Unset flags when python was built.
2020-11-20 11:10:51 -08:00
Catena cyber c031d50ec9
[infra] Golang coverage summary for each fuzz target (#2817, #2714). (#4671)
* Golang coverage summary for each fuzz target

* Document usage of compile_go_fuzzer

* update the documentation change

Co-authored-by: Max Moroz <mmoroz@chromium.org>
2020-11-20 10:55:33 -08:00
jonathanmetzman ee7031c4a5
Fix permission denied errors on CI in unittests (#4664)
Also remove usrstcp from the repos we do tests since they no longer work with usrstcp (repo history seems to have been rewritten).
2020-11-20 10:39:19 -08:00
jonathanmetzman a28d03be6e
Build base-images before building projects in CI (#4679)
This will help us catch breaking changes to the base-images.
Unfortunately caching seems to fail here when I expect it to help. 
For example, base-builder doesn't build from cache when I do it locally.
This means that every other image I try to build doesn't use the cache. 
That means that base-clang would take forever to rebuild. 
So to compromise, I don't rebuild base-clang here.
This means that this PR won't catch breaking changes to base-image or base-clang that break in base-builder.
But it will catch breaking changes to base-image that break in base-runner and it will catch breaking changes to base-runner and base-builder.
2020-11-20 10:09:17 -08:00
jonathanmetzman 486c1c3e9d
[CI] Build a canary project on infra/ changes. (#4675)
[CI] Build a canary project on infra/ changes.

Build a specific project, sckms, that does msan, ubsan, asan, i386
builds quickly, when infra/ code is changed. This can let us know
when infra/ changes break proper functioning of OSS-Fuzz.
For this to work more thoroughly we also need to rebuild images.
2020-11-20 08:40:47 -08:00
Chris Fallin 5fdc24206e
wasmtime: add register allocator to fuzz targets. (#4669)
Wasmtime uses
[regalloc.rs](https://github.com/bytecodealliance/regalloc.rs), a
register allocator written in Rust that was developed for use in
Cranelift (but is also an independently-usable crate). While it will be
indirectly fuzzed by wasmtime itself once we start fuzzing the new
backends that use it, we should also fuzz it directly, since it exposes
targets just for this. The regalloc fuzzing makes use of a symbolic
checker as an oracle for allocation results, so should be relatively
high-quality. This PR enables the `bt` (backtracking) allocator's fuzz
target, as this is the default allocator.
2020-11-20 07:37:16 -08:00
jonathanmetzman 640a9c2bcf
Fix test_all breakage (#4673)
Specify fuzzing language.
Intended to fix https://github.com/google/oss-fuzz/issues/4672
2020-11-20 07:24:06 -08:00
Abhishek Arya 5e3f47dba6
Fix ujson python fuzzing. (#4667)
* Fix ujson python fuzzing.

* Fix.

* Improve integration.

* Remove preload, stick with wrapper with /bin/sh.

* Update build.sh
2020-11-19 22:41:12 -08:00
asraa e81d27e287
remove third_party (#4665)
Signed-off-by: Asra Ali <asraa@google.com>
2020-11-19 18:10:14 -08:00
Oliver Chang 5da57c9128
Fix requirements.txt for GCB functions. (#4670) 2020-11-20 12:07:09 +11:00
Max Moroz b97f6e296a
[infra] Allow coverage for Go project on GCB (#2817, #2714). (#4668) 2020-11-19 16:07:35 -08:00
Catena cyber 217175212b
[infra] Use generic compile_go_fuzzer for golang projects (#4659)
* Use generic compile_go_fuzzer for golang projects

* fix the copyright in the new script

Co-authored-by: Max Moroz <mmoroz@chromium.org>
2020-11-19 14:18:25 -08:00
Abhishek Arya 772d0efef5
Add missing ldconfig for shared lib path of python libs (#4663) 2020-11-19 10:43:21 -08:00
Abhishek Arya 98fa319760
Improve ujson build.sh to build fuzzers. (#4662)
Still ASAN lib preload is missing.
2020-11-19 10:35:53 -08:00
Abhishek Arya 38b7c5e162
Enable shared build for python deps, needed for pyinstaller (#4661) 2020-11-19 09:54:21 -08:00
mbarbella-chromium e36bb8f7c6
Initial support for ujson (as a Python fuzzing sample). (#4657)
* Initial support for ujson (as a Python fuzzing sample).

* Add python to supported languages.

* Fix TODO.

* Update presubmit to ignore python in projects.

* Format

* Remove explicit addition of -fsanitize=fuzzer-no-link

* Only fuzz using libFuzzer.

Co-authored-by: Martin Barbella <mbarbella@google.com>
2020-11-19 07:40:10 -08:00
DavidKorczynski d0824ca343
[Redis] update configuration (#4660)
CR: https://github.com/edenhill/librdkafka/pull/3151
2020-11-19 07:12:27 -08:00
Catena cyber 07ea81ba3e
[infra] Add code coverage report generation for Go projects (#3142)
* Golang coverage report

* Enables golang coverage report for gonids and go-dns

* Generates summary for golang coverage reports

* Performance profile for golang projects
2020-11-19 00:14:30 -08:00
Abhishek Arya 43f768df01
Add pyinstaller to experiment with python fuzzer packaging (#4658) 2020-11-18 16:42:26 -08:00
DavidKorczynski 07454dc5d9
[leveldb] initial integration (#4636)
* initial integration of leveldb

* leveldb: fix build.

* leveldb: Added a remaining on API call.

* leveldb: update project to fit review.
2020-11-18 15:21:23 -08:00
Max Moroz 3f782ade9a
[infra] Unfreeze LLVM updating that was stopped due to #4608. (#4655) 2020-11-18 15:00:19 -08:00
Joachim Metz 35575e1fca
Added libfsxfs to libyal project configuration (#4654) 2020-11-18 13:05:21 -08:00
DavidKorczynski f6eb565cd8
[Librdkafka] Initial integration (#4652)
* Added initial integration of librdkafka.'

* librdkafka: updated primary email and auto_ccs.

* librdkafka: fix build script.
2020-11-18 07:10:09 -08:00
AdamKorcz 750a177e5a
[NATS] initial integration (#4630)
* nats initial integration

* Added maintainer email

* Running test again

* Running tests again
2020-11-17 17:18:50 -08:00
Amit Patankar 63fa6a111b
Add amitpatankar@google.com to CCs. (#4651) 2020-11-17 13:54:20 -08:00
jonathanmetzman f3c0204d10
[NFC][CIFuzz] Fix coding issues. (#4550)
Fix some coding and style issues.
1. Treat "testcase" as one word. This is consistent with ClusterFuzz.
2. Treat "stacktrace" as one word. This is consistent with ClusterFuzz.
3. Fix spelling of comments and words in code.
4. Use descriptive style docstrings and remove unnecessary clutter
(e.g. "Test the functionality of foo_function function in bar module"
becomes "Tests foo_function."
5. Use JSON for a list needed in testing instead of pickle.
2020-11-17 13:39:57 -08:00
Abhishek Arya 93214a5535
Move atheris install base builder where python3 is installed. (#4650) 2020-11-17 12:23:29 -08:00
Abhishek Arya 583bd2b3c3
Update project.yaml 2020-11-17 10:03:03 -08:00
DavidKorczynski 2d0251ce65
[libphonenumber] Initial integration (#4629)
* [libphonenumber] Initial integration

* Fixed coverage build of libphonenumber.

* Fix build of libphonenumber.

* Trying to fix coverage build. Cannot replicate CI issue locally, however.
2020-11-17 09:51:47 -08:00
Abhishek Arya a3356cbb7c
Fix CLANG_BIN path for atheris 2020-11-17 08:39:30 -08:00
Oliver Chang 88251fcd5c
Update project.yaml 2020-11-17 17:09:00 +11:00
mbarbella-chromium e3487bc8e2
Install Atheris in base-clang. (#4647)
Co-authored-by: Martin Barbella <mbarbella@google.com>
2020-11-16 16:34:05 -08:00
Guido Vranken 20670816b6
[protobuf-c] Initial integration (#2772)
* [protobuf-c] Initial integration

* [protobuf-c] Disable UBSAN
2020-11-16 12:43:36 -08:00
Guido Vranken a21e7d975e
[bearssl] Add project (#4645)
* [bearssl] Add project

* [bearssl] Specify compile-time Cryptofuzz options
2020-11-16 09:04:04 -08:00
AdamKorcz cd9be3e383
[flatbuffers] Initial integration (#4638)
* [flatbuffers] initial integration

* Running tests again

* Running tests again

* Add developer email.
2020-11-15 12:48:53 -08:00
AdamKorcz cfd6969ba1
[snappy] Initial integration (#4631) 2020-11-13 17:59:49 -08:00
Petteri Aimonen 0c86aff172
[nanopb] Move build script to project repository (#4640) 2020-11-13 08:22:18 -08:00
Jon Siwek 4c18f0337d
projects/zeek: update build script to fix coverage build (#4633) 2020-11-12 13:49:49 -08:00
Ondřej Surý c1f671f078
[bind9] Add missing -lssl to the build instructions (#4634) 2020-11-12 06:21:33 -08:00
AdamKorcz a7a973458c
[teleport] Initial integration (#4570)
* [teleport] Initial integration

* Minor update to run tests again
2020-11-11 13:37:57 -08:00
Catena cyber d751d093e9
Updates for mysql 8.22 (#4627)
* Updates for mysql 8.22

* Mysql uses mv instead of cp to save disk space

* Dummy fix to temp file creation in mysql
2020-11-11 12:09:30 -08:00
Sergey Nizovtsev 5a49742166
Move tmux corpus to the new location (#4628) 2020-11-11 07:19:02 -08:00
Martin Holst Swende 52d73b8923
project/go-ethereum: use canon address instead of vanity-alias (#4625) 2020-11-10 18:47:02 -08:00
Nick Terrell 7e4c035a82
[lz4] Disable i386 fuzzing (#4600)
There are 3 open LZ4 i386 issues. Each claims to be reliabily reproducable. We've
never been able to reproduce any of them. At this point it is just causing noise.
So we want to disable i386 fuzzing until these issues have been sorted out.

OSS-Fuzz claims the latest tested revision is
664427aa8f
from 5 days ago. Does that mean it was able to succesfully reproduce then?
2020-11-10 11:44:30 -08:00
Guido Vranken 260479e790
[cryptofuzz] Disable i386 build (#4626) 2020-11-10 09:02:33 -08:00
Martin Holst Swende e838b5f3a4
projects/go-ethereum: improve build + move config to project repo (#4621) 2020-11-10 08:58:58 -08:00
metamerism 6195bf380e
[OpenEXR] update for OpenEXR-3.0 build config (#4624)
* [OpenEXR] update for OpenEXR-3.0 build config

Signed-off-by: Peter Hillman <peter@pedro.kiwi>
2020-11-09 19:02:22 -08:00
Oliver Chang 8b10d4b705
Fix incorrect OSS-Fuzz build project deletion. (#4623) 2020-11-10 11:10:43 +11:00
Sergey Nizovtsev 04bc87103d
Move tmux to point at the correct repository (#4622) 2020-11-09 11:34:39 -08:00
StalkR 77fa6b32ba
capstone/keystone/unicorn: add to auto_ccs (#4456) 2020-11-09 07:31:47 -08:00