Commit Graph

19 Commits

Author SHA1 Message Date
Oliver Chang ef0e5413c9
CFLite: Logging fixes. (#6715)
Don't output stacktrace again in detected bug log message.

Disable Python buffering to avoid log interleaving issues.
2021-11-02 16:50:59 +11:00
jonathanmetzman b2fa3547b2
[clusterfuzzlite] Fixes for gsutil (#6683)
1 Fix usage of gsutil tool.
2 Get rid of run_fuzzers_mode and change to mode. Fixes: #6677
3 Install requirements before copying source code to make iterative development of cifuzz code faster.
2021-10-28 15:00:44 -04:00
jonathanmetzman b77a55b9b4
[ClusterFuzzLite] Support GCB and gsutil/gcs as filestore. (#6629)
* add gsutil filestore

* lint

* Fix

* Add build image script

* get gcb fuzzing working

* fmt and fix config_utils_test

* Check that crashes are uploaded

* Add no_filestore

* fix test

* fix tests

* fix

* Print crash URL

* Fix

* fix

* fmt

* lnt

* fix

* fmt
2021-10-27 10:00:04 -04:00
Oliver Chang c63ca4b8cd
Fix CIFuzz coverage generation. (#6523)
Also clean up the external action definitions:
- Set default values for the storage repo branches.
- Remove storage repo options from build_fuzzers.
2021-10-06 06:56:20 +11:00
jonathanmetzman 6d23f29f29
[cifuzz] Use javascript actions library for uploading artifacts (#6552)
Delete our python implementation which appears buggy and will be annoying to maintain.
Fixes: https://github.com/google/oss-fuzz/issues/6526
2021-10-05 09:16:54 -04:00
jonathanmetzman c625dcb3ab
ClusterFuzzLite: Install nodejs in cifuzz-base. (#6534)
We will use this to upload artifacts in the future.
2021-10-04 09:48:16 -04:00
jonathanmetzman 5576d3bd45
[cifuzz] Install docker for focal. (#6339) 2021-08-30 06:49:43 -07:00
jonathanmetzman 8d90359bd9
[cifuzz] Fix bug caused by Ubuntu upgrade. (#6318)
* [cifuzz] Fix bug caused by Ubuntu upgrade.
systemd-detect-virt isn't being found.

* fix
2021-08-26 11:22:24 -07:00
jonathanmetzman d01808333d
[cifuzz] Fuzz in cifuzz-base (#6142)
Fixes: #5926
2021-08-05 13:27:24 -07:00
Mitchel Herman faea660c5e
Add CIFuzz external entrypoint for cifuzz base (#5906)
This is an entrypoint for CIFuzz users that can't build two docker images
(e.g. prow users).
Co-authored-by: jonathanmetzman <31354670+jonathanmetzman@users.noreply.github.com>
2021-06-30 17:19:03 -07:00
jonathanmetzman 624a294bff
[CIFuzz] Allow run_fuzzers to use a preexisting corpus. (#5928)
* [CIFuzz] Allow run_fuzzers to use a preexisting corpus.

Also improve comment in cifuzz-base/Dockerfile.

* improve comment

* Fix run_fuzzers
Add --cache option to helper.py's build_image command which
uses the docker image cache when building and use this in
ci/build.py.
Change build_image_impl's argument no_cache to cache for clarity.
Eliminate default argument cache in build_fuzzers_impl since no users
use it.
2021-06-17 08:32:20 -07:00
jonathanmetzman 0034bfde5d
[CIFuzz] Refactor HTTP code and use a newer python. (#5842)
* Move to http_utils

* Update dockerfiles

* Dont install python3 from apt if we copy it into image

* fix

* fmt

* Add missing
2021-06-14 09:26:04 -07:00
jonathanmetzman 39483b8403
[CIFuzz][cifuzz-base] Slim down cifuzz-base (#5288)
Reduce cifuzz-base size from 846MB to 444MB.

1. Don't install parts of docker that aren't necessary.
2. Use .dockerignore properly.
2021-03-09 08:32:50 -08:00
jonathanmetzman b0b99d5ccd
Cifuzz external build (#4656)
* Support building fuzzers for projects outside of OSS-Fuzz
* Use retry wrapper
* Fix some tests.
2020-12-07 10:50:11 -08:00
jonathanmetzman a85de2b3a7
Make CIFuzz more debuggable by allowing one to run off a branch (#4666)
Make it possible to run CIFuzz from a non-master branch
2020-11-24 06:32:23 -08:00
jonathanmetzman 571dbfb39f
Reland 55d9a81. (#4269)
The issue with 55d9a81 that caused it to be reverted by 3370f8f
was probably due to the build trigger on GCB being stale. I've
updated it so this commit should stick.
2020-08-06 14:33:08 -07:00
Evgeny Vereshchagin 3370f8f7e5
Revert "[CIFuzz] Allow supplying a manual source checkout (#4250)" (#4263)
This reverts commit 55d9a81cd7.

Closes https://github.com/google/oss-fuzz/issues/4262
2020-08-06 06:11:59 -07:00
jonathanmetzman 55d9a81cd7
[CIFuzz] Allow supplying a manual source checkout (#4250)
Make CIFuzz building accept an env var `MANUAL_SRC_PATH` that points to a manually prepared checkout of the project-under-tests's source code. This allows projects like Skia which are not on OSS-Fuzz and/or need to make changes to the repo after checking out the right commit to use CIFuzz.
Note that for now we aren't supporting this in GitHub, so projects that need to modify the source after checkout can't use it until
we do support it.

Also, use the local copy of OSS-Fuzz when building cifuzz-base instead of cloning it from GitHub. This makes local debugging/development much easier since it allows one to use CIFuzz with local changes.
2020-08-05 18:45:12 -07:00
Leo Neat 5cefaac000
[CIFuzz] Separate build and run actions (#3336)
* Separating actions into build and run

* Formatting

* Formatting

* Removing project-name from run action

* Jonathan comments

* Maxs comments pt.1

* Updating example_main.yml

* Switch 1 0 to true false

* Add base Dockerfile for CIFuzz

* Adding license to dockerfile
2020-02-06 13:39:42 -08:00