Commit Graph

22 Commits

Author SHA1 Message Date
jonathanmetzman 3f304fc32d
Cifuzz upload fix (#9899) 2023-03-16 11:35:55 -04:00
jonathanmetzman 1abbd8bf08
Revert "Fix run_fuzzers_test::CoverageReportIntegrationTest. (#7325)" (#7466)
This reverts commit 9553ab10d7.
2022-03-29 14:46:36 +11:00
Oliver Chang 9553ab10d7
Fix run_fuzzers_test::CoverageReportIntegrationTest. (#7325)
Fixes #7324.
2022-03-01 10:39:05 +11:00
jonathanmetzman 36e5931a19
Make a better api for platform specific config. (#6708)
1. Move most of the generic stuff into BasePlatformConfig.
2. Make a GCB platform config that sets WORKSPACE and PROJECT_SRC_PATH so users don't have to.
3. Make a skeleton prow platform_config for Mitchel to fill out.
4. Make users explicitly specify the CFL_PLATFORM so we can pick CI environments
2021-11-01 12:29:38 +00:00
jonathanmetzman 4ce563f882
Fix diffing on non-GitHub and improve config (#6707)
Fix diffing on non-GitHub and improve config

1. Remove obsolete comments.
2. Remove unused function get_pr_ref
3. Correct comment on git_sha
4. Rename commit_sha to git_sha
5. Make base_commit, pr_ref, and base_ref non-github specific and move to
CiEnvironment.
6. Hoist get_diff_base to base class to allow diffing
7. Fix downloading coverage on non-Github.
8. Add TODO so that we don't assume github actions is run on github.com
(enterprise users)
9. Rename repo_url to git_url.
10. Add missing git_url method base class.
11. Clarify what git_url, git_sha and pr_ref are for and leave TODOs about how
we can eliminate them.
12. Fix typos.
2021-10-31 20:36:07 -04:00
jonathanmetzman b77a55b9b4
[ClusterFuzzLite] Support GCB and gsutil/gcs as filestore. (#6629)
* add gsutil filestore

* lint

* Fix

* Add build image script

* get gcb fuzzing working

* fmt and fix config_utils_test

* Check that crashes are uploaded

* Add no_filestore

* fix test

* fix tests

* fix

* Print crash URL

* Fix

* fix

* fmt

* lnt

* fix

* fmt
2021-10-27 10:00:04 -04:00
jonathanmetzman 6d23f29f29
[cifuzz] Use javascript actions library for uploading artifacts (#6552)
Delete our python implementation which appears buggy and will be annoying to maintain.
Fixes: https://github.com/google/oss-fuzz/issues/6526
2021-10-05 09:16:54 -04:00
Oliver Chang d178de5e00
CFLite: Fix corpus pruning for git store. (#6434)
Fixes #6376.
2021-09-15 11:49:29 +10:00
jonathanmetzman 01247be731
[infra][tests][NFC] Change mocked function prefix from "mocked_" to "mock_" (#6198)
Also rename mock_ functions to have impl suffix so we can use mock_ in place of mocked_
2021-08-12 11:25:57 -07:00
jonathanmetzman 0bf87a10c4
[cifuzz] Only grab github-specific env vars on github (#6150)
This removes need for non-OSS-Fuzz users to fake using OSS-Fuzz.

Fixes: #6129
2021-08-03 18:13:59 -07:00
Oliver Chang 69400fb24b
Add a Git backed filestore. (#6088)
- Add storage-repo, storage-repo-branch, and
  storage-repo-branch-coverage fields to the actions, to indicate that
  the Git filestore should be used.
- The CI provided filestore is still used for crashes and builds.
- Replace generic Filestore.upload_directory with typed upload methods
  which matches the download methods.
- Rename upload_latest_build to upload_build to make it more generic.
- Make artifact name prefixes an implementation detail of the store.

For #6052.
2021-07-27 10:46:20 +10:00
Jonathan Metzman 3bd4c2d3ac [cifuzz] Fix last commit pushed to master 2021-07-23 08:12:52 -07:00
Jonathan Metzman 781749884b [cifuzz][github_actions] Create methods/functions for uploading without tar
This can be useful for artifacts we want to upload that we know
do not need to be tarred, such as crashes. It's important not
to tar these because they will need to be viewed by users.
2021-07-23 08:00:35 -07:00
jonathanmetzman c67d5b8626
[CIFuzz] Fix build uploading. (#6096)
Previously, the downloaded build was uploaded instead of the new build.
This regression was introduced when the big workspace change was made.
Also, add more logging.
2021-07-22 12:52:07 -07:00
jonathanmetzman 24eb7e6668
[NFC][cifuzz] Add tests for github actions. (#6094)
To avoid issues like #6087 before they land.
2021-07-22 12:51:34 -07:00
jonathanmetzman 3d75fc9fb4
[cifuzz][NFC] Use f-strings instead of format function (#6095) 2021-07-22 09:22:29 -07:00
Oliver Chang fdb9c9a0fd
Fix typo (#6087) 2021-07-22 15:02:00 +10:00
jonathanmetzman 2a3a1e903a
[CIFuzz] Add cifuzz- prefix to all artifacts (#6084)
This will prevent conflicts with other artifacts in the repo.
2021-07-21 11:36:11 -07:00
jonathanmetzman 6baa5e3e68
[CIFuzz] Fix bug in tar_directory (#6083)
We need to split the archive_path
2021-07-21 10:19:32 -07:00
jonathanmetzman fde0a30492
[CIFuzz] Support uploading coverage reports (#6078) 2021-07-21 09:19:47 -07:00
jonathanmetzman 86392ca2f4
[CIFuzz][ClusterFuzzLite] Prepare to support coverage reports for external users (#6074)
1. Make coverage script accept an env var that controls where the generated report is written to. Use this in generate_coverage_report.
2. Rename CoverageGetter to OSSFuzzCoverage
3. Make affected_fuzz_targets get coverage object from clusterfuzz_deployment.
4. Add stubbed FilesystemCoverage class that will be used by non-OSS-Fuzz users.
5. Make ClusterFuzzLite able to return coverage object by downloading old coverage report and returning a FilesystemCoverage object.
6. Add stub to ClusterFuzzLite for uploading coverage.

Related: #6054
2021-07-20 10:04:57 -07:00
jonathanmetzman c779501392
[CIFuzz] Implement filestore based on github artifacts (#5943)
Implement filestore based on github actions' artifacts feature.
This uses the github api and the github actions API.
Also fix imports in github_actions_toolkit library that were broken by move to third_party directory.
2021-06-21 15:28:21 +00:00