From 5623cbaf80ef27caae2dd6f9bfe5b7896aad6031 Mon Sep 17 00:00:00 2001 From: Dongge Liu Date: Wed, 16 Aug 2023 17:03:45 +1000 Subject: [PATCH] Fix LLM report benchmark table. (#10845) 1. Merge Prompt, Fixes, and Targets into one column. 2. Make the page wider to fit all column. --- docs/_sass/color_schemes/wider.scss | 2 + docs/assets/css/just-the-docs-wider.scss | 3 + docs/research/target_generation.md | 569 +++++++++++------------ 3 files changed, 288 insertions(+), 286 deletions(-) create mode 100644 docs/_sass/color_schemes/wider.scss create mode 100644 docs/assets/css/just-the-docs-wider.scss diff --git a/docs/_sass/color_schemes/wider.scss b/docs/_sass/color_schemes/wider.scss new file mode 100644 index 000000000..e38d17481 --- /dev/null +++ b/docs/_sass/color_schemes/wider.scss @@ -0,0 +1,2 @@ +@import "./color_schemes/light"; +$content-width: 70rem; diff --git a/docs/assets/css/just-the-docs-wider.scss b/docs/assets/css/just-the-docs-wider.scss new file mode 100644 index 000000000..f4a84f4fa --- /dev/null +++ b/docs/assets/css/just-the-docs-wider.scss @@ -0,0 +1,3 @@ +--- +--- +{% include css/just-the-docs.scss.liquid color_scheme="wider" %} diff --git a/docs/research/target_generation.md b/docs/research/target_generation.md index d350733fd..30f54179c 100644 --- a/docs/research/target_generation.md +++ b/docs/research/target_generation.md @@ -244,18 +244,13 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz, ## Successful benchmark results - - - - @@ -271,11 +266,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Project Function Prompt - Fix iterations - Final fuzz targets + Output Build rate tinyxml2-xmldocument-print Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -297,11 +292,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmldocument-deepcopy Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -323,11 +318,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-setattribute Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

75

@@ -349,11 +344,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
plist_print Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -375,11 +370,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-doubletext Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -401,11 +396,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-booltext Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

87.5

@@ -427,11 +422,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-insertnewunknown Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -453,11 +448,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-int64text Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

87.5

@@ -479,11 +474,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
cjson_compare Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

75

@@ -505,11 +500,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-floattext Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -531,11 +526,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-inttext Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

75

@@ -557,11 +552,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-unsigned64text Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -583,11 +578,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyobj-objreader-parsefromfile Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -609,11 +604,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-unsignedtext Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -635,11 +630,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-shallowclone Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -661,11 +656,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
cjson_replaceiteminobject Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -687,11 +682,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-gettext Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -713,11 +708,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-shallowequal Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -739,11 +734,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
cjson_duplicate Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -765,11 +760,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
xml_externalentityparsercreate Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

12.5

@@ -791,11 +786,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
cjson_replaceiteminobjectcasesensitive Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

87.5

@@ -817,11 +812,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-insertnewcomment Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -843,11 +838,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
xml_parsercreatens Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

12.5

@@ -869,11 +864,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-deleteattribute Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -895,11 +890,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-insertnewdeclaration Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -921,11 +916,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-insertnewchildelement Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -947,11 +942,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlnode-previoussiblingelement Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

87.5

@@ -973,11 +968,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyobj-loadobj Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -999,11 +994,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyobj-material_t-material_t Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1025,11 +1020,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmlelement-insertnewtext Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -1051,11 +1046,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
dwfl_module_relocate_address Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

87.5

@@ -1077,11 +1072,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
xmlschemavalidatefile Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -1103,11 +1098,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
tinyxml2-xmldocument-loadfile Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1129,11 +1124,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
ogg_stream_packetin Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1155,11 +1150,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
xmltextreadersetschema Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -1181,11 +1176,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
xmltextreaderschemavalidate Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -1207,11 +1202,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
plist_dict_merge Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

12.5

@@ -1233,11 +1228,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
xmltextreaderschemavalidatectxt Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1259,11 +1254,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
cjson_printpreallocated Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

75

@@ -1285,11 +1280,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
ucl_parser_insert_chunk Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1311,11 +1306,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
ucl_object_compare Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

12.5

@@ -1337,11 +1332,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
dwarf_getlocations Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -1363,11 +1358,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
ucl_parser_add_fd_priority Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

71.43

@@ -1389,11 +1384,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
json-value-resize Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -1415,11 +1410,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
mosquitto_topic_matches_sub2 Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

87.5

@@ -1441,11 +1436,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
xvid_encore Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

31.25

@@ -1467,11 +1462,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
cjson_parse Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

75

@@ -1493,11 +1488,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
cjson_parsewithlength Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -1519,11 +1514,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
json-value-removeindex Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1545,11 +1540,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
ucl_object_merge Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1571,11 +1566,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
ogg_stream_pageout_fill Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

6.25

@@ -1597,11 +1592,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
sf_command Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

25

@@ -1623,11 +1618,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
mosquitto_topic_matches_sub Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

62.5

@@ -1649,11 +1644,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
sf_format_check Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

12.5

@@ -1675,11 +1670,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
ucl_object_replace_key Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

50

@@ -1701,11 +1696,11 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
dwarf_find_die_given_sig8 Prompt - Fixes - Targets + Prompt; +
+Fixes; +
+Targets.

37.5

@@ -1725,3 +1720,5 @@ Ultimately, the goal is to integrate the results of this research into OSS-Fuzz,
+ +