java-sdk icon indicating copy to clipboard operation
java-sdk copied to clipboard

[WIP] Add Jazzer configuration to run in an Action

Open sahansera opened this issue 3 years ago • 5 comments

Description

Based on the discussion on #510 I thought it might be a good idea to receive some early feedback on some of the questions I had per comment here. In summary, what this does is:

  • Add a new workflow to trigger the Jazzer testing. Currently, I target the previously built version to keep this as a separate job.
  • Invoke jazzer.sh which is a Bash script I wrote to run Jazzer against a given set of classes and methods. Currently, the Class and method names are hardcoded under the jobs.build.runs-on.strategy.matrix.include for this proof-of-concept. This can be sourced differently (eg: YAML or a code scan)
  • In each Jazzer run, a Docker container gets spun up, runs autofuzzing, and dumps the file(s) to a mounted volume on the current Action container.
  • These collected files are published to the workflow pipeline. An example can be found here under the Artifacts section.

Happy to know any feedback on this.

Issue reference

We strive to have all PR being opened based on an issue, where the problem or feature have been discussed prior to implementation.

Please reference the issue this PR will close: #510

Checklist

Please make sure you've completed the relevant tasks for this PR, out of the following list:

  • [x] Code compiles correctly
  • [ ] Created/updated tests
  • [ ] Extended the documentation

sahansera avatar Dec 07 '21 13:12 sahansera

CLA assistant check
All CLA requirements met.

ghost avatar Dec 07 '21 13:12 ghost

gentle ping - @sahansera

cicoyle avatar Dec 21 '23 15:12 cicoyle

gentle ping @sahansera

cicoyle avatar Feb 19 '24 21:02 cicoyle

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (14cc3f8) 77.60% compared to head (9cb7dc7) 77.60%. Report is 4 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff            @@
##             master     #664   +/-   ##
=========================================
  Coverage     77.60%   77.60%           
  Complexity     1570     1570           
=========================================
  Files           144      144           
  Lines          4765     4765           
  Branches        554      554           
=========================================
  Hits           3698     3698           
  Misses          781      781           
  Partials        286      286           

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov[bot] avatar Feb 19 '24 21:02 codecov[bot]