oss-fuzz Code coverage daily build cadence

Hi, how often do code coverage builds typically happen?

https://oss-fuzz-build-logs.storage.googleapis.com/index.html shows no projects have coverage builds since April 11th. It is now April 16th. Is this expected?

Apr 17 '25 07:04 nareddyt

Just opened https://github.com/google/oss-fuzz/issues/13231.

Previously was expected to build every day, or at least that is what I observed.

cc @jonathanmetzman @DavidKorczynski

Apr 17 '25 07:04 zi0Black

We are still without coverage builds 🥲

Apr 22 '25 08:04 zi0Black

@DavidKorczynski can you take a look? gateway project is trying to debug why our fuzzers show 0 code coverage, but it's difficult to reproduce locally. We're hoping re-enabling the daily coverage build will help us debug.

Apr 22 '25 10:04 nareddyt

@jonathanmetzman do you have ideas here? is it a similar issue to https://github.com/google/oss-fuzz/issues/13217 ?

Apr 22 '25 10:04 DavidKorczynski

Should be fixed in: https://github.com/google/oss-fuzz/pull/13240

Apr 22 '25 10:04 DavidKorczynski

will close once we see builds coming in

Apr 22 '25 10:04 DavidKorczynski

Looks like https://oss-fuzz.com/coverage-report/job/libfuzzer_asan_systemd/latest points to the coverage report built yesterday (on 2025-04-22) so it seems to have gotten back to normal.

The FI report at https://introspector.oss-fuzz.com/project-profile?project=systemd hasn't been updated yet though.

Apr 23 '25 07:04 evverx

@DavidKorczynski Do you know what updates that page? The introspector builds have been happening: https://pantheon.corp.google.com/cloud-build/builds;region=us-central1/19766c20-439b-4881-9470-3bebb45cad76;step=8?project=oss-fuzz

Apr 23 '25 16:04 jonathanmetzman

@DavidKorczynski can you take a look? gateway project is trying to debug why our fuzzers show 0 code coverage, but it's difficult to reproduce locally. We're hoping re-enabling the daily coverage build will help us debug.

We are also experiencing low coverage compared to local builds with just the initial seed corpus.

Apr 23 '25 16:04 zi0Black

All the FI dashboards I've taken a look at have been updated as well. I'm not sure why the graphs are flat in some places but it's probably unrelated to this issue.

Apr 23 '25 17:04 evverx

I'm not sure why the graphs are flat in some places but it's probably unrelated to this issue.

Which graphs? it's looking good as far as I can tell?

Apr 24 '25 13:04 DavidKorczynski

For example two fuzz targets vanished in https://github.com/systemd/systemd/commit/d95818f5221d9b9b19648cffa0cb2407f023b27e and then they were brought back in https://github.com/systemd/systemd/commit/39dd06dbc4feaf8a792ea6d2f5f51a2ae141968b so I expected their graphs to reflect that but they are flat

There should have been a visible drop from 2025-03-29 to 2025-04-21 probably.

Apr 24 '25 14:04 evverx