fuzzbench icon indicating copy to clipboard operation
fuzzbench copied to clipboard

Support running FuzzBench without Google Cloud

Open jonathanmetzman opened this issue 5 years ago • 7 comments

Local experiments are currently not truly local because they depend on Google Cloud Storage (GCS). We should break this dependency. We use gsutil which has bash-like commands for managing files on GCS (e.g. cp, rm etc). Instead we may need to switch to a library that supports other s3-like solutions and/or the local filesystem. Local support will also break after the queue branch is merged into master and will need to be fixed again.

jonathanmetzman avatar Apr 22 '20 20:04 jonathanmetzman

@zchai please link to this issue on every pull request you do for this feature.

jonathanmetzman avatar Jun 11 '20 23:06 jonathanmetzman

PRs that were already done: https://github.com/google/fuzzbench/pull/422 https://github.com/google/fuzzbench/pull/417 https://github.com/google/fuzzbench/pull/407 https://github.com/google/fuzzbench/pull/406 https://github.com/google/fuzzbench/pull/405 https://github.com/google/fuzzbench/pull/402 https://github.com/google/fuzzbench/pull/394 The initial PR: https://github.com/google/fuzzbench/pull/8

jonathanmetzman avatar Jun 11 '20 23:06 jonathanmetzman

Let's keep this open until there is nothing left to be done here.

jonathanmetzman avatar Jun 17 '20 22:06 jonathanmetzman

Let's keep this open until there is nothing left to be done here.

Sounds good.

zchcai avatar Jun 17 '20 22:06 zchcai

Basic support is in - https://google.github.io/fuzzbench/running-a-local-experiment

inferno-chromium avatar Sep 25 '20 21:09 inferno-chromium

This is a tracking bug and should be kept open as long as there is work to do here. Reopening since there is still a ton of stuff to do here.

jonathanmetzman avatar Sep 25 '20 22:09 jonathanmetzman

See also https://github.com/google/fuzzbench/issues/777 for the need to support local docker registry.

inferno-chromium avatar Sep 29 '20 15:09 inferno-chromium