DSPBench icon indicating copy to clipboard operation
DSPBench copied to clipboard

Implementation for Flink and Spark is missing

Open FraBle opened this issue 4 years ago • 4 comments

The folder dspbench-flink and dspbench-spark are exact copies of dspbench-storm.

~/P/DSPBench » git diff --no-index dspbench-flink dspbench-storm
~/P/DSPBench » git diff --no-index dspbench-spark dspbench-storm
~/P/DSPBench »

Can you provide the source code for Spark (and Flink) to reproduce the paper results? 🙏

FraBle avatar Jun 10 '21 06:06 FraBle

I will do a refactor of the project and add the missing parts, first I need to fix some build issues.

mayconbordin avatar Jul 13 '21 14:07 mayconbordin

Hello and thank you for the great paper and the great work! Could you give some insight on when Flink support will be available? Note that depending on the advancement I can help a bit on this side in the future (with some PR), as we are interested in using your bench in our work.

guillaumerosinosky avatar Jan 17 '22 20:01 guillaumerosinosky

@guillaumerosinosky we are planning to release a Flink and SPark version by July 2022. Thank you for your interest. We are hard-working on this project.

dalvangriebler avatar Jan 29 '22 18:01 dalvangriebler

Hi @guillaumerosinosky, we just provided the Flink version for the applications. The Spark version is still under development. Partial versions were integrated into the master branch.

dalvangriebler avatar Jun 07 '24 12:06 dalvangriebler