databend icon indicating copy to clipboard operation
databend copied to clipboard

Published 20 hours ago • verified publisher icon datafuselabs

There is no date on when the TPC-H benchmark was run

Open alberttwong opened this issue 1 year ago • 8 comments

on https://docs.databend.com/guides/benchmark/tpch there is no date on when the TPC-H benchmark was run

alberttwong avatar Sep 20 '24 15:09 alberttwong

Hey @alberttwong, I'm here to help you with any bugs, questions, or becoming a contributor. Let's tackle this together!

The date of the TPC-H benchmark is recorded in the result.json file using the following line in the benchmark script:

yq -i ".date = \"$(date -u +%Y-%m-%d)\"" -o json result.json

This line sets the date in the result.json file to the current date in UTC format [1].

Additionally, there are references to the TPC-H benchmark in the project's main documentation that include dates:

To continue talking to Dosu, mention @dosu.

dosubot[bot] avatar Sep 20 '24 15:09 dosubot[bot]

Unfortunately that doesn't answer the question

alberttwong avatar Sep 20 '24 19:09 alberttwong

@alberttwong Thanks for the advice, we will add it soon. By the way, each night release will run the TPC-H 100: https://benchmark.databend.com/clickbench/release/tpch.html#eyJzeXN0ZW0iOnsiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzOS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYyMy1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxOC1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzMy1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzMi1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzMS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYwNS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYwNi1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzNC1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYwOC1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzNS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxMi1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxMy1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxNSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTUtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjktbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDEtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjAtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTktbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTUtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTEtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTItbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjEtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjItbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzgtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzAtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjgtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTMtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDktbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjUtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTAtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDkpIjp0cnVlfSwidHlwZSI6eyJzMyI6dHJ1ZX0sIm1hY2hpbmUiOnsiU21hbGwiOnRydWUsIkxhcmdlIjpmYWxzZX0sImNsdXN0ZXJfc2l6ZSI6eyIxNiI6dHJ1ZSwiNjQiOnRydWV9LCJtZXRyaWMiOiJob3QiLCJxdWVyaWVzIjpbdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlXX0=

BohuTANG avatar Sep 20 '24 23:09 BohuTANG

Tpch by itself is not interesting. I'm more interested in your comparison with other olap like snowflake.

alberttwong avatar Sep 20 '24 23:09 alberttwong

Yeah, comparison with snowflake: https://docs.databend.com/guides/benchmark/tpch

wubx avatar Sep 22 '24 01:09 wubx

the comparison with snowflake doesn't seem like a nightly.

alberttwong avatar Sep 23 '24 20:09 alberttwong

the comparison with snowflake doesn't seem like a nightly.

Databend currently only offers a nightly release (as used by Databend Cloud), with no additional release versions available. You can refer to the NOTE section and reproduce the benchmark using the public guide here: https://docs.databend.com/guides/benchmark/tpch#reproduce-the-benchmark

BohuTANG avatar Sep 24 '24 00:09 BohuTANG

I didn't understand the comment. So it tests against snowflake nightly?

alberttwong avatar Sep 24 '24 02:09 alberttwong