redis-benchmarks-specification icon indicating copy to clipboard operation
redis-benchmarks-specification copied to clipboard

[BUG]: "redis-benchmark-spec" test suite failures

Open odidev opened this issue 1 year ago • 2 comments

Describe the bug

I am executing benchmark tests following the documents here: < https://github.com/redis/redis-benchmarks-specification#testing-out-the-redis-benchmarks-spec-client-runner > on the Linux/AMD64 Ubuntu AWS instance.

However, tests failed with the below error:

2023-05-24 09:08:06 INFO Benchmark used memory at start of benchmark: 1g 
2023-05-24 09:08:06 INFO Checking if there is a keyspace check being enforced 
2023-05-24 09:08:06 INFO Ensuring keyspace length requirement = 1000000 is met. 
2023-05-24 09:08:06 ERROR The total numbers of keys in setup does not match the expected spec: 1000000!=1000002. Aborting... 
2023-05-24 09:08:06 CRITICAL Some unexpected exception was caught during local work. Failing test.... 
2023-05-24 09:08:06 CRITICAL <class 'Exception'> 

Referring to the already raised ticket here: < https://github.com/redis/redis-benchmarks-specification/issues/206 >, I already installed the latest version of redis-benchmarks-specification (0.1.70) available with pip. But I am getting the same error.

Can you please provide some pointers for the same?

Environment (please complete the following information):

  • OS: Ubuntu 22.04
  • PyPi version package: pip 23.1.2 from /usr/local/lib/python3.10/dist-packages/pip (python 3.10)
  • Platfrom: x86

odidev avatar May 24 '23 10:05 odidev