Request distribution uniform results in 0 op/s for MongoDB

[seybi87]

Hi guys,

I am trying to run a 99% read / 1 % insert workload with the uniform request distribution against MongoDB.

The load phase has been successfully executed and the MongoDB database contains 2000000 records.

However in the run phase, basically no throughput at all is achieved:

2022-06-17 06:37:04:791 10 sec: 1 operations; 0.1 current ops/sec; est completion in 11574 days 1 hour [INSERT: Count=1, Max=2081791, Min=2080768, Avg=2081280, 90=2081791, 99=2081791, 99.9=2081791, 99.99=2081791]
2022-06-17 06:37:14:791 20 sec: 1 operations; 0 current ops/sec; est completion in 23148 days 3 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:37:24:791 30 sec: 1 operations; 0 current ops/sec; est completion in 34722 days 5 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:37:34:791 40 sec: 1 operations; 0 current ops/sec; est completion in 46296 days 7 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:37:44:791 50 sec: 1 operations; 0 current ops/sec; est completion in 57870 days 8 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:37:54:791 60 sec: 1 operations; 0 current ops/sec; est completion in 69444 days 10 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:38:04:802 70 sec: 1 operations; 0 current ops/sec; est completion in 81031 days 5 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:38:14:791 80 sec: 1 operations; 0 current ops/sec; est completion in 92592 days 14 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:38:24:791 90 sec: 1 operations; 0 current ops/sec; est completion in 104166 days 15 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:38:34:791 100 sec: 1 operations; 0 current ops/sec; est completion in 115740 days 17 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:38:44:806 110 sec: 1 operations; 0 current ops/sec; est completion in 127332 days 4 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:38:54:798 120 sec: 1 operations; 0 current ops/sec; est completion in 138896 days 23 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:39:04:791 130 sec: 1 operations; 0 current ops/sec; est completion in 150462 days 23 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:39:14:791 140 sec: 1 operations; 0 current ops/sec; est completion in 162037 days [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:39:24:791 150 sec: 1 operations; 0 current ops/sec; est completion in 173611 days 2 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
2022-06-17 06:39:34:791 160 sec: 1 operations; 0 current ops/sec; est completion in 185185 days 4 hours [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=?, 90=0, 99=0, 99.9=0, 99.99=0]
...

Find below the load and run commands below:

load:

bin/ycsb load mongodb -s -jvm-args=-XX:MaxRAMPercentage=85.0  -p mongodb.url="mongodb://user:[email protected]:27017/admin" -p workload=site.ycsb.workloads.CoreWorkload -threads 50 -p recordcount=2000000 -p operationcount=100000000 -p fieldcount=10 -p fieldlength=500 -p requestdistribution=uniform -p insertorder=ordered -p readproportion=0.99 -p updateproportion=0.0 -p insertproportion=0.01 -p scanproportion=0.0 -p scanlengthdistribution=uniform -p core_workload_insertion_retry_limit=3 -p core_workload_insertion_retry_interval=3 

run:

bin/ycsb run mongodb -s -jvm-args=-XX:MaxRAMPercentage=85.0  -p mongodb.url="mongodb://user:[email protected]:27017/admin" -p workload=site.ycsb.workloads.CoreWorkload -p maxexecutiontime=1800 -threads 50 -p recordcount=2000000 -p operationcount=100000000 -p fieldcount=10 -p fieldlength=500 -p requestdistribution=uniform -p insertorder=ordered -p readproportion=0.99 -p updateproportion=0.0 -p insertproportion=0.01 -p scanproportion=0.0 -p scanlengthdistribution=uniform -p core_workload_insertion_retry_limit=3 -p core_workload_insertion_retry_interval=3 -p insertstart=2000001

Any advice is much appreciated!

[busbey]

How are you confirming that the load phase was successful?

For the run phase it sounds like you need to get more logging from the mongodb client to get an idea of what might be failing.

[seybi87]

Thanks for your reply @busbey

How are you confirming that the load phase was successful?

This is confirmed by the result file result.txt and I also checked the MongoDB instance if the records are available after the load phase.

Thanks for the hint regarding the log level, I will increase the log level and check if this provides more insights.