YCSB icon indicating copy to clipboard operation
YCSB copied to clipboard

Postgresql issue

Open ghost opened this issue 4 years ago • 1 comments

Hi there! I'm trying to run YCSB 0.17 against postgres (12.6 (Ubuntu 12.6-1.pgdg18.04+1)) in WSL 2 and did all the steps against the test DB.

Upon running the command:

./bin/ycsb load postgrenosql -s -P workloads/workloadb -P postgrenosql/conf/postgrenosql.properties -p recordcount=1000 -threads 8 > postgrenosql_load.txt

I get following never ending response:

DBWrapper: report latency for each error is false and specific error codes to track for latency are: []
2021-03-13 11:19:27:361 10 sec: 125 operations; 12.5 current ops/sec; est completion in 1 minute [CLEANUP: Count=1, Max=5, Min=5, Avg=5, 90=5, 99=5, 99.9=5, 99.99=5] [INSERT: Count=125, Max=181247, Min=1579, Avg=5882.79, 90=7891, 99=27407, 99.9=181247, 99.99=181247]
2021-03-13 11:19:37:360 20 sec: 125 operations; 0 current ops/sec; est completion in 2 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:19:47:360 30 sec: 125 operations; 0 current ops/sec; est completion in 3 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:19:57:360 40 sec: 125 operations; 0 current ops/sec; est completion in 4 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:20:07:360 50 sec: 125 operations; 0 current ops/sec; est completion in 5 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:20:17:360 60 sec: 125 operations; 0 current ops/sec; est completion in 7 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:20:27:360 70 sec: 125 operations; 0 current ops/sec; est completion in 8 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:20:37:360 80 sec: 125 operations; 0 current ops/sec; est completion in 9 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:20:47:360 90 sec: 125 operations; 0 current ops/sec; est completion in 10 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:20:57:360 100 sec: 125 operations; 0 current ops/sec; est completion in 11 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:21:07:360 110 sec: 125 operations; 0 current ops/sec; est completion in 12 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:21:17:360 120 sec: 125 operations; 0 current ops/sec; est completion in 14 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]
2021-03-13 11:21:27:360 130 sec: 125 operations; 0 current ops/sec; est completion in 15 minutes [CLEANUP: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0] [INSERT: Count=0, Max=0, Min=9223372036854775807, Avg=NaN, 90=0, 99=0, 99.9=0, 99.99=0]

It won't basically do anything an keep running and updating every 10 seconds until I stop the process manually.

Edit: Just tried it on V 9.6, as per documentation, and it's still not working. Edit: Might be related to: https://github.com/brianfrankcooper/YCSB/issues/1379 since I'm also getting in my logs:

2021-03-13 11:43:48.552 CET [3221] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:43:48.552 CET [3221] postgres@test DETAIL:  Key (ycsb_key)=(user8517097267634966620) already exists.
2021-03-13 11:43:48.552 CET [3221] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:43:48.578 CET [3221] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:43:48.578 CET [3221] postgres@test DETAIL:  Key (ycsb_key)=(user1820151046732198393) already exists.
2021-03-13 11:43:48.578 CET [3221] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:43:48.579 CET [3221] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:43:48.579 CET [3221] postgres@test DETAIL:  Key (ycsb_key)=(user1820151046732198393) already exists.
2021-03-13 11:43:48.579 CET [3221] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:46:55.414 CET [3327] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:46:55.414 CET [3327] postgres@test DETAIL:  Key (ycsb_key)=(user1820151046732198393) already exists.
2021-03-13 11:46:55.414 CET [3327] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:46:55.451 CET [3327] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:46:55.451 CET [3327] postgres@test DETAIL:  Key (ycsb_key)=(user1820151046732198393) already exists.
2021-03-13 11:46:55.451 CET [3327] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:46:55.453 CET [3327] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:46:55.453 CET [3327] postgres@test DETAIL:  Key (ycsb_key)=(user1820151046732198393) already exists.
2021-03-13 11:46:55.453 CET [3327] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:46:55.490 CET [3327] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:46:55.490 CET [3327] postgres@test DETAIL:  Key (ycsb_key)=(user3232700585171816769) already exists.
2021-03-13 11:46:55.490 CET [3327] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:52:11.466 CET [3453] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:52:11.466 CET [3453] postgres@test DETAIL:  Key (ycsb_key)=(user4052466453699787802) already exists.
2021-03-13 11:52:11.466 CET [3453] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)
2021-03-13 11:52:11.527 CET [3453] postgres@test ERROR:  duplicate key value violates unique constraint "usertable_pkey"
2021-03-13 11:52:11.527 CET [3453] postgres@test DETAIL:  Key (ycsb_key)=(user4052466453699787802) already exists.
2021-03-13 11:52:11.527 CET [3453] postgres@test STATEMENT:  INSERT INTO usertable (YCSB_KEY,YCSB_VALUE) VALUES($1,$2)

ghost avatar Mar 13 '21 10:03 ghost

@douaberigoale did you find a solution to this?

kazzasticc avatar Oct 24 '23 12:10 kazzasticc