pika icon indicating copy to clipboard operation
pika copied to clipboard

读取性能很差

Open isoleo opened this issue 4 years ago • 3 comments

16 核 64G 数据写入了20G 。读取时qps 6K 内存仅占用了2G 。内存也上不去,大神给指教一下吧。 -----------Pika server 3.2.9 ---------- -----------Pika config list---------- 1 port 9221 2 thread-num 16 3 thread-pool-size 16 4 sync-thread-num 6 5 log-path ./log/ 6 db-path ./db/ 7 write-buffer-size 536870912 8 timeout 6000 9 requirepass 10 masterauth 11 userpass 12 userblacklist 13 instance-mode classic 14 databases 1 15 default-slot-num 100 16 dump-prefix 17 daemonize yes 18 dump-path ./dump/ 19 dump-expire 0 20 pidfile ./pika.pid 21 maxclients 20000 22 target-file-size-base 33554432 23 expire-logs-days 7 24 expire-logs-nums 10 25 root-connection-num 2 26 slowlog-write-errorlog no 27 slowlog-log-slower-than 10000 28 slowlog-max-len 128 29 db-sync-path ./dbsync/ 30 db-sync-speed -1 31 slave-priority 100 32 server-id 1 33 sync-window-size 9000 34 max-conn-rbuf-size 268435456 35 write-binlog yes 36 binlog-file-size 104857600 37 max-cache-statistic-keys 0 38 small-compaction-threshold 5000 39 max-write-buffer-size 32212254720 40 max-client-response-size 524288000 41 compression snappy 42 max-background-flushes 2 43 max-background-compactions 2 44 max-cache-files 10000 45 max-bytes-for-level-multiplier 10 46 cache-index-and-filter-blocks no 47 level-compaction-d/ynamic-level-bytes no -----------Pika config end----------

isoleo avatar Sep 22 '21 10:09 isoleo

采用默认参数也是这样的性能吗?机器采用的是nvme盘吗?此外配置参数做的修改有什么参考依据吗?看到你修改了write-buffer-size target-file-size-base

kernelai avatar Sep 23 '21 09:09 kernelai

如果是nvme盘,20核cpu,64G内存,默认配置随机读应该能20~40万的qps

kernelai avatar Sep 23 '21 09:09 kernelai

首先要确认,是什么工具,如何方式测试的?

chinafzy avatar Jan 07 '22 07:01 chinafzy