pikiwidb icon indicating copy to clipboard operation
pikiwidb copied to clipboard

bug: exit pikiwidb with error

Open dingxiaoshuai123 opened this issue 1 year ago • 16 comments

Is this a regression?

Yes

Description

使用 ctrl + c 退出后, 会有错误. image

Please provide a link to a minimal reproduction of the bug

No response

Screenshots or videos

images

Please provide the version you discovered this bug in (check about page for version information)

No response

Anything else?

No response

dingxiaoshuai123 avatar Apr 25 '24 13:04 dingxiaoshuai123

txt_to_pika导入内部做了哪些操作,数据同步到磁盘了吗

TenderWang avatar Jul 05 '18 12:07 TenderWang

会落盘的, 具体逻辑可以参考一下pika下tools目录里面的源码

Axlgrep avatar Jul 05 '18 14:07 Axlgrep

我用txt_to_pika导入78121条记录时间是17S,导入1千4百万条时间就到18min了,差距有点大

TenderWang avatar Jul 06 '18 01:07 TenderWang

数据量大的话, 由于rocksdb会做compact,可能会影响写入, 但是这个差距确实有点大, 是不是一千多万条数据中有大量重复的key, 导致多线程之间锁抢占占用了时间?

Axlgrep avatar Jul 06 '18 02:07 Axlgrep

such a too old issue. close it now.

AlexStocks avatar Mar 11 '23 17:03 AlexStocks