pikiwidb icon indicating copy to clipboard operation
pikiwidb copied to clipboard

todo of floyd

Open wangshao1 opened this issue 1 year ago • 8 comments
trafficstars

Which PikiwiDB functionalities are relevant/related to the feature request?

No response

Description

  1. 使用无锁队列替换当前的队列实现。

  2. rocksdb kv分离的优化,减少Compaction过程中对blob文件的随机IO。https://github.com/pikiwidb/rocksdb/pull/2/files

  3. pika对应工具的更新,如pika-port。

  4. binlog和wal重复,只保留一份。

  5. rocksdb env,现在是所有rocksdb公用同一个bgthreadpool线程池,是否进行拆分,每个rocksdb使用独立的bgthreadpool。

  6. benchmark_client支持更多接口。

Proposed solution

同上

Alternatives considered

同上

wangshao1 avatar Jun 28 '24 03:06 wangshao1

Bot detected the issue body's language is not English, translate it automatically.


Title: pika 4.0 all

Issues-translate-bot avatar Jun 28 '24 03:06 Issues-translate-bot

@wangshao1 @AlexStocks this sounds amazing, anyone has any eta on this?

sprappcom avatar Jul 05 '24 16:07 sprappcom

@wangshao1 @AlexStocks this sounds amazing, anyone has any eta on this?

there is some todos for the third generation storage engine floyd.

AlexStocks avatar Jul 06 '24 06:07 AlexStocks

@AlexStocks eta?

sprappcom avatar Jul 06 '24 10:07 sprappcom

Bot detected the issue body's language is not English, translate it automatically.


@AlexStocks and what?

Issues-translate-bot avatar Jul 06 '24 10:07 Issues-translate-bot

2 rocksdb kv 分离的优化,减少 Compaction 过程中对 blob 文件的随机 IO。

这个工作暂不推进,防止已经开启 blob 的 RocksDB 数据无法向前兼容。

AlexStocks avatar Jul 12 '24 13:07 AlexStocks

Bot detected the issue body's language is not English, translate it automatically.


2 Optimization of rocksdb kv separation to reduce random IO to blob files during the compaction process.

This work is not being advanced for the time being to prevent RocksDB data that has blobs enabled from being forward-compatible.

Issues-translate-bot avatar Jul 12 '24 13:07 Issues-translate-bot

@AlexStocks the old pika is holding back a lot of new developments. possible to do an X version without considering the current technical debt?

  1. doesnt need forward compatibility.
  2. when performing slot migrate in future can have the X version immediately.

sprappcom avatar Jul 17 '24 13:07 sprappcom