go-while
go-while
never give up! removed sub/nested bucketing and will try with 256 root buckets in every of the 16 dbs to put key/vals in (int to hex with space seperator )....
i've never looked at iotop but that's burning :rofl: Total DISK WRITE: 580.49 M/s while zfs is not writing anything.... flushing normally.
when you don't know what your own vars can do :dancers: typical pebcac. that's how we learn and evolve :rocket: there is a "BatchFlushEvery" variable in the testapp. this was...
this is very interesting now. tuned some numbers from the app and bbolt runs smoothly :rofl: do batchflushing every 15sec in the app to bbolt and delayed workers to start...
nested buckets are back in game again and working too. no issues. let's go to the moon, new target: 1b keys. 100M it is doing laughingly. 256 workers, one for...
the most interesting point to look at while debugging is the splitTwo() function in bbolt:node.go ```go log.Printf("%d splitTwo returned@ pagesize='%d' n.inodes=%d/%d*2 threshold=%d splitIndex=%d fillPercent=%f", now, pageSize, len(n.inodes), common.MinKeysPerPage, threshold, splitIndex,...
hi! i'm debugging the hell out of bbolt and maybe i've found something in db.go Batch() in this [line ](https://github.com/etcd-io/bbolt/blob/233156a53aebc333337d8dc7b350271c9611591f/db.go#L930) ```go if (db.batch == nil) || (db.batch != nil &&...
maybe i got something that can help ` ###DEBUG START 1698163402996429837### 2023/10/24 18:03:23 1698163402996429837 WARN db.go: (121b) run() b.db.batch != b ??? 2023/10/24 18:03:23 1698163402996429837 !!! b.db.batch='&bbolt.batch{db:(*bbolt.DB)(0xc0097d2fc0), timer:(*time.Timer)(0xc00ba2e2d0), start:sync.Once{done:0x0, m:sync.Mutex{state:0,...
i don't know how it works on ext4 or any other filesystem. because, in iotop i can see the app writing with insane bandwidth but zfs does show nothing of...
this debugging branch is a bit messed up but maybe this works. thus don't know if anyone can follow. :dancers: [here this line 927 Batch()](https://github.com/go-while/bbolt/blob/b879cc58350209146f23afa682f34cf85aa8f529/db.go#L927) is a clean approach i'd...