go-while
go-while
i need some help. i'm working with 16 dbs at a time, still trying to find out what my problem is. the test app in my link from first post...
is creating one now. with values: 16 dbs (always const) 256 root.buckets and 256 sub.buckets 4 KB pagesize untouched bbolt from github RootBucketFillPercent = 0.3 SubBucketFillPercent = 0.3 not sure...
[cpu prof](https://github.com/go-while/nntp-history/blob/main/test/cpu.pprof.1697646197) [log file](https://github.com/go-while/nntp-history/blob/main/test/cpu.pprof.1697646197.log.gz) thank you!
what GPT says to PEEK log from profile Certainly, here's a summary of the functions that consumed the most CPU time, along with their line endings: 1. `github.com/go-while/nntp-history.(*L3CACHE).L3Cache_Thread.func2` (line ending:...
go-while/nntp-history/L3CACHE.go:143 ```go //getexpired: for key, item := range ptr.cache { ``` go-while/nntp-history/L1CACHE.go:210 ```go //getexpired: for hash, item := range ptr.cache { ``` go-while/nntp-history/L2CACHE.go:152 ```go //getexpired: for offset, item := range...
ok cool all bad map iters are gone and found queue congestion which should be fixed, but the problem with the writes is still happening. will pull it after some...
```sh 2023/10/19 07:12:50 1697692370252293163 split() pagesize='4096' nodes=2 n.inodes=6 common.MinKeysPerPage=2 2023/10/19 07:12:50 splitIndex threshold=3686 2023/10/19 07:12:50 1697692370252496266 splitTwo pagesize='4096' (n.inodes=6 common.MinKeysPerPage=2*2 || n.sizeLessThan=true) threshold=3686 splitIndex=6 2023/10/19 07:12:50 1697692370252502507 split() pagesize='4096' nodes=2...
i can't test on ext4 at the moment. no more hardware. could setup a VM but still zfs on the host. but i don't believe this is fragmentation issue. ZFS...
i dumped my debugs into this tree: https://github.com/go-while/bbolt/tree/debugs with defaults 4KB pagesize and a fresh db i can see this: ```sh 2023/10/19 16:11:05 1697724665147285003 splitTwo determine pagesize='4096' (n.inodes=50 common.MinKeysPerPage=2*2 ||...
with 32KB pagesize ```sh 023/10/19 16:27:28 1697725648796881482 splitTwo determine pagesize='32768' (n.inodes=117 common.MinKeysPerPage=2*2 || n.sizeLessThan=false) 2023/10/19 16:27:28 1697725648796881482 splitIndex forloop index=0 n.inodes=117 n.pageElementSize=16 keyLen=2 valLen=217 elsize=235 sz=16 2023/10/19 16:27:28 1697725648796881482 splitIndex...