ahocorasick
ahocorasick copied to clipboard
iohub
A fast and memory efficient implementation of aho-corasick algorithm based on double-array trie (cedar), supports visualizing structure via graphviz.
```go queryData := `xxxxxx` kvs := map[string]ValutType{....} // about 1w keys m := NewMatcher() for i:=0; i < 10; i++ { m := NewMatcher() for k, v := range kvs...
I run a simple test to count the number of occurrence for every keyword, but the result seems incorrect. For the benchmark [testdata](https://github.com/iohub/ahocorasick/tree/master/benchmark/en), the number of keyword "abbe" should be...
I build with 4000W key-value,occur erro fatal error: runtime: out of memory runtime stack: runtime.throw(0x5069d0, 0x16) /home/work/local/go/src/runtime/panic.go:1116 +0x72 runtime.sysMap(0xc664000000, 0x400000000, 0x5f6438) /home/work/local/go/src/runtime/mem_linux.go:169 +0xc6 runtime.(*mheap).sysAlloc(0x5dc060, 0x400000000, 0x429d17, 0x5dc068) /home/work/local/go/src/runtime/malloc.go:727 +0x1e5 runtime.(*mheap).grow(0x5dc060,...
I'm getting transient errors when trying to create multiple automaton in different threads. I keep getting panic: runtime error: index out of range [-x] errors that pop up in different...
just wondering if it would be possible to cache the tried data structure in redis with this package.. this will help in being able to load the strings one time...
