zed
zed copied to clipboard
brimdata
A novel data lake based on super-structured data
Converting multiple pools to one pool (virtual) Hello I have a lot of pools though it is possible to search them all. But I have a small problem I have...
Some changes worth trying before vng is stabilized: * Don't use containers for primitives. * For fixed-length types just concatenate all the bytes. Reading can be zero-copy. * For integers,...
e.g., primary, second etc keys should be allowed for pools. The data structures are all set up for this but the compiler and optimizer currently assume a single primary key....
Repro is with Zed commit efdcd27. Imagine you have an complex value such as the array of numbers `[1, 4, 9, 16]` and you want to execute some function on...
A community user discovered that the fix for #2779 did not cover nested records. ## Details Repro is with Zed commit 40a7db8. (The initial repro of this issue was with...
Neither the zng reader nor zed.NewValue does any validation, so reading a bad zng file can produce eg Float64s with 2 bytes, which blow up in later code.
For example: ``` package main import ( "bytes" "fmt" "github.com/brimdata/zed" "github.com/brimdata/zed/zbuf" "github.com/brimdata/zed/zio" "github.com/brimdata/zed/zio/zngio" //"github.com/brimdata/zed/zcode" //"github.com/brimdata/zed/zson" ) func main() { bytesReader := bytes.NewReader([]byte("\x14\x00\x1b\x01\x100")) context := zed.NewContext() reader := zngio.NewReader(context, bytesReader) var...
[This loop](https://github.com/brimdata/zed/blob/47cdb95d319d4679cb0a2d3bba86a5a62ce7c4bb//value.go#L445) never ends because [Untag returns typ, nil](https://github.com/brimdata/zed/blob/47cdb95d319d4679cb0a2d3bba86a5a62ce7c4bb//complex.go#L343). To repro: ``` > dlv debug cmd/zq/main.go -- 'yield cast(this, ) | yield this.x' ~/test.json (dlv) break github.com/brimdata/zed.(*Value).Under Breakpoint 1 set...
To reproduce: ``` > git checkout origin/jamii-fuzz-vng-repro > cd vng > ZED_USE_DICT=1 go test -fuzz FuzzVngRoundtripGen/f5c94e3a7a95e75c --- FAIL: FuzzVngRoundtripGen (0.00s) --- FAIL: FuzzVngRoundtripGen/f5c94e3a7a95e75c (0.00s) panic: runtime error: slice bounds out...
To reproduce: ``` > git checkout origin/jamii-fuzz-vng-repro > cd vng > ZED_USE_DICT=1 go test -run FuzzVngRoundtripGen/0169eec3758e54cb --- FAIL: FuzzVngRoundtripGen (0.00s) --- FAIL: FuzzVngRoundtripGen/0169eec3758e54cb (0.00s) vng_test.go:123: comparing: len(in)=2 vs len(out)=2 vng_test.go:132:...