zed
zed copied to clipboard
brimdata
A novel data lake based on super-structured data
Is there a way to add a field with RE2 named capture groups? ``` zq -Z '/total (?P\S+)/' -
In the reference Grok implementation that comes from Logstash, fields referenced in patterns may use a square bracket notation to indicate when a nested field should be created to hold...
A community user asked in a recent [Slack thread](https://brimdata.slack.com/archives/C03MW6XT7HC/p1701719184160869?thread_ts=1701288001.536269&cid=C03MW6XT7HC): > I keep getting CSV files where I have to skip rows before the header - things like pandas and knime...
In researching #2345, data set we're considering using happens to be stored as an sqlite DB. While the sqlite tools provide JSON/CSV export options that allow the data to make...
The reference Grok implementation has a `:type` "type conversion" syntax that may appear in patterns. This is not yet supported in Zed's `grok()` function. ## Details From [Elastic's page for...
For queries that are flow insensitive, the same parallelization logic that we use for lake can also apply to streams (e.g., zq or internal readers like ingest). We should logic...
A recent feature idea from @jameskerr: > I’ve been wanting an operator that breaks early from a pipeline for debugging. It would be the equivalent of commenting out all the...
A user that forks the Zed repo using GitHub defaults and then tries to run the tests will see these failures. ``` $ make test-system % Total % Received %...
The following doesn't work, but probably should. ``` $ echo '{id:{orig_h:10.164.94.120,orig_p:39681(port=uint16),resp_h:10.47.3.155,resp_p:3389(port)}}' | zq -Z 'rename dst:=id.resp_h' - rename: left-hand side and right-hand side must have the same depth (dst vs...