spyql

spyql copied to clipboard

We started by putting some recipes at the README, but at some point we will have to write documentation. Proposed tools: - https://www.sphinx-doc.org/ - https://readthedocs.org/ Example: https://github.com/pallets/click/blob/main/docs/options.rst

dcmoura

dcmoura

This is a backlog to be converted into issues as we go 😅 🔨 ### Backlog (after 1st release) #### Tentative (but unlikely) - [x] add badges to Readme.md: https://dev.to/ananto30/how-to-add-some-badges-in-your-git-readme-github-gitlab-etc-3ne9...

dcmoura

Allow `json->*` and `json->afield->*` for horizontal explosion. - [ ] Gather set of fields based on sample from the input (keys not present in the sample will be excluded) -...

dcmoura

Add methods to `NullSafeDict` to help working with dicts: - [ ] `dict.with(k, v)`: returns dict with new/updated pair - [ ] `dict.drop(k1, k2, k3)`: return dicts without keys (does...

dcmoura

This PR closes #59. First, it introduces `dict_agg` for key-value aggregations. Example: ``` $ cat codes.csv (git)-[key-value] MCC,MCC (int),MNC,MNC (int),ISO,Country,Country Code,Network 289,649,88,2191,ge,Abkhazia,7,A-Mobile 289,649,68,1679,ge,Abkhazia,7,A-Mobile 289,649,67,1663,ge,Abkhazia,7,Aquafon 412,1042,01,31,af,Afghanistan,93,AWCC 412,1042,50,1295,af,Afghanistan,93,Etisalat 412,1042,30,783,af,Afghanistan,93,Etisalat 452,1106,04,79,vn,Vietnam,84,Viettel 452,1106,02,47,vn,Vietnam,84,VinaPhone 543,1347,299,665,wf,Wallis...

dcmoura

[Feature request] Define data access interface

1

I really appreciate spyql flexibility and the fact that it supports many formats, but what if I want to add my own format support?:slightly_smiling_face: My use case: I have custom...

ivaigult

[Feature request] Support multiple tables in FROM clause

1

The [documentation](https://github.com/dcmoura/spyql/blob/master/docs/queries.rst ) suggests that only one table is supported in FROM clause: > [ FROM csv | spy | text | python_expression | json [ EXPLODE path ] ]...

ivaigult

improve error messaging when I'm holding it wrong

1

This is probably related-ish to #83. I saw a note about this, thought "hey what a cool tool", tried to write things that would use spyql to read json. Consistently...

seebs

[FR] join 2 CSV files

9

Hi @dcmoura , I see examples to join a JSON file in the document, would joining 2 CSV files be supported? https://spyql.readthedocs.io/en/latest/recipes.html?highlight=join#equi-joins

Minyus