Other issues

[dcmoura]

This is a backlog to be converted into issues as we go 😅 🔨

Backlog (after 1st release)

Tentative (but unlikely)

• [x] add badges to Readme.md: https://dev.to/ananto30/how-to-add-some-badges-in-your-git-readme-github-gitlab-etc-3ne9
• [ ] Better handling of dates constants. e.g. instead of datetime.datetime(2020,11,10,19,55,03) use $2020-11-10 19:55:04$ or to_datetime('2020-11-10 19:55:04')

Next

• [x] prev object/dict/list/function (choose) with data from the previous line, e.g. prev(col1) or prev->col1
• [ ] EXECUTE clause to execute python statements for each row. e.g. create a variable to simplify query: EXECUTE cust = json->order->customer SELECT cust->id, cust->name, cust->age FROM JSON.

Later / ideas

• [ ] Other file formats: ARFF, XML, YAML, ...
• [ ] When writing to SQL, CREATE TABLE IF NOT EXISTS - data types vary w/ the DB - (look at csvsql: https://github.com/wireservice/csvkit))
• [ ] aggregates options (print every record, print every x sec, by window)
• [ ] windows + watermarks (streaming) ?
• [ ] read from files (with wildcards)
• [ ] window functions: percentile, median (only on sorted input)
• [ ] when reading from files, get file size info to make planning decisions