piped-processing-language icon indicating copy to clipboard operation
piped-processing-language copied to clipboard

Features planned & comprehensive data manipulation

Open dumblob opened this issue 4 years ago • 2 comments

Looks like an interesting initiative.

  1. I wonder what are the planned features (I couldn't find any list nor description, nothing...)?

  2. And second whether one of the main goals is to create a comprehensive language for data manipulation (I'm deliberately not saying a programming language - i.e. no turing-complete computation per se, but rather focus on data manipulation in time - i.e. feedback loops, splitting, merging, changing frequency, reshaping data samples, synchronously/blocking joining, asynchronously/non-blocking joining, recoding data samples, runtime arbitrary creation & deletion of pipes based on inputs, full type safety (incl. null/none/nil safety), pipe-based-feedback-loop error handling, push/pull semantics choice anywhere in the graph, pipes in pipes, etc.)?


Disclaimer: I'm into pipe "languages" focused on user interaction (in its simpliest form imagine something like the implicit | prettyprint nushell has).

dumblob avatar Oct 14 '21 20:10 dumblob

https://github.com/opensearch-project/sql/blob/main/docs/user/ppl/index.rst

anirudha avatar Nov 16 '21 18:11 anirudha

I now learned this repo is obsolete (https://github.com/opensearch-project/piped-processing-language/issues/18#issuecomment-1540950868 ). Is there any successor?

Btw. the link to the heavily unfinished documentation unfortunately did not shed enough light on the questions I raised.

Would you have some more recent information regarding the two questions? Thanks!

dumblob avatar Jun 13 '23 09:06 dumblob