Mounting file systems

[lucapette]

trafficstars

This issue is for the milestone “mounting file systems”.

One of the fundamental Ideas we “stole” from UNIX is that everything is a stream in TypeStream so it’s only fair to imagine features that allow us to source/sink streams of data via mount points.

The long term plan it to provide TypeStream developers with the ability to express non-trivial pipelines with a very terse syntax, for example:

cat /mnt/postgres/db1/tables/table | grep something > /mnt/http/server1

While the feature is a significant investment, it opens the door to a number of amazing features (like “one command db to kafka sync” or “one liner to ingest/expose topics via http” ) in line with TypeStream long term vision of simplifying the user experience of building streaming data pipelines. It also requires a number of improvements we never got around to (specifically the revamping of the server configuration) and research on the “right” semantics for each filesystem type.

Here’s a (draft) list of the features that are part of this milestone (we’ll convert them into issues soon):

• #92
• #93
• #101
• Introduce the HTTP file system type
• Introduce the JDBC file system type