Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mounting file systems #91

Open
lucapette opened this issue Jan 12, 2024 · 0 comments
Open

Mounting file systems #91

lucapette opened this issue Jan 12, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@lucapette
Copy link
Contributor

lucapette commented Jan 12, 2024

This issue is for the milestone “mounting file systems”.

One of the fundamental Ideas we “stole” from UNIX is that everything is a stream in TypeStream so it’s only fair to imagine features that allow us to source/sink streams of data via mount points.

The long term plan it to provide TypeStream developers with the ability to express non-trivial pipelines with a very terse syntax, for example:

cat /mnt/postgres/db1/tables/table | grep something > /mnt/http/server1

While the feature is a significant investment, it opens the door to a number of amazing features (like “one command db to kafka sync” or “one liner to ingest/expose topics via http” ) in line with TypeStream long term vision of simplifying the user experience of building streaming data pipelines. It also requires a number of improvements we never got around to (specifically the revamping of the server configuration) and research on the “right” semantics for each filesystem type.

Here’s a (draft) list of the features that are part of this milestone (we’ll convert them into issues soon):

@lucapette lucapette added the enhancement New feature or request label Jan 12, 2024
@lucapette lucapette added this to the Mounting file systems milestone Jan 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant