d6tflow
d6tflow copied to clipboard
Reconfigure save() option to point to external store
Is there a method by which you could configure d6tflow to save a result of the output outside of a local filesystem. For example, if you do not have the memory to save large datasets from spark into your local development environment, is there a way to configure d6tflow to reference that environment instead of its local path?
This is an important but also somewhat involved topic. Can you pick a time to discuss in more detail? https://calendly.com/databolt/30min