disdat
disdat copied to clipboard
kyocum
Data science tool for creating and deploying pipelines with versioned data
This is a feature request. Currently you must return all local files or all remote (s3) files in a bundle column. I.e., `b.data = ["/some/file", "/some/otherfile"]` is valid, but `b.data...
I need to have my workflow reference a system command that is installed via `apt-get install ...`. Is there a way to allow the dockerize step to build a custom...
We sys.exit(1) if we try to initialize an already initialized disdat home directory. It shouldn't be an error, it should just create a message and return.
although much of disdat output uses python logging, there are still many print statements that make it difficult to filter out unwanted verbose output for users of disdat library
i get this a lot when i have an error (on my side) creating a bundle: MOONSCAPE INFO - creating bundle "inputs" with job_id=e549985059fa49008b3ecbaa239b8191 disdat ERROR - Removal of hyperframe...
if api.push is not able to connect and push to a remote, it simply prints (not logs) the error rather, it should throw an exception that can be caught by...
proposal is for calls like `api.local_context_exists()` and `api.remote_context_exists(,)`
Disdat checks for the ability to find dynamo, but that requires an aws region. For now, we don't use dynamo, but we're also spitting out an error that the region...
The behavior should be that it is not a file, then ignore it (treat as string).
Provide a third name to allow users and the system to identify "same data." For each Frame in the bundle HyperFrame, hash key and contents. If it is a link...