disdat
disdat copied to clipboard
kyocum
Data science tool for creating and deploying pipelines with versioned data
Issue: Sometimes pip will fail to install a dependency when installing user's source distribution. However the dockerize command continues on and produces a container. When trying to run the pipeline,...
When a user wants to create a remote, a user should supply some command that will create an S3 bucket to use as the remote. The user could provide parameters...
Dsdt pull localize should grab only the latest bundle(s) version unless you pass in like —all-versions
Sometimes lightweight functions (like AWS Lambda's) need to read bundles from remotes. However, the API currently requires Disdat to be initialized (i.e., have a ~/.disdat directory for local contexts). This...
===== Luigi Execution Summary ===== Scheduled 566 tasks of which: * 41 present dependencies were encountered: - 12 xxx - 12 yyyy * 525 ran successfully: - 1 Backfill(...) -...
Currently, tags are part of the bundle definition. One cannot add tags to an existing bundle. Note that some system tags (i.e., the param tags) are used to form the...
When a DataFrame with an index that is not standard (0, 1, 2...) is returned from run, the original index is not present when the DataFrame is loaded into memory...