Caleb Van Dyke

Results 36 issues of Caleb Van Dyke

Works fine with buildflow run or when dataclass is in separate file

if you have low throughput with massive fan out it will actually be better to use loads jobs, we should support this option.

gcp
io

Right now we just fail when we start but things still attempt to start. Ideally this would kill the pipeline immediately.

io

Some more file types: JSON, Avro, CSV

enhancement
io