datapackage-pipelines icon indicating copy to clipboard operation
datapackage-pipelines copied to clipboard

[dataflows] revisit loading multiple sheets with one load step

Open cschloer opened this issue 5 years ago • 4 comments

see https://github.com/datahq/dataflows/pull/110

@roll

cschloer avatar Apr 29 '20 09:04 cschloer

Thanks @cschloer

I'll take a look

roll avatar Apr 30 '20 05:04 roll

Hi @cschloer,

The only thing left is integrating goodtables into dataflows/datapackage pipelines.

Does this mean that this issue is not needed anymore?

roll avatar Jul 27 '20 12:07 roll

This would still be great, but as I said in the linked issue we already have the "batch load" concept in our custom load step. And I guess since you said you didn't think the tabulator.Collections solution would be possible in this stage of the pilot, maybe it makes sense to remove it?

cschloer avatar Jul 28 '20 10:07 cschloer

Yes, I think it's better to remove it from this stage. I hope in a few months it will be ready so you will be able to rebase from your custom processor

roll avatar Jul 28 '20 10:07 roll