data-making-guidelines icon indicating copy to clipboard operation
data-making-guidelines copied to clipboard

Published 20 hours ago • verified publisher icon datamade

Handling Remote Data

Open hunterowens opened this issue 9 years ago • 3 comments

Was wondering if you have been able to integrate make into workflows that require working with remote services/servers? I've generally had to turn to Drake or Luigi in these use cases, but being able to use make in this situation would be great...

hunterowens avatar Apr 29 '15 15:04 hunterowens

Could you describe a concrete use case a little bit more. We use lots of web services to get data, but I'm not sure if that's what you mean?

fgregg avatar Apr 29 '15 19:04 fgregg

More of a working with multiple remote machines or a cluster, I guess...

hunterowens avatar May 05 '15 20:05 hunterowens

Sorry, I still have no idea what you are trying to do? Distributing tasks to many machines? Could you describe a concrete task you did?

fgregg avatar May 05 '15 20:05 fgregg