mrjob icon indicating copy to clipboard operation
mrjob copied to clipboard

Published 20 hours ago • verified publisher icon Yelp

Is there any way to connect to a remote Hadoop cluster?

Open FlorinAndrei opened this issue 4 years ago • 1 comments

Can't find any trace of this in the docs.

Can I run a Python script with mrjob on my laptop, and have it connect to a remote Hadoop cluster over VPN, run the mapreduce job there, get the results back on my local system? I can connect to any Hadoop TCP port just fine from my laptop.

Is there a config or code example for this?

Thanks!

FlorinAndrei avatar Jun 19 '20 20:06 FlorinAndrei

Facing the same issue.

JellyBai avatar Jun 24 '20 06:06 JellyBai