webhdfs
webhdfs copied to clipboard
kzk
Ruby client for Hadoop WebHDFS
when i use webhdfs with kerberos hadoop cluster ``` [hdfs@nfjd-hadoop02-node27 ~]$ irb irb(main):001:0> require 'webhdfs' => true irb(main):002:0> require 'gssapi' => true irb(main):003:0> client = WebHDFS::Client.new('nfjd-hadoop02-node169', 50070) => # irb(main):004:0>...
Added methods to allow use of an SSL certificate/key pair when using FileUtils. Please let me know if there are any issues with the COPYRIGHT file; I'm following Akamai's policy...
We have two namenodes for high availability and get `StandbyException` when using the non-active namenode, which makes sense. ``` WebHDFS::IOError: {"RemoteException":{"exception":"StandbyException","javaClassName":"org.apache.hadoop.ipc.StandbyException","message":"Operation category READ is not supported in state standby"}} from...
This change provides the ability to use the HTTP connection multiple times. The HTTP connection can now be reused over consecutive calls to the same host:port combination. Experience with this...
Hi, First, thank you for a great ruby gem! I am trying to use webhdfs gem with Kerberos auth. It works with a cached kerberos credential, but I am wondering...
We are using WebHDFS through a Knox gateway. This requires: 1. Specifying the gateway and the cluster to the path 2. Support for basic auth Let us know if you...
Effectively something along these lines: http://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FileUtil.html#copyMerge I have an alpha implementation of this inside a project I'm currently working on, but thought it might be a good addition this one...
Hi Currently issuing something like client.get("/foo/*/bar") always results in {"RemoteException":{"exception":"FileNotFoundException"...}} Compared to the CLI "hdfs dfs -ls '/foo/*/bar'" which lists the matches as expected. Do you know whether the webhdfs...
