webhdfs icon indicating copy to clipboard operation
webhdfs copied to clipboard

Glob support?

Open minaguib opened this issue 11 years ago • 1 comments

Hi

Currently issuing something like client.get("/foo/*/bar") always results in {"RemoteException":{"exception":"FileNotFoundException"...}}

Compared to the CLI "hdfs dfs -ls '/foo/*/bar'" which lists the matches as expected.

Do you know whether the webhdfs API has any support for globbing or it's done purely client-side ? If so, any chance it could be added to ruby-webhdfs ?

minaguib avatar Jan 06 '14 16:01 minaguib

As far as I know, file globs are not supported on webhdfs APIs.And client side globing needs high runtime cost and latency.

From the same viewpoint of hdfs dfs commands, we may be able to support globs on WebHDFS::FileUtils methods.(Patches welcome!)

tagomoris avatar Jan 11 '14 03:01 tagomoris