Noah Watkins

turns out the issue i was observing was actually because the read immediately after the txn committed was not taking the db lock when copying the root pointer. otherwise the...

The parameter `ceph.root.dir` is the mount point directory (https://github.com/ceph/ceph/blob/master/src/include/cephfs/libcephfs.h#L241). When you set it to "/" or the default, then things work OK? If you set `ceph.root.dir` to `/hadoop-dir` you'll probably...

Since `native_ceph_get_pool_id` will just lookup the name of a pool, the error seems to suggest that either the pool name is invalid, or the mount context is invalid. The later...

HI @wwang-pivotal I'll take a look at this this week. If the changes aren't major then it shouldn't take more than an a day or two. Patches welcome too :)

Thank @m0zes. I've dropped the ball on 2.7, but I have some updates pending for that. I've only heard of a few problems with 2.6, and in those cases there...

Wow, nothing there looks suspicious at first glance. The usual suspect is a mismatch between our bindings and what Hadoop expects, which seems to diverge occasionally. What version of Ceph...

There hasn't been much work on this. I don't have a lot of time to work on this in the short term, but would be happy to offer basic support....

Hi @hellertime the cephfs-hadoop shim is a thin layer over the cephfs userspace client (that in turn is the basis for the fuse client) so it probably isn't the shim...

@hellertime I haven't used spark on the hadoop-shim, but in the past I found with a little poking around in hadoop or a hadoop application I could find some dangling...

could be a race with process exiting and the error merely needs to be ignored. but could be terrible.