cloudfuse icon indicating copy to clipboard operation
cloudfuse copied to clipboard

Files not showing / displaying / listing for .CDN_ACCESS_LOGS/ RackSpace log directory.

Open SCREWY opened this issue 12 years ago • 3 comments

RackSpace Support Suggested I post this issue here:

I have a mounted CDN parent directory with several subdirectories.

meuser@mydomain: ~$ cdn total 4.0K d-------wx 2 root root 0 Dec 31 1996 ./ drwxr-xr-x 3 root root 4.0K Feb 11 2012 ../ d-------wx 2 root root 0 Sep 11 20:01 .CDN_ACCESS_LOGS/ d-------wx 2 root root 0 Sep 11 20:01 cloudservers/ d-------wx 2 root root 0 Sep 11 20:01 mymainbackups/ d-------wx 2 root root 0 Sep 11 20:01 mymainfiles/

I automount at boot using /etc/crontab. Everything works great except that I can not see the files in the .CDN_ACCESS_LOGS/ directory.

I can read/write/delete etc all the files in all of the subdirectories except for .CDN_ACCESS_LOGS/

In actuality, there are 4 log files in .CDN_ACCESS_LOGS/ which I can see through the RackSpace control panel.

meuser/2012/07/30/19/317ea70e8f004ac386cfffbf51adac9.log.gz meuser/2012/07/30/20/241f5a989cb44896b916f2aaf134f6c.log.gz meuser/2012/08/11/20/749ce9176fa64bb9babe9b3e65ea7c9.log.gz meuser/2012/08/12/15/5cb28ac4f00747a0b7cd0835f7823e6.log.gz

I can open the .CDN_ACCESS_LOGS/ directory on the server, but it appears empty.

The files are not hidden, they just don't show up.

Becoming root does not help.

I have restarted and remounted using the following (which results in 003 and 644 permissions, respectively): modprobe fuse cloudfuse /media/cloudfiles -o allow_other,umask=774,nonempty (and umask=133)

Also tried the following (which results in 755 permissions): modprobe fuse cloudfuse /media/cloudfiles -o allow_other,nonempty

But to no avail.

I can not rationalize the behavior of this one CDN mount subdirectory using CloudFuse. Neither can RackSpace Support.

SCREWY avatar Sep 14 '12 00:09 SCREWY

This may be related... I had a hard time with some directories just vanishing from view. Upon digging, they were not being returned by the RackSpace API when sending the &path= parameter. After some discussion with their support team, it seems that "&path=" is deprecated. They recommend using "&delimiter=" and "&marker=" instead.

I've made some (perhaps blundering) patches to the revision of CloudFuse that I'm using (I'm back on the one where it supports >10k files per response; the current master seems to have lost this). Perhaps this would help you?

For my problem it was quite hard to figure out the criteria causing it, just like it is with your problem. In a given directory, ls | wc -l prior to the fix returns 9024, and afterward, returns 9159. Just shows how random it is. In my case, the missing directories always ended in _10 or _20, strangely enough (I have sets of directories that are numbered _1, _2, etc).

Anyway, the fix that makes things peachy for me: https://dl.dropbox.com/u/4592587/cloudfsapi.c

Best of luck! Chris Michaelis

cmichaelis avatar Sep 19 '12 17:09 cmichaelis

@cmichaelis can you reupload this file (it's not available anymore)?

lukasztackowiak avatar Dec 20 '12 14:12 lukasztackowiak

Sorry about that - being a neat freak, I tend to clean up my dropbox folders quite often. :)

I'd like to attach it here, but it will only allow images. Thus, save the attached image and rename it to .c, and there you go.

Cheers, Chris

cloudfsapi c

cmichaelis avatar Dec 20 '12 16:12 cmichaelis