file not found errors not logged to billing in all cases

[calestyo]

trafficstars

Hey.

This is on dCache 9.1.2.

I've noted by accident, that (at least) file not found errors do sometimes not make it into the billing logs.

E.g.: /pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.json exists, /pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.jsonA does not exist.

Now any of

xrdcp xroot://lcg-lrz-rootd.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.json foo
curl -v --capath /etc/grid-security/certificates/ -E /tmp/x509up_u1000 -L https://lcg-lrz-http.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.json   -o foo
gfal-copy -vvv  xroot://lcg-lrz-rootd.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.json foo
gfal-copy -vvv  davs://lcg-lrz-http.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.json foo

gives a billing log entry with status 0:""

And

xrdcp xroot://lcg-lrz-rootd.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.jsonA foo

Gives a billing log entry with status 10001:"No such file or directory /pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.jsonA"

So far so good.

But any of:

curl -v --capath /etc/grid-security/certificates/ -E /tmp/x509up_u1000 -L https://lcg-lrz-http.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.jsonA   -o foo
gfal-copy -vvv  xroot://lcg-lrz-rootd.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.jsonA foo
gfal-copy -vvv  davs://lcg-lrz-http.grid.lrz.de/pnfs/lrz-muenchen.de/data/atlas/meta/storage-descriptor.jsonA foo

give just nothing in billing, which seems wrong.

Cheers, Chris.

[kofemann]

Hi Chris,

billing entries log transfers. If the file doesn't exist, then there is no transfer, thus no billing entry. If you want to track any access, then check /var/log/dcache/xx.access file.

[calestyo]

But why does it work then in case of xrdcp?

[kofemann]

Just as simplification of xroot door implementation.

[calestyo]

Well.. still pretty strange, that it depends on the client... it works with xrdcp, but not with gfal-copy and xrootd.

But apart from that, it would IMO be simply nice to have that information in billing, too.