Dmitry Litvintsev

7.2.17 get NPE when uploading file using WebDAV...

3

I see this in pool log: ```05 Jul 2022 14:28:11 (v-stkendca1911-3) [door:WebDAV-fndca4b-1@webdavDomain:AAXjE9jN2HA WebDAV-fndca4b-1 PoolAcceptFile 00000292C6DF8C8246DF8C4066E7C23F5F8B] Uncaught exception in thread post-transfer-3687 java.lang.NullPointerException: null at org.dcache.notification.BillingMessageSerializer.serialize(BillingMessageSerializer.java:82) at org.dcache.notification.BillingMessageSerializer.serialize(BillingMessageSerializer.java:17) at org.apache.kafka.common.serialization.Serializer.serialize(Serializer.java:62) at org.apache.kafka.clients.producer.KafkaProducer.doSend(KafkaProducer.java:903)...

WebDAV issue on trunk

2

Running this command: curl -L --capath /etc/grid-security/certificates --cert /tmp/x509up_u8637 --cacert /tmp/x509up_u8637 --key /tmp/x509up_u8637 -Tjunk https://fndcaitb4.fnal.gov:2880/pnfs/fnal.gov/usr/test/litvinse/world_readable/test.4 produced error: Internal problem: Protocol Https-1.1:2620:6a:0:87:219:b9ff:fe03:7377:0:WebDAV-fndcaitb4-1:webdavDomain:/pnfs/fnal.gov/usr/pnfs/fnal.gov/usr/test/litvinse/world_readable/test.4 is not supported 7.2 successful: curl -L --capath /etc/grid-security/certificates...

WebDAV uploads leave behind broken files on failure

22

two problems in one: 1) WebDAV transfers fail like so: ``` 02 Feb 2022 19:26:58 (v-stkendca1806-1) [door:WebDAV-fndca4b-1@webdavDomain:AAXXEs+sAog WebDAV-fndca4b-1 PoolAcceptFile 00008FBFF2A3F3B542BCA50AD15FEEF94E90] Transfer failed: Channel idle for too long during upload. ```...

NFS v4.1: fail to copy file from a host, works fine form other hosts

6

In 7.2: on one host: ``` [root@dunegpvm06 litvinse]# time cp /pnfs/dune/persistent/users/hyliao/protodune/proton/v09_26_00/ana/PDSPProd4a_MC_1GeV_reco1_sce_datadriven_v1_nog4rw/mcproton_all.root /dev/null cp: overwrite ‘/dev/null’? y real 1m22.006s user 0m0.128s sys 0m8.804s ``` saw mover on pool :+1: ``` [fndca3b]...

NFS: ls on directory hangs, dCache 7.2

3

dCache 7.2 client : Scientific Linux release 7.9 (Nitrogen) ``` [litvinse@mu2egpvm01 ~]$ ls /pnfs/mu2e/persistent/users/mu2epro/valjob/2022/02/09/summary/ ^C ``` Hangs. ls on parent works: ``` [litvinse@mu2egpvm01 ~]$ time ls /pnfs/mu2e/persistent/users/mu2epro/valjob/2022/02/09/ ceMix ceSimReco cosmicSimReco...

Truncated files

1

Continuing issues of bad files. User report: ``` Error in : file /pnfs/GM2/scratch/daq/2021-10-29-18-14-40/data/gm2preproduction_full_49855919_44135.00292.root is truncated at 700743060 bytes: should be 1242600121, trying to recover Warning in : no keys recovered,...

Potentially seeing double restores in 7.2

7

A user reported inability to access a file that was ONLINE_AND_NEARLINE. Our admin looked and reported that he observed PoolManager restore request while file was available on pool. Which is...

GFTP: Aborted uploads leave 0 length files behind

25

dCache 7.2 Aborted GFTP uploads leave 0 length files behind. Additionally these files are "P"recious on pools and perpetually tried to be written to tape: ``` billing=# select datestamp, connectiontime,...

Uncaught exception in GFTP

5

After upgrade to 7.2 the following exception is seen. I do not believe I have seen it before. ``` 01 Nov 2021 14:37:05 (GFTP0-fndca4b-AAXPv01F4lA) [door:GFTP0-fndca4b-AAXPv01F4lA@gridftp0-fndca4bDomain] Uncaught exception in thread GFTP0-fndca4b-io-51...

NFS: format of show clients changed, unclear how to kill clients now

3

in 5.2 `show clients ` would return ``` 131.225.67.36:876:4c696e7578204e465376342e31206d7532656770766d30332e666e616c2e676f76@6814085741044304387:v4.1 /131.225.67.36:876 : 5e907ee100000a030000000000000001 max slot: 15/4 ``` That number between `@` and `:` is what is called client id it was...