dcache icon indicating copy to clipboard operation
dcache copied to clipboard

Implement RFC9530: WCLG TPC Data Integrity enhancements

Open labkode opened this issue 3 months ago • 2 comments

Hello colleagues,

I create this request for implementation to follow-up on the agreement to support enhanced data integrity in WLCG TPC transfers, by implementing RFC9530.

The specification of the changes needed is described here: https://github.com/labkode/wlcg-tpc

Slides: https://indico.cern.ch/event/1538346/contributions/6474197/attachments/3053366/5397622/DOMA%20BDT%20TPC%20DATA%20INTEGRITY%20(1).pdf

The implementation for XrootD has already been done and is waiting a release in upcoming XROOTD 6 major version: https://github.com/xrootd/xrootd/pull/2595

Let me know if you have some questions regarding the spec, while Cedric was implementing we had to clarify a few sentences.

Thanks in advance, Hugo

labkode avatar Oct 01 '25 09:10 labkode

Hi @labkode

Thanks for all your work in this area.

As I'm sure you already know, dCache already implements integrity checking when undertaking HTTP-TPC transfers.

There are a few points where the spec might benefit from some further work. I've created a few issued against your repo that try to capture the points and allow for discussion.

Cheers, Paul.

paulmillar avatar Oct 01 '25 22:10 paulmillar

Thanks Paul for jumping into it. I know dCache has already data integrity validation with the old spec so I expect most changes would be syntatic sugar for you.

Let's follow-up on your remarks, I am sure we'll manage to define some behaviours that work for everyone.

labkode avatar Oct 02 '25 06:10 labkode