daos icon indicating copy to clipboard operation
daos copied to clipboard

DAOS-17591 dtx: handle orphan DTX entries

Open Nasf-Fan opened this issue 7 months ago • 3 comments

Our current DTX resync mechanism does DTX leader sponsored scanning for the specified container. But if current DTX leader is dead, the new DTX leader will switch to another target on which related entry may be not exist or has been committed. Under such case, DTX resync on the new DTX leader will not handle such DTX entry, as to the DTX entry on other non-leaders may become "orphan".

Such kind of orphan DTX entries may affect subsequent rebuild. This patch introduces DTX orphan cleanup mechanism to handle them before rebuild scanning related container.

Steps for the author:

  • [ ] Commit message follows the guidelines.
  • [ ] Appropriate Features or Test-tag pragmas were used.
  • [ ] Appropriate Functional Test Stages were run.
  • [ ] At least two positive code reviews including at least one code owner from each category referenced in the PR.
  • [ ] Testing is complete. If necessary, forced-landing label added and a reason added in a comment.

After all prior steps are complete:

  • [ ] Gatekeeper requested (daos-gatekeeper added as a reviewer).

Nasf-Fan avatar Jun 06 '25 04:06 Nasf-Fan

Ticket title is 'Active DTX cleanup after global metadata verification' Status is 'In Progress' https://daosio.atlassian.net/browse/DAOS-17591

github-actions[bot] avatar Jun 06 '25 04:06 github-actions[bot]

Test stage NLT on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16482/3/testReport/

daosbuild3 avatar Jun 09 '25 07:06 daosbuild3

Test stage Functional Hardware Medium MD on SSD completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16482/5/testReport/

daosbuild3 avatar Jun 17 '25 22:06 daosbuild3

Test stage NLT on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16482/7/testReport/

daosbuild3 avatar Jul 23 '25 01:07 daosbuild3

Ping reviewers, thanks!

Nasf-Fan avatar Aug 11 '25 01:08 Nasf-Fan

@NiuYawei could you check this patch?

gnailzenh avatar Aug 18 '25 12:08 gnailzenh