daos icon indicating copy to clipboard operation
daos copied to clipboard

DAOS-17637 vos: support to mark corruption on object/{d,a}key - b26

Open Nasf-Fan opened this issue 7 months ago • 26 comments

Sometimes. when rebuild, we may have not enough information to rebuild some object or {d,a}key. Under such case, we need to add some flags on the target, then subsequent operation, such as read data from such bad target can properly return errno to indicate some data lost. Otherwise it will cause sclient data corruption.

For such purpose, we introduce new VOS API: vos_obj_mark_corruption(). It allows server side caller to mark the specified object or {d,a}key as corrupted. Any subsequent online operation against such bad target, except discard, will get -DER_DATA_LOSS failure.

The user/admin can use ddb (rm) to remove corrupted target to release related space.

Signed-off-by: Fan Yong [email protected]

Steps for the author:

  • [ ] Commit message follows the guidelines.
  • [ ] Appropriate Features or Test-tag pragmas were used.
  • [ ] Appropriate Functional Test Stages were run.
  • [ ] At least two positive code reviews including at least one code owner from each category referenced in the PR.
  • [ ] Testing is complete. If necessary, forced-landing label added and a reason added in a comment.

After all prior steps are complete:

  • [ ] Gatekeeper requested (daos-gatekeeper added as a reviewer).

Nasf-Fan avatar Jun 09 '25 15:06 Nasf-Fan

Ticket title is 'Support to mark corrupted object or key' Status is 'Awaiting backport' Labels: '2.8pp,request_for_2.6.5' https://daosio.atlassian.net/browse/DAOS-17637

github-actions[bot] avatar Jun 09 '25 15:06 github-actions[bot]

Test stage Build RPM on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-16492/4/display/redirect

daosbuild3 avatar Jun 09 '25 17:06 daosbuild3

Test stage Build RPM on EL 8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-16492/4/display/redirect

daosbuild3 avatar Jun 09 '25 17:06 daosbuild3

Test stage Build RPM on Leap 15.5 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-16492/6/display/redirect

daosbuild3 avatar Jun 10 '25 10:06 daosbuild3

Test stage Build RPM on EL 8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/9/execution/node/328/log

daosbuild3 avatar Jun 11 '25 05:06 daosbuild3

Test stage Build RPM on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/9/execution/node/331/log

daosbuild3 avatar Jun 11 '25 05:06 daosbuild3

Test stage Build RPM on Leap 15.5 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/9/execution/node/327/log

daosbuild3 avatar Jun 11 '25 05:06 daosbuild3

Test stage Unit Test on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/9/testReport/

daosbuild3 avatar Jun 11 '25 06:06 daosbuild3

Test stage Unit Test bdev on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/9/testReport/

daosbuild3 avatar Jun 11 '25 06:06 daosbuild3

Test stage Build RPM on EL 8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/10/execution/node/323/log

daosbuild3 avatar Jun 11 '25 09:06 daosbuild3

Test stage Build RPM on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/10/execution/node/338/log

daosbuild3 avatar Jun 11 '25 10:06 daosbuild3

Test stage Build RPM on Leap 15.5 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/10/execution/node/324/log

daosbuild3 avatar Jun 11 '25 10:06 daosbuild3

Test stage Unit Test on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/10/testReport/

daosbuild3 avatar Jun 11 '25 10:06 daosbuild3

Test stage Unit Test bdev on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/10/testReport/

daosbuild3 avatar Jun 11 '25 10:06 daosbuild3

Test stage Build RPM on EL 8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/11/execution/node/335/log

daosbuild3 avatar Jun 11 '25 14:06 daosbuild3

Test stage Build RPM on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/11/execution/node/327/log

daosbuild3 avatar Jun 11 '25 15:06 daosbuild3

Test stage Build RPM on Leap 15.5 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/11/execution/node/331/log

daosbuild3 avatar Jun 11 '25 15:06 daosbuild3

Test stage Unit Test with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/12/testReport/

daosbuild3 avatar Jun 17 '25 05:06 daosbuild3

Test stage Unit Test bdev with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/12/testReport/

daosbuild3 avatar Jun 17 '25 05:06 daosbuild3

Test stage Unit Test bdev with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/13/testReport/

daosbuild3 avatar Jun 19 '25 15:06 daosbuild3

Test stage Unit Test with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/13/testReport/

daosbuild3 avatar Jun 19 '25 15:06 daosbuild3

Test stage Unit Test with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/14/testReport/

daosbuild3 avatar Jun 19 '25 17:06 daosbuild3

Test stage Unit Test bdev with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/14/testReport/

daosbuild3 avatar Jun 19 '25 17:06 daosbuild3

Test stage Functional Hardware Large completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/14/execution/node/1354/log

daosbuild3 avatar Jun 19 '25 22:06 daosbuild3

Test stage Unit Test with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/15/testReport/

daosbuild3 avatar Jun 20 '25 02:06 daosbuild3

Test stage Unit Test bdev with memcheck on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-16492/15/testReport/

daosbuild3 avatar Jun 20 '25 02:06 daosbuild3

Test stage Functional Hardware Large completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-16492/18/execution/node/1439/log

daosbuild3 avatar Nov 03 '25 11:11 daosbuild3

Decision in staff not to backport to 2.6.5

Nasf-Fan avatar Nov 08 '25 01:11 Nasf-Fan