foundationdb icon indicating copy to clipboard operation
foundationdb copied to clipboard
verified publisher icon apple

Validate data consistency

Open liquid-helium opened this issue 3 years ago • 71 comments

Added TriggerAuditRequest CC/DD APIs.

It can start a storage audit process, currently, it picks two storage server from each side of a HA configuration for a keyrange, and compare the key/values.

A TriggerAuditRequest is processed first by DD, it breaks down the audit into sub-tasks, and select a storage server to execute each sub-task. E.g., DD can select storage servers based on their keyrange assignment, and each storage server will read the range locally and fetch the same range from a remote server in a different cluster, and compare the data.

Code-Reviewer Section

The general pull request guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

  • [ ] The PR has a description, explaining both the problem and the solution.
  • [ ] The description mentions which forms of testing were done and the testing seems reasonable.
  • [ ] Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

  • [ ] This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or main if this is the youngest branch)
  • [ ] There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

liquid-helium avatar Sep 01 '22 18:09 liquid-helium

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: cade0baf7ecdd5907d7079e81e0901a22d605ede
  • Duration 0:04:55
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 01 '22 18:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: cade0baf7ecdd5907d7079e81e0901a22d605ede
  • Duration 0:05:07
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 01 '22 18:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: cade0baf7ecdd5907d7079e81e0901a22d605ede
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 01 '22 18:09 fdb-windows-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 033741daab715477557c791ec14fa7ea9791e186
  • Duration 0:04:50
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 02 '22 17:09 foundationdb-ci

Result of foundationdb-pr-macos on macOS BigSur 11.5.2

  • Commit ID: 033741daab715477557c791ec14fa7ea9791e186
  • Duration 0:04:59
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 02 '22 17:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 033741daab715477557c791ec14fa7ea9791e186
  • Duration 0:06:27
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 02 '22 17:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 033741daab715477557c791ec14fa7ea9791e186
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 02 '22 17:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 68ea3267384e822e2a79ecff2c5c80b5cddd32aa
  • Duration 0:03:49
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 02 '22 19:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 68ea3267384e822e2a79ecff2c5c80b5cddd32aa
  • Duration 0:03:52
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 02 '22 19:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 68ea3267384e822e2a79ecff2c5c80b5cddd32aa
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 02 '22 20:09 fdb-windows-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 6f4d09f947c104855351fef2f54381eb8f122317
  • Duration 0:04:34
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 05 '22 19:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 6f4d09f947c104855351fef2f54381eb8f122317
  • Duration 0:04:45
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 05 '22 19:09 foundationdb-ci

Result of foundationdb-pr-macos on macOS BigSur 11.5.2

  • Commit ID: 6f4d09f947c104855351fef2f54381eb8f122317
  • Duration 0:05:01
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 05 '22 19:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 6f4d09f947c104855351fef2f54381eb8f122317
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 05 '22 20:09 fdb-windows-ci

Doxense CI Report for Windows 10

  • Commit ID: ad11c6e82d04f4919d49b0e1fabd5a10b5a27c4f
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 07 '22 02:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: ad11c6e82d04f4919d49b0e1fabd5a10b5a27c4f
  • Duration 0:46:57
  • Result: :x: FAILED
  • Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 07 '22 02:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: ad11c6e82d04f4919d49b0e1fabd5a10b5a27c4f
  • Duration 3:41:51
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 07 '22 05:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 071ed41caa77557aea5a1cf2d49fb334892f9aff
  • Duration 0:05:11
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 05:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 071ed41caa77557aea5a1cf2d49fb334892f9aff
  • Duration 0:05:45
  • Result: :x: FAILED
  • Error: Error while executing command: if [[ $(git diff --shortstat 2> /dev/null | tail -n1) == "" ]]; then echo "CODE FORMAT CLEAN"; else echo "CODE FORMAT NOT CLEAN"; echo; echo "THE FOLLOWING FILES NEED TO BE FORMATTED"; echo; git ls-files -m; echo; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 05:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 071ed41caa77557aea5a1cf2d49fb334892f9aff
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 08 '22 06:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 0f363d48e1bac726e184703839b3631a27bcb325
  • Duration 0:03:55
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 22:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 0f363d48e1bac726e184703839b3631a27bcb325
  • Duration 0:03:55
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 22:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: d53feb871b5dc84323652108d3a3b7cd294023bf
  • Duration 0:11:14
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 23:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: d53feb871b5dc84323652108d3a3b7cd294023bf
  • Duration 0:11:18
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 23:09 foundationdb-ci

Result of foundationdb-pr-macos on macOS BigSur 11.5.2

  • Commit ID: 9e911956d9d2c520f89e6279ca93542032f0aab4
  • Duration 0:30:39
  • Result: :x: FAILED
  • Error: Error while executing command: ssh -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -i ${HOME}/.ssh_key ec2-user@${MAC_EC2_HOST} /usr/local/bin/bash --login -c ./build_pr_macos.sh. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 23:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 0f363d48e1bac726e184703839b3631a27bcb325
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 08 '22 23:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 9e911956d9d2c520f89e6279ca93542032f0aab4
  • Duration 0:49:54
  • Result: :x: FAILED
  • Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 08 '22 23:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: baedc1f709fb4f73c1f8d339599e793dbf3bdf84
  • Result: :x: FAILED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 09 '22 00:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: baedc1f709fb4f73c1f8d339599e793dbf3bdf84
  • Duration 0:47:03
  • Result: :x: FAILED
  • Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 09 '22 00:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: baedc1f709fb4f73c1f8d339599e793dbf3bdf84
  • Duration 2:43:09
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 09 '22 02:09 foundationdb-ci