cockroach icon indicating copy to clipboard operation
cockroach copied to clipboard

Published 20 hours ago • verified publisher icon cockroachdb

roachtest: cdc/kafka-chaos-multiple-sink-nodes failed

Open cockroach-teamcity opened this issue 1 year ago • 185 comments

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ dc3ebba01015d2c7275aa27af2a54fe88b87e901:

(cluster.go:2417).Run: full command output in run_070318.119852687_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-40275

cockroach-teamcity avatar Jul 13 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1ebd9e1e105cd90ef0bcff47a47369681d165d14:

(cluster.go:2417).Run: full command output in run_070425.179591162_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 14 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1ebd9e1e105cd90ef0bcff47a47369681d165d14:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.065045824s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 14 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 67aa2613446c3c6b53bad21f01286c98290cc0a3:

(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 15 '24 07:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ eccb77d2320955b477bb03bc1f1aee137bd1de76:

(cluster.go:2456).Run: full command output in run_200821.706454962_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 15 '24 21:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 73ecc8b494c4e7f757bb35d68b3587a51af93b02:

(cdc.go:3572).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1721114722547786000.0000000000 after 1721114809196991345.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 16 '24 07:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 73ecc8b494c4e7f757bb35d68b3587a51af93b02:

(cluster.go:2456).Run: full command output in run_071243.250530868_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 16 '24 08:07 cockroach-teamcity

this is a new test that seems to flake a lot on ci (works on my gceworker though..). investigation pending but it's not a release blocker

asg0451 avatar Jul 16 '24 17:07 asg0451

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ bcd4e5e37f2a95e73347f5ed83db5a24bebfd8d1:

(cdc.go:3572).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1721198789333437014.0000000000 after 1721198945113914998.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 17 '24 06:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ bcd4e5e37f2a95e73347f5ed83db5a24bebfd8d1:

(cluster.go:2456).Run: full command output in run_070634.543657724_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 17 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 46854026bc11b3870c8bbefc976f5550b18dd82c:

(cdc.go:3572).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721284906681032015.0000000000 after 1721285123592838392.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 18 '24 06:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 46854026bc11b3870c8bbefc976f5550b18dd82c:

(cluster.go:2456).Run: full command output in run_071018.644515944_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 18 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 6154ebfa1482bcaecc1988a10f1f0f124b5c6b27:

(cluster.go:2456).Run: full command output in run_212001.538594652_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 18 '24 22:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 59be0708627bb27f49d8976182062c6886d64282:

(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 19 '24 07:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 59be0708627bb27f49d8976182062c6886d64282:

(cluster.go:2456).Run: full command output in run_072505.361096831_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 19 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7a8ce2447eb023e855cb85b3ce65a07a70a39334:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.67713304s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 20 '24 06:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7a8ce2447eb023e855cb85b3ce65a07a70a39334:

(cluster.go:2456).Run: full command output in run_070540.347040267_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 20 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1721544086420409658.0000000000 after 1721544089523320910.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=false
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 21 '24 06:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cluster.go:2456).Run: full command output in run_070540.248848618_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 21 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721630760787794140.0000000000 after 1721631121585352911.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 22 '24 06:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 05052df0b4d89dd1147714431163cd8a9b63c589:

(cluster.go:2456).Run: full command output in run_070457.310124728_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 22 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7c29b0c71f3ee8ccc436b5f039955bf6d2add914:

(monitor.go:154).Wait: monitor failure: changefeed[default]: max latency was more than allowed: 5m0.635719847s vs 5m0s
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 23 '24 07:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7c29b0c71f3ee8ccc436b5f039955bf6d2add914:

(cluster.go:2456).Run: full command output in run_070608.949893345_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 23 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 4af6b13bf95a52fe8f6857ffd32e8c1156c36950:

(cluster.go:2456).Run: full command output in run_070520.761192346_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 24 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ da85c982fa391ef34fd14c29006b1f629217ff42:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721888370170710395.0000000000 after 1721888601837299720.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 25 '24 06:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ da85c982fa391ef34fd14c29006b1f629217ff42:

(cluster.go:2456).Run: full command output in run_070641.672418411_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 25 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7fb362dd5aa6e85d65c4c89f208c5bed51ab9692:

(cdc.go:3578).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 0: saw new row timestamp 1721974887322126368.0000000000 after 1721975094537863667.0000000000 was seen
(cluster.go:2456).Run: context canceled
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=false
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 26 '24 06:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 7fb362dd5aa6e85d65c4c89f208c5bed51ab9692:

(cluster.go:2456).Run: full command output in run_071949.985897779_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:386).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 26 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1893ac1d7188dc87dbb2b379b30172bf83ca4645:

(cdc.go:3569).validateMessage: topic consumer for warehouse encountered validator error(s): topic warehouse partition 1: saw new row timestamp 1722065972160087313.0000000000 after 1722065976248567451.0000000000 was seen
(cluster.go:2458).Run: context canceled
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 27 '24 07:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ 1893ac1d7188dc87dbb2b379b30172bf83ca4645:

(cluster.go:2458).Run: full command output in run_071701.193307423_n5-6_CONFLUENTCURRENTmntd.log: error persisted after 31 attempts: COMMAND_PROBLEM: exit status 1
(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 27 '24 08:07 cockroach-teamcity

roachtest.cdc/kafka-chaos-multiple-sink-nodes failed with artifacts on master @ fb8032d12d2a787b54076812595e9d7fb22f925a:

(cdc.go:379).Close: error shutting down prometheus/grafana: COMMAND_PROBLEM: exit status 7
test artifacts and logs in: /artifacts/cdc/kafka-chaos-multiple-sink-nodes/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=16
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity avatar Jul 28 '24 07:07 cockroach-teamcity