yugabyte-db icon indicating copy to clipboard operation
yugabyte-db copied to clipboard

[docdb][test] Check failed: data_assignment_value_iter != table_data_assignment_map_[table_id].end()

Open amitanandaiyer opened this issue 5 years ago • 2 comments

Jira Link: DB-2026


 
--
218560 | [ts-3] | Fatal failure details written to /Volumes/share/jenkins/jenkins-github-yugabyte-db-phabricator-39058/build/debug-clang-dynamic-ninja/yb-test-logs/tests-integration-tests__cassandra_cpp_driver-test/CppCassandraDriverTest_TestDeleteAndCreateIndex.fatal_failure_details.ts-3.2020-06-03T15_34_38.pid92647.txt
218561 | [ts-3] | F20200603 15:34:38 ../../src/yb/tserver/ts_tablet_manager.cc:2125] Check failed: data_assignment_value_iter != table_data_assignment_map_[table_id].end() No data directory index found for table: c0eb0b5984994e85822a37331f2f259e
218562 | [ts-3] | @ 0x117579b40 google::LogDestination::LogToSinks()
218563 | [ts-3] | @ 0x117578b9a google::LogMessage::SendToLog()
218564 | [ts-3] | @ 0x117579515 google::LogMessage::Flush()
218565 | [ts-3] | @ 0x11757e29f google::LogMessageFatal::~LogMessageFatal()
218566 | [ts-3] | @ 0x11757a4e9 google::LogMessageFatal::~LogMessageFatal()
218567 | [ts-3] | @ 0x10cbc2df7 yb::tserver::TSTabletManager::UnregisterDataWalDir()
218568 | [ts-3] | @ 0x10cbc875b yb::tserver::TSTabletManager::DeleteTablet()
218569 | [ts-3] | @ 0x10cb86ca8 yb::tserver::TabletServiceAdminImpl::DeleteTablet()
218570 | [ts-3] | @ 0x111a34ada yb::tserver::TabletServerAdminServiceIf::Handle()
218571 | [ts-3] | @ 0x114be0e84 yb::rpc::ServicePoolImpl::Handle()
218572 | [ts-3] | @ 0x114b378ba yb::rpc::InboundCall::InboundCallTask::Run()
218573 | [ts-3] | @ 0x114bfcfa0 yb::rpc::(anonymous namespace)::Worker::Execute()
218574 | [ts-3] | @ 0x1163e48e4 yb::Thread::SuperviseThread()
218575 | [ts-3] | @ 0x7fff674d62eb _pthread_body
218576 | [ts-3] | @ 0x7fff674d9249 _pthread_start
218577 | [ts-3] | @ 0x7fff674d540d thread_start
218578 | [ts-3] |  
218579 | [ts-3] | *** Check failure stack trace: ***
 



from https://detective-gcp.dev.yugabyte.com/job/github-yugabyte-db-phabricator%2F39058%2Fartifact%2Fbuild%2Fdebug-clang-dynamic-ninja%2Fyb-test-logs%2Ftests-integration-tests__cassandra_cpp_driver-test%2FCppCassandraDriverTest_TestDeleteAndCreateIndex.log?max_lines=3000&start_line=216001

amitanandaiyer avatar Jun 04 '20 00:06 amitanandaiyer

Got the same with https://jenkins.dev.yugabyte.com/job/github-yugabyte-db-phabricator/103052/artifact/java/yb-pgsql/target/surefire-reports_org.yb.pgsql.TestPgRegressTypesUDT__testPgRegressTypesUDT/org.yb.pgsql.TestPgRegressTypesUDT-output.txt.gz (mac-clang-debug ./yb_build.sh --java-test 'org.yb.pgsql.TestPgRegressTypesUDT#testPgRegressTypesUDT').

ts1|pid71944|:19961 F20210715 06:52:55 ../../src/yb/tserver/ts_tablet_manager.cc:2227] Check failed: data_assignment_value_iter != table_data_assignment_map_[table_id].end() No data directory index found for table: 000030af000030008000000000004028
ts1|pid71944|:19961     @        0x11fad1f03  google::LogDestination::LogToSinks()
ts1|pid71944|:19961     @        0x11fad116c  google::LogMessage::SendToLog()
ts1|pid71944|:19961     @        0x11fad1a65  google::LogMessage::Flush()
ts1|pid71944|:19961     @        0x11fad68bf  google::LogMessageFatal::~LogMessageFatal()
ts1|pid71944|:19961     @        0x11fad2a79  google::LogMessageFatal::~LogMessageFatal()
ts1|pid71944|:19961     @        0x114552a2b  yb::tserver::TSTabletManager::UnregisterDataWalDir()
ts1|pid71944|:19961     @        0x114558654  yb::tserver::TSTabletManager::DeleteTablet()
ts1|pid71944|:19961     @        0x114505ad8  yb::tserver::TabletServiceAdminImpl::DeleteTablet()
ts1|pid71944|:19961     @        0x119e80cea  yb::tserver::TabletServerAdminServiceIf::Handle()
ts1|pid71944|:19961     @        0x11b39d5e4  yb::rpc::ServicePoolImpl::Handle()
ts1|pid71944|:19961     @        0x11b2f95ea  yb::rpc::InboundCall::InboundCallTask::Run()
ts1|pid71944|:19961     @        0x11b3bb2b0  yb::rpc::(anonymous namespace)::Worker::Execute()
ts1|pid71944|:19961     @        0x11eab75c4  yb::Thread::SuperviseThread()
ts1|pid71944|:19961     @     0x7fff71d8d2eb  _pthread_body
ts1|pid71944|:19961     @     0x7fff71d90249  _pthread_start
ts1|pid71944|:19961
ts1|pid71944|:19961 *** Check failure stack trace: ***
ts1|pid71944|:19961 I0715 06:52:55.482280 258461696 tablet_bootstrap_if.cc:79] T c1a745ff789b45b59316d55952803332 P 26c5d496dd53403f9e17dd38648200f7: Deleted tablet blocks from disk
ts1|pid71944|:19961 I0715 06:52:55.490589 258461696 ts_tablet_manager.cc:2208] Unregister data/wal directory assignment map for table: 000030af000030008000000000004028 and tablet c1a745ff789b45b59316d55952803332
ts1|pid71944|:19961     @        0x11fad12e8  google::LogMessage::SendToLog()
ts1|pid71944|:19961     @        0x11fad1a65  google::LogMessage::Flush()
ts1|pid71944|:19961     @        0x11fad68bf  google::LogMessageFatal::~LogMessageFatal()
ts1|pid71944|:19961     @        0x11fad2a79  google::LogMessageFatal::~LogMessageFatal()
ts1|pid71944|:19961     @        0x114552a2b  yb::tserver::TSTabletManager::UnregisterDataWalDir()
ts1|pid71944|:19961     @        0x114558654  yb::tserver::TSTabletManager::DeleteTablet()
ts1|pid71944|:19961     @        0x114505ad8  yb::tserver::TabletServiceAdminImpl::DeleteTablet()
ts1|pid71944|:19961     @        0x119e80cea  yb::tserver::TabletServerAdminServiceIf::Handle()
ts1|pid71944|:19961     @        0x11b39d5e4  yb::rpc::ServicePoolImpl::Handle()
ts1|pid71944|:19961     @        0x11b2f95ea  yb::rpc::InboundCall::InboundCallTask::Run()
ts1|pid71944|:19961     @        0x11b3bb2b0  yb::rpc::(anonymous namespace)::Worker::Execute()
ts1|pid71944|:19961     @        0x11eab75c4  yb::Thread::SuperviseThread()
ts1|pid71944|:19961     @     0x7fff71d8d2eb  _pthread_body
ts1|pid71944|:19961     @     0x7fff71d90249  _pthread_start

The last postgres log statements I see before this error are

ts1|pid71944|:19961 2021-07-15 06:52:55.213 GMT [73166] ERROR:  column "nope" of relation "default_test_row" does not exist
ts1|pid71944|:19961 2021-07-15 06:52:55.213 GMT [73166] STATEMENT:  COMMENT ON COLUMN default_test_row.nope IS 'bad comment';
ts1|pid71944|:19961 2021-07-15 06:52:55.252 GMT [73166] ERROR:  type "text_w_default" already exists
ts1|pid71944|:19961 2021-07-15 06:52:55.252 GMT [73166] STATEMENT:  CREATE TYPE text_w_default;

jaki avatar Jul 15 '21 21:07 jaki

@amitanandaiyer , Can you check if this test is still failing? Detective report doesn't seem to indicate the same.

rthallamko3 avatar Sep 23 '22 00:09 rthallamko3

Closing it as it no longer happens on master.

rthallamko3 avatar Apr 11 '23 22:04 rthallamko3