waggle-dance icon indicating copy to clipboard operation
waggle-dance copied to clipboard

CloseableThriftHiveMetastoreIfaceClientFactory new instance get blocked

Open chenwyi2 opened this issue 2 years ago • 1 comments

recently, the waggle-dance is blocekd when inlitialize CloseableThriftHiveMetastoreIfaceClientFactory.java new instance, then the serve cannot be used. these is jstack image

image defaultMetaStoreClientFactory .newInstance(confFactory.newInstance(), "waggledance-" + name, DEFAULT_CLIENT_FACTORY_RECONNECTION_RETRY, connectionTimeout); why should use confFactory.newInstance() rather than use hiveConf in the paramter, becasue confFactory.newInstance() will synchronized(HiveConf.class), all the requets can be blocked there image

chenwyi2 avatar Sep 28 '22 10:09 chenwyi2

Hey @chenwyi2, could you add more details of your use case? Which is the input configuration that you set in Waggledance? Does this occur when Waggledance is trying to map databases in parallel?

I didn't see this error before, and we are running multiple instances of Waggledance with different configurations. I would like to know what is different in your use case. Also I'm open to code suggestions :)

javsanbel2 avatar Feb 24 '23 10:02 javsanbel2