openr icon indicating copy to clipboard operation
openr copied to clipboard

openr_kvstore_snooper and clients connected to OpenrCtrl thrift server throw error

Open guodong opened this issue 2 years ago • 1 comments

Issue Description

semifuture_subscribeAndGetAreaKvStores thows error when subscribe updates from OpenR kvstore.

The openr log shows a stream-0 is attached, but the stream is ended immediatly and openr_kvstore_snooper throws error.

Environment

  • OS version: ubuntu2004

What's the actual result?

terminate called after throwing an instance of 'apache::thrift::transport::TTransportException'
  what():  TTransportException: Timed out
*** Aborted at 1658243418 (Unix time, try 'date -d @1658243418') ***
*** Signal 6 (SIGABRT) (0x3e8000536c4) received by PID 341700 (pthread TID 0x7eff0a7ef600) (linux TID 341700) (maybe from PID 341700, UID 1000) (code: -6), stack trace: ***
(error retrieving stack trace)
Aborted (core dumped)

guodong avatar Jul 19 '22 15:07 guodong

After digging in to the KvStoreSnooper.cpp and logs from OpenrCtrlHandler.cpp, I found that the subscription API takes relative long time to return the Future result. Typically > 5s on my computer.

Then I tried openr_kvstore_snooper -processing_timeout_ms=10000 or set to 0 for no timeout (correct me if I'm wrong), everything goes well.

guodong avatar Jul 20 '22 12:07 guodong