awips2 icon indicating copy to clipboard operation
awips2 copied to clipboard

Exception when sending message:timed out waiting for sync: complete = 303852, point = 303853,

Open mjames-upc opened this issue 6 years ago • 0 comments

I love the part of my job where EDEX runs smoothly for 2 months and then fucking crashes like this for no good reason.

ERROR 2018-12-11 20:27:57,660 2207 [external.dropbox-1] distribution: Exchange[ExchangePattern: InOnly, BodyType: byte[], CaughtExceptionType: org.springframework.jms.UncategorizedJmsException, CaughtExceptionMessage: Uncategorized exception occurred during JMS processing; nested exception is javax.jms.JMSException: Exception occurred on pooled producer; nested exception is javax.jms.JMSException: Exception when sending message:timed out waiting for sync: complete = 303852, point = 303853, StackTrace: org.springframework.jms.UncategorizedJmsException: Uncategorized exception occurred during JMS processing; nested exception is javax.jms.JMSException: Exception occurred on pooled producer; nested exception is javax.jms.JMSException: Exception when sending message:timed out waiting for sync: complete = 303852, point = 303853
        at org.springframework.jms.support.JmsUtils.convertJmsAccessException(JmsUtils.java:316)
        at org.springframework.jms.support.JmsAccessor.convertJmsAccessException(JmsAccessor.java:169)
        at org.springframework.jms.core.JmsTemplate.execute(JmsTemplate.java:497)
        at org.apache.camel.component.jms.JmsConfiguration$CamelJmsTemplate.send(JmsConfiguration.java:470)
        at org.apache.camel.component.jms.JmsProducer.doSend(JmsProducer.java:414)
        at org.apache.camel.component.jms.JmsProducer.processInOnly(JmsProducer.java:368)
        at org.apache.camel.component.jms.JmsProducer.process(JmsProducer.java:154)
        at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:197)
        at org.apache.camel.processor.MulticastProcessor.doProcessSequential(MulticastProcessor.java:681)
        at org.apache.camel.processor.MulticastProcessor.doProcessSequential(MulticastProcessor.java:609)
        at org.apache.camel.processor.MulticastProcessor.process(MulticastProcessor.java:238)
        at org.apache.camel.processor.RecipientList.sendToRecipientList(RecipientList.java:170)
        at org.apache.camel.component.bean.MethodInfo$1.doProceed(MethodInfo.java:296)
        at org.apache.camel.component.bean.MethodInfo$1.proceed(MethodInfo.java:262)
        at org.apache.camel.component.bean.BeanProcessor.process(BeanProcessor.java:178)
        at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:109)
        at org.apache.camel.component.bean.BeanProcessor.process(BeanProcessor.java:69)
        at com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessageProducer.java:439)
        at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:110)
        at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:197)
        at org.apache.camel.processor.TryProcessor.process(TryProcessor.java:113)
        at org.apache.camel.processor.TryProcessor.process(TryProcessor.java:84)
        at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:109)
        at org.apache.camel.processor.TryProcessor.process(TryProcessor.java:68)
        at com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessageProducer.java:439)
        at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:110)
        at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:197)
        at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:197)
        at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97)
        at org.apache.camel.component.jms.EndpointMessageListener.onMessage(EndpointMessageListener.java:112)
        at org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:721)
        at org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:681)
        at org.springframework.jms.listener.AbstractMessageListenerContainer.doExecuteListener(AbstractMessageListenerContainer.java:651)
        at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.doReceiveAndExecute(AbstractPollingMessageListenerContainer.java:313)
        at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.receiveAndExecute(AbstractPollingMessageListenerContainer.java:251)
        at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.invokeListener(DefaultMessageListenerContainer.java:1164)
        at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.executeOngoingLoop(DefaultMessageListenerContainer.java:1156)
        at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.run(DefaultMessageListenerContainer.java:1053)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: javax.jms.JMSException: Exception occurred on pooled producer
        at com.raytheon.uf.common.jms.wrapper.JmsProducerWrapper.send(JmsProducerWrapper.java:310)
        at org.springframework.jms.core.JmsTemplate.doSend(JmsTemplate.java:633)
        at org.apache.camel.component.jms.JmsConfiguration$CamelJmsTemplate.doSend(JmsConfiguration.java:578)
        at org.apache.camel.component.jms.JmsConfiguration$CamelJmsTemplate.doSendToDestination(JmsConfiguration.java:517)
        at org.apache.camel.component.jms.JmsConfiguration$CamelJmsTemplate.access$100(JmsConfiguration.java:459)
        at org.apache.camel.component.jms.JmsConfiguration$CamelJmsTemplate$1.doInJms(JmsConfiguration.java:473)
        at org.springframework.jms.core.JmsTemplate.execute(JmsTemplate.java:494)
        ... 38 more
Caused by: javax.jms.JMSException: Exception when sending message:timed out waiting for sync: complete = 303852, point = 303853
        at org.apache.qpid.client.BasicMessageProducer_0_10.sendMessage(BasicMessageProducer_0_10.java:385)
        at org.apache.qpid.client.BasicMessageProducer.sendImpl(BasicMessageProducer.java:549)
        at org.apache.qpid.client.BasicMessageProducer.send(BasicMessageProducer.java:367)
        at com.raytheon.uf.common.jms.wrapper.JmsProducerWrapper.send(JmsProducerWrapper.java:307)
        ... 44 more
Caused by: org.apache.qpid.transport.SessionException: timed out waiting for sync: complete = 303852, point = 303853
        at org.apache.qpid.transport.Session.sync(Session.java:853)
        at org.apache.qpid.transport.Session.sync(Session.java:823)
        at org.apache.qpid.client.BasicMessageProducer_0_10.sendMessage(BasicMessageProducer_0_10.java:378)
        ... 47 more
]

mjames-upc avatar Dec 11 '18 20:12 mjames-upc