secretpad创建项目对方节点看不到,消息同步报错503
关键日志如下:
2025-05-14 19:09:16 [DataSyncThreadPool-3] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - serializableWrite ---0
2025-05-14 19:09:16 [DataSyncThreadPool-5] INFO o.s.s.p.d.r.p.P2pDataSyncRestTemplate - recordMetrics target:asiainfo, tableName:org.secretflow.secretpad.persistence.entity.VoteRequestDO, duration:14, status:p2pDataSyncRestService error 503, size:1
2025-05-14 19:09:16 [DataSyncThreadPool-5] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync end to send tiiuxeud, now size 0
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response status: 503 SERVICE_UNAVAILABLE
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-b3-traceid=d28d8d5de3c5040b
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-b3-spanid=d28d8d5de3c5040b
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers content-length=152
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers content-type=text/plain
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers date=Wed, 14 May 2025 11:09:16 GMT
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers server=envoy
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-envoy-upstream-service-time=1
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-accel-buffering=no
2025-05-14 19:09:16 [reactor-http-epoll-26] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers kuscia-error-message=<cmcc/kuscia-cmcc-0/internal> => <asiainfo/kuscia-asiainfo-0/external $upstream_reset_before_response_started{remote_connection_failure,delayed_connect_error:_111}$ Service Unavailable>
2025-05-14 19:09:16 [DataSyncThreadPool-3] INFO o.s.s.p.d.r.p.P2pDataSyncRestTemplate - recordMetrics target:asiainfo, tableName:org.secretflow.secretpad.persistence.entity.VoteRequestDO, duration:42, status:p2pDataSyncRestService error 503, size:1
2025-05-14 19:09:16 [DataSyncThreadPool-2] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - serializableWrite ---0
2025-05-14 19:09:16 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync end to send tiiuxeud, now size 0
2025-05-14 19:09:16 [DataSyncThreadPool-3] DEBUG o.s.s.p.datasync.job.DataSyncJob - start data sync to tiiuxeud
2025-05-14 19:09:16 [DataSyncThreadPool-3] DEBUG o.s.s.p.datasync.job.DataSyncJob - DataSyncThreadPool-3 start
2025-05-14 19:09:16 [DataSyncThreadPool-6] ERROR o.s.s.p.d.r.p.P2pDataSyncRestTemplate - P2pDataSyncRestTemplate send error
java.lang.RuntimeException: p2pDataSyncRestService error 503
at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:130)
Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException:
Error has been observed at the following site(s):
*__checkpoint ⇢ 503 SERVICE_UNAVAILABLE from POST http://kuscia-cmcc.dsc2:80/api/v1alpha1/data/sync [DefaultWebClient]
Original Stack Trace:
at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:130)
at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec$StatusHandler.apply(DefaultWebClient.java:722)
at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.applyStatusHandlers(DefaultWebClient.java:687)
at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.handleBodyMono(DefaultWebClient.java:656)
at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.lambda$bodyToMono$3(DefaultWebClient.java:581)
at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:132)
at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107)
at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:113)
at reactor.core.publisher.MonoPeekTerminal$MonoTerminalPeekSubscriber.onNext(MonoPeekTerminal.java:180)
at reactor.core.publisher.FluxPeekFuseable$PeekConditionalSubscriber.onNext(FluxPeekFuseable.java:854)
at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:74)
at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:158)
at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200)
at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:122)
at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79)
at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200)
at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200)
at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200)
at reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82)
at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:251)
at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107)
at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2571)
at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.request(FluxContextWrite.java:136)
at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onSubscribeInner(MonoFlatMapMany.java:150)
at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onSubscribe(MonoFlatMapMany.java:246)
at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onSubscribe(FluxContextWrite.java:101)
at reactor.core.publisher.FluxJust.subscribe(FluxJust.java:68)
at reactor.core.publisher.Flux.subscribe(Flux.java:8848)
at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:196)
at reactor.core.publisher.SerializedSubscriber.onNext(SerializedSubscriber.java:99)
at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onNext(FluxRetryWhen.java:178)
at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:176)
at reactor.netty.http.client.HttpClientConnect$HttpIOHandlerObserver.onStateChange(HttpClientConnect.java:435)
at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:716)
at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onStateChange(DefaultPooledConnectionProvider.java:205)
at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onStateChange(DefaultPooledConnectionProvider.java:466)
at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:725)
at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:115)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:289)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:333)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:455)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:290)
at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:799)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:501)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:399)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Thread.java:840)
Suppressed: java.lang.Exception: #block terminated with an error
at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:104)
at reactor.core.publisher.Mono.block(Mono.java:1779)
at org.springframework.web.service.invoker.HttpServiceMethod$ReactorExchangeResponseFunction.execute(HttpServiceMethod.java:417)
at org.springframework.web.service.invoker.HttpServiceMethod.invoke(HttpServiceMethod.java:130)
at org.springframework.web.service.invoker.HttpServiceProxyFactory$HttpServiceMethodInterceptor.invoke(HttpServiceProxyFactory.java:304)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:223)
at jdk.proxy2/jdk.proxy2.$Proxy305.sync(Unknown Source)
at org.secretflow.secretpad.persistence.datasync.rest.p2p.P2pDataSyncRestTemplate.send(P2pDataSyncRestTemplate.java:65)
at jdk.internal.reflect.GeneratedMethodAccessor394.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:355)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:716)
at org.secretflow.secretpad.persistence.datasync.rest.DataSyncRestTemplate$$SpringCGLIB$$0.send(
你好 现在问题解决了吗,
你好 现在问题解决了吗,
老师您好,问题还没有解决呢
你好。 看报错最早的日志信息是 SERVICE_UNAVAILABLE 服务不可用
你是p2p模式部署的吧, 1 节点是二次开发部署还是参考官网部署? 2.两个节点是否都运行正常?每个节点添加对方的合作节点是否正常,添加的合作节点是否可用? 3.两个节点之间的网络是否正常,帮忙先检查下
你好。 看报错最早的日志信息是 SERVICE_UNAVAILABLE 服务不可用
你是p2p模式部署的吧, 1 节点是二次开发部署还是参考官网部署? 2.两个节点是否都运行正常?每个节点添加对方的合作节点是否正常,添加的合作节点是否可用? 3.两个节点之间的网络是否正常,帮忙先检查下
1.我们不是二次开发,只是尝试按照官网的runk方式部署了k8s,然后把secretpad也部署到了k8s; 2.两个节点运行正常,并且secretpad上可以互相添加了kuscia,secretpad界面上显示对方节点可用; 3.双方网络可互通,且正常。
帮忙执行下 kubectl get svc -A 提供下相关信息
kuscia dsc1 内部:
bash-5.2# kubectl get svc -A
NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
default kubernetes ClusterIP 10.43.0.1
宿主机:
kubectl get svc -n dsc1 | grep secretpad-dsc1
secretpad ExternalName
帮忙执行下 kubectl get svc -A 提供下相关信息
在kuscia.log中有以下日志
2025-05-19 18:39:22.070 INFO kuscia/controller.go:375 Host resource manager finish syncing resources 2025-05-19 18:39:22.070 INFO kuscia/controller.go:381 Starting 4 workers to handle object for interconn-kuscia 2025-05-19 18:41:26.701 ERROR controller/handshake.go:432 DestReplyHandshake for [dsc2-dsc1] failed, detail-> domainRoute [dsc2-dsc1] get error in dest domain [dsc1]: domainroute.kuscia.secretflow "dsc2-dsc1" not found 2025-05-19 18:41:26.712 ERROR controller/handshake.go:432 DestReplyHandshake for [dsc2-dsc1] failed, detail-> domainRoute [dsc2-dsc1] get error in dest domain [dsc1]: domainroute.kuscia.secretflow "dsc2-dsc1" not found 2025-05-19 18:41:44.432 INFO domain/namespace.go:33 Create domain namespace dsc2 2025-05-19 18:41:44.581 INFO clusterdomainroute/controller.go:430 ClusterDomainRoute dsc1-dsc2 updateLabel
secretpad日志中有以下日志 2025-05-19 18:59:38 [DataSyncThreadPool-3] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - serializableWrite ---3 2025-05-19 18:59:38 [DataSyncThreadPool-5] INFO o.s.s.p.d.r.p.P2pDataSyncRestTemplate - recordMetrics target:dsc2, tableName:org.secretflow.secretpad.persistence.entity.VoteRequestDO, duration:82, status:p2pDataSyncRestService error 503, size:3 2025-05-19 18:59:38 [DataSyncThreadPool-5] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync end to send vaxhgrbe, now size 3 2025-05-19 18:59:38 [DataSyncThreadPool-5] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync start to send vaxhgrbe, now size 3 2025-05-19 18:59:38 [DataSyncThreadPool-8] DEBUG o.s.s.p.datasync.job.DataSyncJob - start data sync to vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-8] DEBUG o.s.s.p.datasync.job.DataSyncJob - DataSyncThreadPool-8 start 2025-05-19 18:59:38 [DataSyncThreadPool-8] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync start to send vaxhgrbe, now size 3 2025-05-19 18:59:38 [DataSyncThreadPool-8] INFO o.s.s.p.d.p.p.P2pPaddingNodeServiceImpl - inst_Node = {eslpopdc=dsc1, vaxhgrbe=dsc2} from vaxhgrbe to dsc2 2025-05-19 18:59:38 [DataSyncThreadPool-5] INFO o.s.s.p.d.p.p.P2pPaddingNodeServiceImpl - inst_Node = {eslpopdc=dsc1, vaxhgrbe=dsc2} from vaxhgrbe to dsc2 2025-05-19 18:59:38 [DataSyncThreadPool-8] INFO o.s.s.p.d.r.p.P2pDataSyncRestTemplate - P2pDataSyncRestTemplate send, routeId:dsc2 instId:vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-5] INFO o.s.s.p.d.r.p.P2pDataSyncRestTemplate - P2pDataSyncRestTemplate send, routeId:dsc2 instId:vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-5] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request: POST http://kuscia-dsc1.dsc1:80/api/v1alpha1/data/sync 2025-05-19 18:59:38 [DataSyncThreadPool-5] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request headers kuscia-origin-source=vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-5] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request headers host=secretpad.dsc2.svc 2025-05-19 18:59:38 [DataSyncThreadPool-8] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request: POST http://kuscia-dsc1.dsc1:80/api/v1alpha1/data/sync 2025-05-19 18:59:38 [DataSyncThreadPool-8] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request headers kuscia-origin-source=vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-8] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request headers host=secretpad.dsc2.svc 2025-05-19 18:59:38 [DataSyncThreadPool-3] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - vaxhgrbe commit EntityChangeListener.DbChangeEvent(dstNode=vaxhgrbe, action=update, dType=org.secretflow.secretpad.persistence.entity.VoteRequestDO, projectId=null, nodeIds=[eslpopdc, vaxhgrbe], source=VoteRequestDO(voteID=2225cfb08192475ab80be7500968f673, initiator=eslpopdc, voters=[vaxhgrbe], type=PROJECT_CREATE, voteCounter=eslpopdc, executors=[dsc1, dsc1], approvedThreshold=1, requestMsg={"body":"eyJhcHByb3ZlZF9hY3Rpb24iOiJQUk9KRUNUX0NSRUFURSx7XCJwcm9qZWN0RE9cIjp7XCJjb21wdXRlRnVuY1wiOlwiREFHXCIsXCJjb21wdXRlTW9kZVwiOlwiTVBDXCIsXCJkZXNjcmlwdGlvblwiOlwiZHNjMV8xXCIsXCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDE4OjU5OjM2XCIsXCJpZFwiOjEsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcIm5hbWVcIjpcImRzYzFfMVwiLFwibm9kZUlkc1wiOltdLFwib3duZXJJZFwiOlwiZXNscG9wZGNcIixcInByb2plY3RJZFwiOlwiYmdkbXN4dWxcIixcInByb2plY3RJbmZvXCI6e30sXCJzdGF0dXNcIjoxfSxcInByb2plY3RJbnN0RE9TXCI6W3tcImdtdENyZWF0ZVwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImlzRGVsZXRlZFwiOmZhbHNlLFwidXBrXCI6e1wiaW5zdElkXCI6XCJlc2xwb3BkY1wiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwifX0se1wiZ210Q3JlYXRlXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJpbnN0SWRcIjpcInZheGhncmJlXCIsXCJwcm9qZWN0SWRcIjpcImJnZG1zeHVsXCJ9fV0sXCJwcm9qZWN0Tm9kZURPU1wiOlt7XCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcIm5vZGVJZFwiOlwiZHNjMVwiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwifX0se1wiZ210Q3JlYXRlXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJub2RlSWRcIjpcImRzYzJcIixcInByb2plY3RJZFwiOlwiYmdkbXN4dWxcIn19XX0iLCJhcHByb3ZlZF90aHJlc2hvbGQiOjEsImV4ZWN1dG9ycyI6WyJkc2MxIl0sImluaXRpYXRvciI6ImVzbHBvcGRjIiwicmVqZWN0ZWRfYWN0aW9uIjoiUFJPSkVDVF9BUkNISVZFLHtcInByb2plY3RET1wiOntcImNvbXB1dGVGdW5jXCI6XCJEQUdcIixcImNvbXB1dGVNb2RlXCI6XCJNUENcIixcImRlc2NyaXB0aW9uXCI6XCJkc2MxXzFcIixcImdtdENyZWF0ZVwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjUtMDUtMTkgMTg6NTk6MzZcIixcImlkXCI6MSxcImlzRGVsZXRlZFwiOmZhbHNlLFwibmFtZVwiOlwiZHNjMV8xXCIsXCJub2RlSWRzXCI6W10sXCJvd25lcklkXCI6XCJlc2xwb3BkY1wiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwiLFwicHJvamVjdEluZm9cIjp7fSxcInN0YXR1c1wiOjJ9LFwicHJvamVjdEluc3RET1NcIjpbe1wiZ210Q3JlYXRlXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJpbnN0SWRcIjpcImVzbHBvcGRjXCIsXCJwcm9qZWN0SWRcIjpcImJnZG1zeHVsXCJ9fSx7XCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcImluc3RJZFwiOlwidmF4aGdyYmVcIixcInByb2plY3RJZFwiOlwiYmdkbXN4dWxcIn19XSxcInByb2plY3ROb2RlRE9TXCI6W3tcImdtdENyZWF0ZVwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImlzRGVsZXRlZFwiOmZhbHNlLFwidXBrXCI6e1wibm9kZUlkXCI6XCJkc2MxXCIsXCJwcm9qZWN0SWRcIjpcImJnZG1zeHVsXCJ9fSx7XCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcIm5vZGVJZFwiOlwiZHNjMlwiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwifX1dfSIsInR5cGUiOiJQUk9KRUNUX0NSRUFURSIsInZvdGVfY291bnRlciI6ImVzbHBvcGRjIiwidm90ZV9yZXF1ZXN0X2lkIjoiMjIyNWNmYjA4MTkyNDc1YWI4MGJlNzUwMDk2OGY2NzMiLCJ2b3RlcnMiOlsidmF4aGdyYmUiXX0=","cert_chain":["LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMwRENDQWJpZ0F3SUJBZ0lGQU9sbTVzZ3dEUVlKS29aSWh2Y05BUUVMQlFBd0R6RU5NQXNHQTFVRUF4TUUKWkhOak1UQWVGdzB5TlRBMU1Ua3hNRFU1TXpaYUZ3MHlOVEExTWpBeE1EVTVNelphTUE4eERUQUxCZ05WQkFNVApCSFp2ZEdVd2dnRWlNQTBHQ1NxR1NJYjNEUUVCQVFVQUE0SUJEd0F3Z2dFS0FvSUJBUURhVlVWYUdlYUx6Y3hmCnJLTzJLVE4vMVlLY2UvRUNCcnBYMWlJREhhbDU0Y3RVdkdMRXBOY3Z6U21uV3pESXZBVC9MUVFMK2pjdmhnT2QKTHlkZHNMRnBZWVRyczRlV1QvMmVIL3FHQklPc3BKT0kvK3BkZndaY0pvQW51OWx1T1M0eDhONDNGTURKdjlzMApFMTZ3UTh3aGdBSkY2NUF2S01JbU94ZzFIaitVR0tISG9zcGlxSjMveFplT1AzMkhrY2MxWXR6eVM0bHNXNStwCjdsMUpyQjI5NlZIVHBRL1hOUEJRNWRTMVJ2RjZlaDFZRksrWEZKQmpzTWlPdENYRVlLbjZnaS9DT2ZWUFRNVmgKTXZZOUNQRnZOc0t5OWduSmoyYXBJbUgrNk5uK0RKSkloQVlPVVdVTWFad2tuR0VmRmZ0L2R4U0JqVXRpQmVIdQpaS1pxNU03WkFnTUJBQUdqTXpBeE1BNEdBMVVkRHdFQi93UUVBd0lGb0RBZkJnTlZIU01FR0RBV2dCUkpHNVgrCmljY0RyNlpxTWI0VTdiL25uTDdsRXpBTkJna3Foa2lHOXcwQkFRc0ZBQU9DQVFFQXduSDVKcDJaYU5LNjZBSlcKcmhRdTJHenZxOGpQSktKRFJTSTVjRlJFcVRlcWFFSzE2OXBJTmc2dE9uR3NnZzF0RWttWE5LZytadEZXMkFIQQpRK1FpSTBqVXZvZ1dkR3RZM0FFVlN2T0lKdHpQNzVzR1piQkFTKzduZmh1eCt3SVdDUTJKbVk3RDM5Ym9DVktICmpOanVkWjh4ajVLZVpuVGZFWEtuWWY5SG15N3Y3cE5ILzZSNFI1SFpwaFJBYjhnYndScjBlcFN2dEtJK0tiSWIKNHNzNEtac0J0L09TZ3BRaERzN1FKbXB6SU9VNnJrM0dwZnBJRlFIc3lETlZTM3hvRU8vNjNVWG40MUZraEYxVwpyN2tmc21FV2hBcHZRWVV0Zlo3S0JMcE9mNWE4RVE2NmZUZTFlNHp6N3JBNEp1SnBRTVR5RUJGYXZTY0FrRm1RCjJwdG1rdz09Ci0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K","LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvRENDQWVTZ0F3SUJBZ0lCQVRBTkJna3Foa2lHOXcwQkFRc0ZBREFQTVEwd0N3WURWUVFERXdSa2MyTXgKTUNBWERUSTFNRFV4T1RFd01qa3hNMW9ZRHpJd056VXdOVEU1TVRBeU9URXpXakFQTVEwd0N3WURWUVFERXdSawpjMk14TUlJQklqQU5CZ2txaGtpRzl3MEJBUUVGQUFPQ0FROEFNSUlCQ2dLQ0FRRUE1cWFDa01tMlFPUGY4UkFNClNnU0dOZURqZjlTRWtsTFcyVmZzc3VncE5TeVQ3SjBNVjdpYUtEOWdQdFRza1kwaXJZd1pxdFc4Ly9QRTFnSnUKY0Y3eWRibEZYYkVvV3oxNlAvR05YRTdoSXlNTHJNY1JTTUxMZGxpbndtanBXY0J3SDFIQ0IxZnc4TXlqbGUydgpxT1NSajZBellYLzVwekVZSW9kRm9aVE44OWhOUVVRSnBxMVhVNkhZK3hLVEFjak1xMWZKTmRuZ3hPVTNmSkFlCjVCSFZhdmUyWkUrSUU1ek81ZDhCc0pZSG9EeUNIcS9PUi9IelJEMHNZQnNIVFlOVkhRWTU5aHBTdnV3ZWwva08KMk10SGllaUJpOXlaRmRNb0ovbEIydjY2RUs4dWpTUEE3T0o2VXQvZyswQmdVYitaRmpSekRleVFxcHB6MDlIMQplbUhHOHdJREFRQUJvMkV3WHpBT0JnTlZIUThCQWY4RUJBTUNBb1F3SFFZRFZSMGxCQll3RkFZSUt3WUJCUVVICkF3SUdDQ3NHQVFVRkJ3TUJNQThHQTFVZEV3RUIvd1FGTUFNQkFmOHdIUVlEVlIwT0JCWUVGRWtibGY2Snh3T3YKcG1veHZoVHR2K2VjdnVVVE1BMEdDU3FHU0liM0RRRUJDd1VBQTRJQkFRQU5zcTR3c0h5Zzkzek9ZSHJiZVJLMgpya3M2WVdqVXI5MVBiRjRvUDFYK09VNW8reE5sVmc5bWVTeDc5Mmt2M2tSUkt4VUJjQnFxN1YwR0VibFBiUWpiCjZnaGdUbitUTzRkamJ1U2JoYVNZazlKelRLdVV4WGV6TDE4bzVDTlMyaWU3dXlVUzlJaGpyRnkrUjVSM0k4ZkMKZndMMzlIWFhyVkNqTktFWHROeFQrcnVTbTNOMkJiVFhtOFp3am1XVDZBQUw0eTFVWlphOFNpQUJEZGQ2UkNHSgpOLzFVQUhlRUIvRW04Y2hqelBZR0hzb1Y3NGJKVjBwekl4Z2Y3OEtJam01dyt4eFdiYWRPTlFadHBhUUdYTW5sCndiWGhUWHFKUTRXSTBkY0Q4byszbFViNWYyb3hEVSswblgyNEpBcDRnb1hDZE9jUGJvQXZlWVRzTmxlcjc2c20KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="],"vote_request_signature":"vZE1s4CVsxiV7zmgM43xKWuz7EOtUOnJTVK+Fp72Uq3ZS8PbBoGsIjI+WB9N4iUf+MbY1U0YvaxGXUUAOzTSsUJILTMBSQfMZQTc0CEpmXlTlbFNe3Gwf903AdyCeT5ClvA7fBLSOKxYT9yVLcCthD80LeIoDTA1OTsUx8SYIebSJKhgth6L/OmKMzl3mlEi2fiajTXUWboxozLy0TjsubAv6AZlIY4npl6NvnAfrdOVvxVb0zU3PIyhw31KWZ58HUSKNmrmXX3rSPYJVlEOkQ1kaKqcN33N27GA3ejvMdO+SaNIMMkT2hbwu5jMUfwOuFUEJj7If6N9pvWXsAKCQw=="}, status=0, executeStatus=COMMITTED, msg=null, desc=dsc1_1, partyVoteInfos=[VoteRequestDO.PartyVoteInfo(partyId=eslpopdc, action=APPROVED, reason=null), VoteRequestDO.PartyVoteInfo(partyId=vaxhgrbe, action=REVIEWING, reason=null)])) 2025-05-19 18:59:38 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - p2pDayaSyncDataBufferTemplate push data vaxhgrbe EntityChangeListener.DbChangeEvent(dstNode=vaxhgrbe, action=update, dType=org.secretflow.secretpad.persistence.entity.VoteRequestDO, projectId=null, nodeIds=[eslpopdc, vaxhgrbe], source=VoteRequestDO(voteID=2225cfb08192475ab80be7500968f673, initiator=eslpopdc, voters=[vaxhgrbe], type=PROJECT_CREATE, voteCounter=eslpopdc, executors=[dsc1, dsc1], approvedThreshold=1, requestMsg={"body":"eyJhcHByb3ZlZF9hY3Rpb24iOiJQUk9KRUNUX0NSRUFURSx7XCJwcm9qZWN0RE9cIjp7XCJjb21wdXRlRnVuY1wiOlwiREFHXCIsXCJjb21wdXRlTW9kZVwiOlwiTVBDXCIsXCJkZXNjcmlwdGlvblwiOlwiZHNjMV8xXCIsXCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDE4OjU5OjM2XCIsXCJpZFwiOjEsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcIm5hbWVcIjpcImRzYzFfMVwiLFwibm9kZUlkc1wiOltdLFwib3duZXJJZFwiOlwiZXNscG9wZGNcIixcInByb2plY3RJZFwiOlwiYmdkbXN4dWxcIixcInByb2plY3RJbmZvXCI6e30sXCJzdGF0dXNcIjoxfSxcInByb2plY3RJbnN0RE9TXCI6W3tcImdtdENyZWF0ZVwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImlzRGVsZXRlZFwiOmZhbHNlLFwidXBrXCI6e1wiaW5zdElkXCI6XCJlc2xwb3BkY1wiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwifX0se1wiZ210Q3JlYXRlXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJpbnN0SWRcIjpcInZheGhncmJlXCIsXCJwcm9qZWN0SWRcIjpcImJnZG1zeHVsXCJ9fV0sXCJwcm9qZWN0Tm9kZURPU1wiOlt7XCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcIm5vZGVJZFwiOlwiZHNjMVwiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwifX0se1wiZ210Q3JlYXRlXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJub2RlSWRcIjpcImRzYzJcIixcInByb2plY3RJZFwiOlwiYmdkbXN4dWxcIn19XX0iLCJhcHByb3ZlZF90aHJlc2hvbGQiOjEsImV4ZWN1dG9ycyI6WyJkc2MxIl0sImluaXRpYXRvciI6ImVzbHBvcGRjIiwicmVqZWN0ZWRfYWN0aW9uIjoiUFJPSkVDVF9BUkNISVZFLHtcInByb2plY3RET1wiOntcImNvbXB1dGVGdW5jXCI6XCJEQUdcIixcImNvbXB1dGVNb2RlXCI6XCJNUENcIixcImRlc2NyaXB0aW9uXCI6XCJkc2MxXzFcIixcImdtdENyZWF0ZVwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjUtMDUtMTkgMTg6NTk6MzZcIixcImlkXCI6MSxcImlzRGVsZXRlZFwiOmZhbHNlLFwibmFtZVwiOlwiZHNjMV8xXCIsXCJub2RlSWRzXCI6W10sXCJvd25lcklkXCI6XCJlc2xwb3BkY1wiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwiLFwicHJvamVjdEluZm9cIjp7fSxcInN0YXR1c1wiOjJ9LFwicHJvamVjdEluc3RET1NcIjpbe1wiZ210Q3JlYXRlXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJnbXRNb2RpZmllZFwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiaXNEZWxldGVkXCI6ZmFsc2UsXCJ1cGtcIjp7XCJpbnN0SWRcIjpcImVzbHBvcGRjXCIsXCJwcm9qZWN0SWRcIjpcImJnZG1zeHVsXCJ9fSx7XCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcImluc3RJZFwiOlwidmF4aGdyYmVcIixcInByb2plY3RJZFwiOlwiYmdkbXN4dWxcIn19XSxcInByb2plY3ROb2RlRE9TXCI6W3tcImdtdENyZWF0ZVwiOlwiMjAyNS0wNS0xOSAxMDo1OTozNlwiLFwiZ210TW9kaWZpZWRcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImlzRGVsZXRlZFwiOmZhbHNlLFwidXBrXCI6e1wibm9kZUlkXCI6XCJkc2MxXCIsXCJwcm9qZWN0SWRcIjpcImJnZG1zeHVsXCJ9fSx7XCJnbXRDcmVhdGVcIjpcIjIwMjUtMDUtMTkgMTA6NTk6MzZcIixcImdtdE1vZGlmaWVkXCI6XCIyMDI1LTA1LTE5IDEwOjU5OjM2XCIsXCJpc0RlbGV0ZWRcIjpmYWxzZSxcInVwa1wiOntcIm5vZGVJZFwiOlwiZHNjMlwiLFwicHJvamVjdElkXCI6XCJiZ2Rtc3h1bFwifX1dfSIsInR5cGUiOiJQUk9KRUNUX0NSRUFURSIsInZvdGVfY291bnRlciI6ImVzbHBvcGRjIiwidm90ZV9yZXF1ZXN0X2lkIjoiMjIyNWNmYjA4MTkyNDc1YWI4MGJlNzUwMDk2OGY2NzMiLCJ2b3RlcnMiOlsidmF4aGdyYmUiXX0=","cert_chain":["LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMwRENDQWJpZ0F3SUJBZ0lGQU9sbTVzZ3dEUVlKS29aSWh2Y05BUUVMQlFBd0R6RU5NQXNHQTFVRUF4TUUKWkhOak1UQWVGdzB5TlRBMU1Ua3hNRFU1TXpaYUZ3MHlOVEExTWpBeE1EVTVNelphTUE4eERUQUxCZ05WQkFNVApCSFp2ZEdVd2dnRWlNQTBHQ1NxR1NJYjNEUUVCQVFVQUE0SUJEd0F3Z2dFS0FvSUJBUURhVlVWYUdlYUx6Y3hmCnJLTzJLVE4vMVlLY2UvRUNCcnBYMWlJREhhbDU0Y3RVdkdMRXBOY3Z6U21uV3pESXZBVC9MUVFMK2pjdmhnT2QKTHlkZHNMRnBZWVRyczRlV1QvMmVIL3FHQklPc3BKT0kvK3BkZndaY0pvQW51OWx1T1M0eDhONDNGTURKdjlzMApFMTZ3UTh3aGdBSkY2NUF2S01JbU94ZzFIaitVR0tISG9zcGlxSjMveFplT1AzMkhrY2MxWXR6eVM0bHNXNStwCjdsMUpyQjI5NlZIVHBRL1hOUEJRNWRTMVJ2RjZlaDFZRksrWEZKQmpzTWlPdENYRVlLbjZnaS9DT2ZWUFRNVmgKTXZZOUNQRnZOc0t5OWduSmoyYXBJbUgrNk5uK0RKSkloQVlPVVdVTWFad2tuR0VmRmZ0L2R4U0JqVXRpQmVIdQpaS1pxNU03WkFnTUJBQUdqTXpBeE1BNEdBMVVkRHdFQi93UUVBd0lGb0RBZkJnTlZIU01FR0RBV2dCUkpHNVgrCmljY0RyNlpxTWI0VTdiL25uTDdsRXpBTkJna3Foa2lHOXcwQkFRc0ZBQU9DQVFFQXduSDVKcDJaYU5LNjZBSlcKcmhRdTJHenZxOGpQSktKRFJTSTVjRlJFcVRlcWFFSzE2OXBJTmc2dE9uR3NnZzF0RWttWE5LZytadEZXMkFIQQpRK1FpSTBqVXZvZ1dkR3RZM0FFVlN2T0lKdHpQNzVzR1piQkFTKzduZmh1eCt3SVdDUTJKbVk3RDM5Ym9DVktICmpOanVkWjh4ajVLZVpuVGZFWEtuWWY5SG15N3Y3cE5ILzZSNFI1SFpwaFJBYjhnYndScjBlcFN2dEtJK0tiSWIKNHNzNEtac0J0L09TZ3BRaERzN1FKbXB6SU9VNnJrM0dwZnBJRlFIc3lETlZTM3hvRU8vNjNVWG40MUZraEYxVwpyN2tmc21FV2hBcHZRWVV0Zlo3S0JMcE9mNWE4RVE2NmZUZTFlNHp6N3JBNEp1SnBRTVR5RUJGYXZTY0FrRm1RCjJwdG1rdz09Ci0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K","LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvRENDQWVTZ0F3SUJBZ0lCQVRBTkJna3Foa2lHOXcwQkFRc0ZBREFQTVEwd0N3WURWUVFERXdSa2MyTXgKTUNBWERUSTFNRFV4T1RFd01qa3hNMW9ZRHpJd056VXdOVEU1TVRBeU9URXpXakFQTVEwd0N3WURWUVFERXdSawpjMk14TUlJQklqQU5CZ2txaGtpRzl3MEJBUUVGQUFPQ0FROEFNSUlCQ2dLQ0FRRUE1cWFDa01tMlFPUGY4UkFNClNnU0dOZURqZjlTRWtsTFcyVmZzc3VncE5TeVQ3SjBNVjdpYUtEOWdQdFRza1kwaXJZd1pxdFc4Ly9QRTFnSnUKY0Y3eWRibEZYYkVvV3oxNlAvR05YRTdoSXlNTHJNY1JTTUxMZGxpbndtanBXY0J3SDFIQ0IxZnc4TXlqbGUydgpxT1NSajZBellYLzVwekVZSW9kRm9aVE44OWhOUVVRSnBxMVhVNkhZK3hLVEFjak1xMWZKTmRuZ3hPVTNmSkFlCjVCSFZhdmUyWkUrSUU1ek81ZDhCc0pZSG9EeUNIcS9PUi9IelJEMHNZQnNIVFlOVkhRWTU5aHBTdnV3ZWwva08KMk10SGllaUJpOXlaRmRNb0ovbEIydjY2RUs4dWpTUEE3T0o2VXQvZyswQmdVYitaRmpSekRleVFxcHB6MDlIMQplbUhHOHdJREFRQUJvMkV3WHpBT0JnTlZIUThCQWY4RUJBTUNBb1F3SFFZRFZSMGxCQll3RkFZSUt3WUJCUVVICkF3SUdDQ3NHQVFVRkJ3TUJNQThHQTFVZEV3RUIvd1FGTUFNQkFmOHdIUVlEVlIwT0JCWUVGRWtibGY2Snh3T3YKcG1veHZoVHR2K2VjdnVVVE1BMEdDU3FHU0liM0RRRUJDd1VBQTRJQkFRQU5zcTR3c0h5Zzkzek9ZSHJiZVJLMgpya3M2WVdqVXI5MVBiRjRvUDFYK09VNW8reE5sVmc5bWVTeDc5Mmt2M2tSUkt4VUJjQnFxN1YwR0VibFBiUWpiCjZnaGdUbitUTzRkamJ1U2JoYVNZazlKelRLdVV4WGV6TDE4bzVDTlMyaWU3dXlVUzlJaGpyRnkrUjVSM0k4ZkMKZndMMzlIWFhyVkNqTktFWHROeFQrcnVTbTNOMkJiVFhtOFp3am1XVDZBQUw0eTFVWlphOFNpQUJEZGQ2UkNHSgpOLzFVQUhlRUIvRW04Y2hqelBZR0hzb1Y3NGJKVjBwekl4Z2Y3OEtJam01dyt4eFdiYWRPTlFadHBhUUdYTW5sCndiWGhUWHFKUTRXSTBkY0Q4byszbFViNWYyb3hEVSswblgyNEpBcDRnb1hDZE9jUGJvQXZlWVRzTmxlcjc2c20KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="],"vote_request_signature":"vZE1s4CVsxiV7zmgM43xKWuz7EOtUOnJTVK+Fp72Uq3ZS8PbBoGsIjI+WB9N4iUf+MbY1U0YvaxGXUUAOzTSsUJILTMBSQfMZQTc0CEpmXlTlbFNe3Gwf903AdyCeT5ClvA7fBLSOKxYT9yVLcCthD80LeIoDTA1OTsUx8SYIebSJKhgth6L/OmKMzl3mlEi2fiajTXUWboxozLy0TjsubAv6AZlIY4npl6NvnAfrdOVvxVb0zU3PIyhw31KWZ58HUSKNmrmXX3rSPYJVlEOkQ1kaKqcN33N27GA3ejvMdO+SaNIMMkT2hbwu5jMUfwOuFUEJj7If6N9pvWXsAKCQw=="}, status=0, executeStatus=COMMITTED, msg=null, desc=dsc1_1, partyVoteInfos=[VoteRequestDO.PartyVoteInfo(partyId=eslpopdc, action=APPROVED, reason=null), VoteRequestDO.PartyVoteInfo(partyId=vaxhgrbe, action=REVIEWING, reason=null)])) 2025-05-19 18:59:38 [DataSyncThreadPool-3] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - serializableWrite ---2 2025-05-19 18:59:38 [DataSyncThreadPool-3] INFO o.s.s.p.d.r.p.P2pDataSyncRestTemplate - recordMetrics target:dsc2, tableName:org.secretflow.secretpad.persistence.entity.VoteRequestDO, duration:15, status:p2pDataSyncRestService error 503, size:3 2025-05-19 18:59:38 [DataSyncThreadPool-4] INFO o.s.s.p.d.b.p.P2PDataSyncDataBufferTemplate - serializableWrite ---2 2025-05-19 18:59:38 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync end to send vaxhgrbe, now size 2 2025-05-19 18:59:38 [DataSyncThreadPool-10] DEBUG o.s.s.p.datasync.job.DataSyncJob - start data sync to vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-10] INFO o.s.s.p.datasync.job.DataSyncJob - vaxhgrbe is working now DataSyncThreadPool-8, skip it 2025-05-19 18:59:38 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.r.p.P2pDataSyncRestTemplate - data sync start to send vaxhgrbe, now size 2 2025-05-19 18:59:38 [DataSyncThreadPool-3] INFO o.s.s.p.d.p.p.P2pPaddingNodeServiceImpl - inst_Node = {eslpopdc=dsc1, vaxhgrbe=dsc2} from vaxhgrbe to dsc2 2025-05-19 18:59:38 [DataSyncThreadPool-3] INFO o.s.s.p.d.r.p.P2pDataSyncRestTemplate - P2pDataSyncRestTemplate send, routeId:dsc2 instId:vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request: POST http://kuscia-dsc1.dsc1:80/api/v1alpha1/data/sync 2025-05-19 18:59:38 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request headers kuscia-origin-source=vaxhgrbe 2025-05-19 18:59:38 [DataSyncThreadPool-3] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Request headers host=secretpad.dsc2.svc 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response status: 503 SERVICE_UNAVAILABLE 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-b3-traceid=879f02d37745c34d 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-b3-spanid=879f02d37745c34d 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers content-length=19 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers content-type=text/plain 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers date=Mon, 19 May 2025 10:59:38 GMT 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers server=envoy 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-envoy-upstream-service-time=1 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-accel-buffering=no 2025-05-19 18:59:38 [reactor-http-epoll-17] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers kuscia-error-message=<dsc1/kuscia-dsc1-0/internal> => <dsc2/kuscia-dsc2-0/external $no_healthy_upstream$ Service Unavailable> 2025-05-19 18:59:38 [reactor-http-epoll-18] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response status: 503 SERVICE_UNAVAILABLE 2025-05-19 18:59:38 [reactor-http-epoll-18] DEBUG o.s.s.p.d.rest.p2p.log.P2pRestLog - Response headers x-b3-traceid=1d6bc70636295477 2025-05-19 18:59:38 [DataSyncThreadPool-8] ERROR o.s.s.p.d.r.p.P2pDataSyncRestTemplate - P2pDataSyncRestTemplate send error java.lang.RuntimeException: p2pDataSyncRestService error 503 at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:130) Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Error has been observed at the following site(s): *__checkpoint ⇢ 503 SERVICE_UNAVAILABLE from POST http://kuscia-dsc1.dsc1:80/api/v1alpha1/data/sync [DefaultWebClient] Original Stack Trace: at org.secretflow.secretpad.service.configuration.P2pDataSyncConfigurable.lambda$p2pDataSyncRestService$1(P2pDataSyncConfigurable.java:130) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec$StatusHandler.apply(DefaultWebClient.java:722) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.applyStatusHandlers(DefaultWebClient.java:687) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.handleBodyMono(DefaultWebClient.java:656) at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.lambda$bodyToMono$3(DefaultWebClient.java:581) at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:132) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:113) at reactor.core.publisher.MonoPeekTerminal$MonoTerminalPeekSubscriber.onNext(MonoPeekTerminal.java:180) at reactor.core.publisher.FluxPeekFuseable$PeekConditionalSubscriber.onNext(FluxPeekFuseable.java:854) at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:74) at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:158) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:122) at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:79) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:200) at reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:251) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107) at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2571) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.request(FluxContextWrite.java:136) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onSubscribeInner(MonoFlatMapMany.java:150) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onSubscribe(MonoFlatMapMany.java:246) at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onSubscribe(FluxContextWrite.java:101) at reactor.core.publisher.FluxJust.subscribe(FluxJust.java:68) at reactor.core.publisher.Flux.subscribe(Flux.java:8848) at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:196) at reactor.core.publisher.SerializedSubscriber.onNext(SerializedSubscriber.java:99) at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onNext(FluxRetryWhen.java:178) at reactor.core.publisher.MonoCreate$DefaultMonoSink.success(MonoCreate.java:176) at reactor.netty.http.client.HttpClientConnect$HttpIOHandlerObserver.onStateChange(HttpClientConnect.java:435) at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:716) at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onStateChange(DefaultPooledConnectionProvider.java:205) at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onStateChange(DefaultPooledConnectionProvider.java:466) at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:725) at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:115) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:289) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:333) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:455) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:290) at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)
问题可能原因大概:k8s部署方式,kucsia和pad都需要单独部署,单独部署时,需要在kuscia上注册下下对于pad节点的service,
登陆下kuscia容器
- 首先检查kuscia的DomainRoute是否有效。【kubectl get cdr -A】
- 查看kuscia k3s Service 服务是否配置了name为SecretPad的服务。【kubectl get svc -A】 ● 可以尝试Ping 一下EXTERNAL-IP属性检测一下通讯状态
3.查看对方kuscia k3s Service 服务是否配置了name为SecretPad的服务。
dsc1:
bash-5.2# kubectl get svc -A
NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
default kubernetes ClusterIP 10.43.0.1
dsc2
kubectl get svc -A
NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
default kubernetes ClusterIP 10.43.0.1
ping secretpad-dsc2 ping: secretpad-dsc2: Temporary failure in name resolution
bash-5.2# kubectl get svc -A
NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
default kubernetes ClusterIP 10.43.0.1
这个ping不通是否影响
dsc1:
bash-5.2# kubectl get svc -A NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE default kubernetes ClusterIP 10.43.0.1 443/TCP 20h dsc1 secretpad ExternalName secretpad-dsc1 9001/TCP 20h bash-5.2# kubectl get cdr -A NAME SOURCE DESTINATION HOST AUTHENTICATION READY dsc1-dsc2 dsc1 dsc2 10.19.195.23 Token True dsc2-dsc1 dsc2 dsc1 Token True bash-5.2# ping secretpad-dsc1 ping: secretpad-dsc1: Temporary failure in name resolution
dsc2
kubectl get svc -A NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE default kubernetes ClusterIP 10.43.0.1 443/TCP 20h dsc2 secretpad ExternalName secretpad-dsc2 9001/TCP 20h
ping secretpad-dsc2 ping: secretpad-dsc2: Temporary failure in name resolution
bash-5.2# kubectl get svc -A NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE default kubernetes ClusterIP 10.43.0.1 443/TCP 20h dsc2 secretpad ExternalName secretpad-dsc2 9001/TCP 20h bash-5.2# kubectl get cdr -A NAME SOURCE DESTINATION HOST AUTHENTICATION READY dsc2-dsc1 dsc2 dsc1 10.19.195.23 Token True dsc1-dsc2 dsc1 dsc2 Token True bash-5.2# ping secretpad-dsc2 ping: secretpad-dsc2: Temporary failure in name resolution
这个ping不通是否影响
看下: 0.ping不通的问题先记录下。 1.方便把两方pad节点的secretpad.yaml文件的内容发下来(可以屏蔽敏感信息) 2.另外问下secretpad-dsc2怎么故意这样配置的吗 没有使用secretpad默认名字吗 不确定这块解析是否有问题。
你好,现在问题解决了没有。
issue先关闭了,如果有新的反馈,我们再沟通。