panbingkun

Results 183 comments of panbingkun

> ready to go ? Yea, the last upgrade was two months ago, Let me run the benchmark: StateStoreBasicOperationsBenchmark JDK17: https://github.com/panbingkun/spark/actions/runs/9640180869 JDK21: https://github.com/panbingkun/spark/actions/runs/9640184179

> > ready to go ? > > Yea, the last upgrade was two months ago, Let me run the benchmark: StateStoreBasicOperationsBenchmark JDK17: https://github.com/panbingkun/spark/actions/runs/9640180869 JDK21: https://github.com/panbingkun/spark/actions/runs/9640184179 Done

> Merged into master. Thanks @panbingkun Thanks.

Make a record of where hang: ``` q.processAllAvailable() ```

``` "pool-31-thread-1" #62 prio=5 os_prio=31 cpu=1.84ms elapsed=681.43s tid=0x000000013c5dac00 nid=0xe303 waiting for monitor entry [0x000000030cbb5000] java.lang.Thread.State: BLOCKED (on object monitor) at org.apache.logging.log4j.core.appender.OutputStreamManager.writeBytes(OutputStreamManager.java:366) - waiting to lock (a org.apache.logging.log4j.core.appender.OutputStreamManager) at org.apache.logging.log4j.core.layout.TextEncoderHelper.writeEncodedText(TextEncoderHelper.java:101) at...

``` "grpc-default-executor-1" #82 daemon prio=5 os_prio=31 cpu=9.92ms elapsed=678.54s tid=0x0000000128b9c800 nid=0xe10b runnable [0x000000030cdbc000] java.lang.Thread.State: RUNNABLE at java.io.FileOutputStream.writeBytes([email protected]/Native Method) at java.io.FileOutputStream.write([email protected]/FileOutputStream.java:349) at java.io.BufferedOutputStream.flushBuffer([email protected]/BufferedOutputStream.java:81) at java.io.BufferedOutputStream.flush([email protected]/BufferedOutputStream.java:142) - locked (a java.io.BufferedOutputStream) at java.io.PrintStream.write([email protected]/PrintStream.java:570) -...

Use the following steps to re-balance: - Download logs from GA, extract the execution cost time of `each UT`, and calculate the total execution cost time of `each part*`, eg:...

After this pr: - First https://github.com/panbingkun/spark/actions/runs/9718805972 part0, cost time: 1h 44m part1, cost time: 1h 40m part2, cost time: 1h 45m part3, cost time: 1h 44m - Second https://github.com/panbingkun/spark/actions/runs/9721535055 part0,...