zstd icon indicating copy to clipboard operation
zstd copied to clipboard
verified publisher icon facebook

Weird behaviors on Ubuntu

Open MegatronKing opened this issue 8 months ago • 3 comments

Describe the bug

I build the library v1.5.4 with CMake on ubuntu 20.04, but failed to run, and noticed some weired behaviors.

Debug build

The compress call will crash, log is here:

/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5802: ZSTD_createCStream 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5952: ZSTD_initCStream 
reqable: /home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5966: ZSTD_nextInputSizeHint: Assertion `cctx->appliedParams.inBufferMode == ZSTD_bm_buffered' failed.

Release build

The compress call seems to be ok now.

/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5802: ZSTD_createCStream 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5952: ZSTD_initCStream 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6977: ZSTD_endStream : remaining to flush : 0

But the decompress might be crash:

/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1672: ZSTD_createDStream 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1750: ZSTD_initDStream

Sometime throws an error:

/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1672: ZSTD_createDStream 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1750: ZSTD_initDStream 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2096: ZSTD_decompressStream 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2107: input size : 15 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2114: stage zdss_init => transparent reset  
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 15) 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 10) 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 9) 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2210: Consume header 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2224: Control max memory usage (2048 KB <= max 131072 KB) 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2246: inBuff  : from 0 to 131072 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2248: outBuff : from 0 to 2359360 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2271: stage zdss_read 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2273: neededInSize = 3 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2063: ERROR!: forwarding error in decodedSize: Src size is incorrect: 
/home/king1234/workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2280: ERROR!: forwarding error in ZSTD_decompressContinueStream(zds, &op, oend, ip, neededInSize): Src size is incorrect:

I have set DEBUGLEVEL from 0 to 10, and only got those logs, I checked the source code and found this to be very unusual, but I couldn't explain it. I also tried clang compiler, and -O0 flags, but got the same results.

On other platforms, like Android, Windows and Mac, I can confirm that the library works well. For the same input, the logs on Mac:

Compress log

/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5802: ZSTD_createCStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5952: ZSTD_initCStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:711: ZSTD_CCtx_setParameter (100, 3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:773: ZSTD_CCtxParams_setParameter (100, 3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6319: ZSTD_compressStream2, endOp=0  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6232: ZSTD_compressStream2 : transparent init stage 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:7077: ZSTD_getCParams_internal (cLevel=3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:7086: ZSTD_getCParams_internal selected tableID: 0 row: 3 strat: 2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5125: ZSTD_compressBegin_internal: wlog=21 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2099: ZSTD_resetCCtx_internal: pledgedSrcSize=4294967295, wlog=21, useRowMatchFinder=2 useBlockSplitter=2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:1681: chainSize: 65536 - hSize: 131072 - h3Size: 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:1740: estimate workspace : 3658105 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2150: Need 3658105 B workspace 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2151: windowSize: 2097152 - blockSize: 131072 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2156: Resize workspaceSize from 0KB to 3572KB 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:678: cwksp: freeing workspace 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:670: cwksp: creating new workspace with 3658105 bytes 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:654: cwksp: init'ing workspace with 3658105 bytes 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:603: cwksp: clearing! 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2165: reserving object space 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:498: cwksp: reserving 0x128210000 object 5632 bytes (rounded to 5632), 3652416 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:498: cwksp: reserving 0x128211600 object 5632 bytes (rounded to 5632), 3646784 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:498: cwksp: reserving 0x128212c00 object 8920 bytes (rounded to 8920), 3637864 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:603: cwksp: clearing! 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2189: pledged content size : 4294967295 ; flag : 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:1992: reset indices : 1 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:526: cwksp: ZSTD_cwksp_mark_tables_dirty 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:581: cwksp: clearing tables! 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2008: reserving table space 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:328: reserving table alignment addtl space: 40 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:459: cwksp: reserving 0x128214f00 table 524288 bytes, 3113536 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:459: cwksp: reserving 0x128294f00 table 262144 bytes, 2851392 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:459: cwksp: reserving 0x1282d4f00 table 0 bytes, 2851392 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2016: reset table : 1 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:567: cwksp: ZSTD_cwksp_clean_tables 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:554: cwksp: ZSTD_cwksp_mark_tables_clean 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:291: cwksp: reserving 0x12854d140 262144 bytes, 2589248 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:291: cwksp: reserving 0x12852d120 131104 bytes, 2458144 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:291: cwksp: reserving 0x12830d120 2228224 bytes, 229920 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:291: cwksp: reserving 0x1282ecf1f 131585 bytes, 98335 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:291: cwksp: reserving 0x1282e4f1f 32768 bytes, 65567 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:291: cwksp: reserving 0x1282dcf1f 32768 bytes, 32799 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:291: cwksp: reserving 0x1282d4f1f 32768 bytes, 31 bytes remaining 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2262: wksp: finished allocating, 31 bytes remain available 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5080: ZSTD_compress_insertDictionary (dictSize=0) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5990: ZSTD_compressStream_generic, flush=0, srcSize = 3 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6408: completed ZSTD_compressStream2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6319: ZSTD_compressStream2, endOp=0  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5990: ZSTD_compressStream_generic, flush=0, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6408: completed ZSTD_compressStream2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6319: ZSTD_compressStream2, endOp=0  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5990: ZSTD_compressStream_generic, flush=0, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6408: completed ZSTD_compressStream2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6319: ZSTD_compressStream2, endOp=1  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5990: ZSTD_compressStream_generic, flush=1, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6068: stream compression stage (flushMode==1) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4735: ZSTD_compressContinue (srcSize=3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4679: ZSTD_compressContinue_internal, stage: 1, srcSize: 3 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4593: ZSTD_writeFrameHeader : dictIDFlag : 1 ; dictID : 0 ; dictIDSizeCode : 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress_internal.h:1254: ZSTD_window_update 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress_internal.h:1263: Non contiguous blocks, new segment starts at 2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4710: ZSTD_compressContinue_internal (blockSize=131072) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4507: ZSTD_compress_frameChunk (blockSize=131072) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress_internal.h:1206: ZSTD_checkDictValidity: blockEndIdx=5, maxDist=2097152, loadedDictEnd=0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress_internal.h:1219: invalidating dictionary for current block (distance > windowSize) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress_internal.h:1159: ZSTD_window_enforceMaxDist: blockEndIdx=2, maxDist=2097152, loadedDictEnd=0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2715: ZSTD_useTargetCBlockSize (targetCBlockSize=0) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:2726: ZSTD_blockSplitterEnabled (useBlockSplitter=2) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4333: ZSTD_compressBlock_internal (dstCapacity=131575, dictLimit=2, nextToUpdate=2) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:3205: ZSTD_buildSeqStore (srcSize=3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress_internal.h:567: ZSTD_noCompressBlock (srcSize=3, dstCapacity=131578) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4567: ZSTD_compress_frameChunk: adding a block of size 6 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6093: inBuffTarget:131075 / inBuffSize:2228224 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6408: completed ZSTD_compressStream2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6319: ZSTD_compressStream2, endOp=1  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5990: ZSTD_compressStream_generic, flush=1, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6408: completed ZSTD_compressStream2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6319: ZSTD_compressStream2, endOp=0  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5990: ZSTD_compressStream_generic, flush=0, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6408: completed ZSTD_compressStream2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6319: ZSTD_compressStream2, endOp=2  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5990: ZSTD_compressStream_generic, flush=2, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6068: stream compression stage (flushMode==2) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:4679: ZSTD_compressContinue_internal, stage: 2, srcSize: 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:5224: ZSTD_writeEpilogue 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6093: inBuffTarget:131075 / inBuffSize:2228224 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6111: Frame completed directly in outBuffer 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6408: completed ZSTD_compressStream2 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6185: ZSTD_setBufferExpectations (for advanced stable in/out modes) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:6977: ZSTD_endStream : remaining to flush : 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_compress.c:181: ZSTD_freeCCtx (address: 0x17e173800) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/compress/zstd_cwksp.h:678: cwksp: freeing workspace

Decompress log

/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1672: ZSTD_createDStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1750: ZSTD_initDStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2096: ZSTD_decompressStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2107: input size : 15 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2114: stage zdss_init => transparent reset  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 15) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 10) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 5 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 9) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 6 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2210: Consume header 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1601: ZSTD_decompressBegin_usingDDict 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 6 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2226: Control max memory usage (2048 KB <= max 131072 KB) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2247: inBuff  : from 0 to 131072 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2249: outBuff : from 0 to 2359360 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2271: stage zdss_read 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2273: neededInSize = 3 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1275: ZSTD_decompressContinue (srcSize:3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2271: stage zdss_read 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2273: neededInSize = 3 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1275: ZSTD_decompressContinue (srcSize:3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1339: ZSTD_decompressContinue: case ZSTDds_decompressBlock 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:897: ZSTD_copyRawBlock 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1366: ZSTD_decompressContinue: decoded size from block : 3 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2271: stage zdss_read 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2273: neededInSize = 3 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:1275: ZSTD_decompressContinue (srcSize:3) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2271: stage zdss_read 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2273: neededInSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2096: ZSTD_decompressStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2107: input size : 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2114: stage zdss_init => transparent reset  
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 0) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2096: ZSTD_decompressStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2107: input size : 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 0) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2096: ZSTD_decompressStream 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2107: input size : 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:2125: stage zdss_loadHeader (srcSize : 0) 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 0 
/Users/megatronking/Workspace/reqable/reqable-compress/third_party/zstd/lib/decompress/zstd_decompress.c:452: ZSTD_getFrameHeader_advanced: minInputSize = 5, srcSize = 0

MegatronKing avatar Apr 09 '25 18:04 MegatronKing

I build the library v1.5.4 with CMake on ubuntu 20.04

Why v1.5.4 ? Current release is v1.5.7.

Cyan4973 avatar Apr 10 '25 03:04 Cyan4973

@Cyan4973 I tried, v1.5.7 has the same issue.

MegatronKing avatar Apr 10 '25 04:04 MegatronKing

@MegatronKing These issues are unexpected.

  1. Do you have local modifications to the library? If you delete the zstd directory and re-download from v1.5.7 does it still occur?
  2. Are other libraries having similar unexplained issues on that system?

terrelln avatar Apr 11 '25 16:04 terrelln