embucket-labs icon indicating copy to clipboard operation
embucket-labs copied to clipboard

[BUG] SLT runs fail intermittently under parallelism with "Table ref snapshot id does not match" and "Object not found" errors

Open YevheniiNiestierov opened this issue 5 months ago • 0 comments

The failures are not specific to a single test but appear more frequently with simple INSERT statements followed by SELECT statements on the same table. For example, a sequence of INSERT statements like the ones below can trigger the issue:

statement ok
INSERT INTO tab0 VALUES(0,261,424.77,'ibryh',479,332.98,'zwzyz')

statement ok
INSERT INTO tab0 VALUES(1,680,179.35,'khsim',589,263.55,'vzeio')

The failures manifest in two distinct but likely related error messages:

Snapshot ID Mismatch: This error occurs during INSERT or other data modification operations.

000200: DataFusion error: External error: Table requirement failed: Table ref snapshot id does not match

Object Not Found: This error typically follows the snapshot ID mismatch and appears during subsequent SELECT statements on the affected table.

000200: DataFusion error: External error: Object at location embucket/public/tab2/metadata/snap-6531058332316589947-0-cd98caea-b30a-4898-add3-69ff06395427.avro not found: No data in memory found. Location: embucket/public/tab2/metadata/snap-6531058332316589947-0-cd98caea-b30a-4898-add3-69ff06395427.avro

YevheniiNiestierov avatar Jul 04 '25 09:07 YevheniiNiestierov