delta icon indicating copy to clipboard operation
delta copied to clipboard
verified publisher icon delta-io

[Spark] Make txn readPredicates thread safe

Open cstavr opened this issue 1 year ago • 0 comments

Which Delta project/connector is this regarding?

  • [X] Spark
  • [ ] Standalone
  • [ ] Flink
  • [ ] Kernel
  • [ ] Other (fill in here)

Description

OptimisticTransaction.readPredicates may be updated by multiple threads that call filesForScan. This commit turns it from an ArrayBuffer to a ConcurrentLinkedQueue to be thread safe.

How was this patch tested?

Existing tests.

Does this PR introduce any user-facing changes?

No

cstavr avatar May 02 '24 09:05 cstavr