spark-utils icon indicating copy to clipboard operation
spark-utils copied to clipboard

Potential security vulnerability in the zstd C library.

Open HelenParr opened this issue 3 years ago • 1 comments

Hi, @tupol , I'd like to report a vulnerable dependency in org.tupol:spark-utils-io_2.12:0.6.2.

Issue Description

I noticed that org.tupol:spark-utils-io_2.12:0.6.2 directly depends on org.apache.spark:spark-core_2.12:3.0.1 in the pom. However, as shown in the following dependency graph, org.apache.spark:spark-core_2.12:3.0.1 sufferes from the vulnerability which the C library zstd(version:1.4.3) exposed: CVE-2021-24032.

Dependency Graph between Java and Shared Libraries

image (12)

Suggested Vulnerability Patch Versions

org.apache.spark:spark-core_2.12:3.2.0 (>=3.2.0) has upgraded this vulnerable C library zstd to the patch version 1.5.0.

Java build tools cannot report vulnerable C libraries, which may induce potential security issues to many downstream Java projects. Could you please upgrade this vulnerable dependency?

Thanks for your help~ Best regards, Helen Parr

HelenParr avatar Apr 14 '22 13:04 HelenParr

Hi @HelenParr,

Thank you for reporting this issue.

Technically the spark dependencies of the spark-utils library are "light", as they are marked as provided. As such, the library's user is asked to provide binary compatibe Spark libraries' versions in the dependencies of the downstream project.

Actions needed for spark-utils:

  • perform some build tests using Spark libraries with version >= 2.12:3.2.0.
  • check the 3.0 and 3.1 Spark latest patched versions as well for the zstd dependency fix.

Thank you for your help. Cheers, Oliver Tupran

tupol avatar Apr 15 '22 12:04 tupol