aws-samples
Amazon Linux 2023 version works has dependency issues
Amazon Linux 2023 version works has dependency issues Pyspark=3.3.0 is not installing properly but works with Amazon Linux 2
Comparing the .toml files for the master branch and version 3.3.0 of PySpark, the notable differences are in the tool.black section. For the master branch, the required version of Black (a Python code formatter) is 23.9.1, targeting Python version py38, and excludes error_classes.py in addition to cloudpickle. In contrast, for version 3.3.0, the required version of Black is 21.12b0, targeting Python version py37, and does not exclude error_classes.py, only cloudpickle. These differences reflect updates in coding standards and compatibility adjustments between the versions.