delta icon indicating copy to clipboard operation
delta copied to clipboard

[BUG] mac idea write_uniform_hudi.py failed

Open liujinhui1994 opened this issue 6 months ago • 0 comments

Bug

idea run write_uniform_hudi.py error。 python version 3.11 pyspark 3.5.1

/Users/liujinhui/community/delta/venv/bin/python -X pycache_prefix=/Users/liujinhui/Library/Caches/JetBrains/IntelliJIdea2023.3/cpython-cache /Users/liujinhui/Library/Application Support/JetBrains/IntelliJIdea2023.3/plugins/python/helpers/pydev/pydevd.py --multiprocess --qt-support=auto --client 127.0.0.1 --port 49397 --file /Users/liujinhui/community/delta/hudi/integration_tests/write_uniform_hudi.py Connected to pydev debugger (build 233.13135.103) Traceback (most recent call last): File "", line 1176, in _find_and_load File "", line 1147, in _find_and_load_unlocked File "", line 690, in _load_unlocked File "", line 940, in exec_module File "", line 241, in _call_with_frames_removed File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/testing/init.py", line 19, in from pyspark.testing.pandasutils import assertPandasOnSparkEqual File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/testing/pandasutils.py", line 27, in import pyspark.pandas as ps File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/pandas/init.py", line 60, in from pyspark.pandas.indexes.base import Index File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/pandas/indexes/init.py", line 17, in from pyspark.pandas.indexes.base import Index # noqa: F401 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/pandas/indexes/base.py", line 66, in from pyspark.pandas.series import Series, first_series File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/pandas/series.py", line 118, in from pyspark.pandas.strings import StringMethods File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/pandas/strings.py", line 44, in class StringMethods: File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/pyspark/pandas/strings.py", line 1332, in StringMethods def match(self, pat: str, case: bool = True, flags: int = 0, na: Any = np.NaN) -> "ps.Series": ^^^^^^ File "/Users/liujinhui/community/delta/venv/lib/python3.11/site-packages/numpy/init.py", line 397, in getattr raise AttributeError( AttributeError: np.NaN was removed in the NumPy 2.0 release. Use np.nan instead.. Did you mean: 'nan'?

liujinhui1994 avatar Aug 05 '24 08:08 liujinhui1994