TypeError: cannot convert 'int' object to bytes
I had an error when trying to open a parquet file:
Traceback (most recent call last):
File "/local/workplace/lib/python3.6/site-packages/lambda_handlers/parquet_test.py", line 57, in lambda_handler
for row in parquet.reader(fin):
File "/local/workplace/lib/python3.6/site-packages/parquet/init.py", line 470, in reader
dict_items)
File "/local/workplace/lib/python3.6/site-packages/parquet/init.py", line 340, in read_data_page
if schema_element.converted_type is not None else read_values
File "/local/workplace/lib/python3.6/site-packages/parquet/converted_types.py", line 68, in convert_column
return [Decimal(intbig(unscaled)) * scale_factor for unscaled in data]
File "/local/workplace/lib/python3.6/site-packages/parquet/converted_types.py", line 68, in
I got a similar error and determined it was choking on a column of type FIXED_LEN_BYTE_ARRAY. I was able to work around this by excluding the column.
Traceback (most recent call last):
File ".\parquetexport3.py", line 102, in
File "C:\Users\m\AppData\Local\Programs\Python\Python38-32\lib\site-packages\parquet\converted_types.py", line 66, in convert_column
return [Decimal(intbig(unscaled)) * scale_factor for unscaled in data]
File "C:\Users\m\AppData\Local\Programs\Python\Python38-32\lib\site-packages\parquet\converted_types.py", line 66, in
Thanks!