pandavro

pandavro copied to clipboard

I see that the config is ``` deploy: provider: pypi user: pyncha password: secure: **** on: tags: true python: 3.9 ``` so it doesn't auto-release https://pypi.org/project/pandavro/#history. Not being an expert...

marctorsoc

Feature request: Could you allow for process_record function while reading in avro? Here is a suggestion. ``` def __file_to_dataframe(f, schema, process_record=None, **kwargs): reader = fastavro.reader(f, reader_schema=schema) records = list() if...

gityow

Datetime-like values errors

2

Got some problems with datetime-like values. Tried with pandas `1.0.3` and `0.25.3`, both don't working. fastavro `0.23.4`. ### date ``` Traceback (most recent call last): File "", line 1, in...

grkhr

fix read_avro kwargs + cleanup tests

1

This PR solves two issues: 1. In a previous [PR](https://github.com/ynqa/pandavro/pull/35), the `columns` kwarg of `from_records` was promoted to read_avro to save RAM. However, this meant that all rows were read,...

marctorsoc

from_records() got an unexpected keyword argument 'na_dtypes'

2

Hi, First of all: many thanks for pandavro! It's incredibly useful in day-to-day data operations. When using read_avro() with na_dtypes=True, I get the following TypeError, using Pandas 1.3.5: ``` from_records()...

JeroenDedimo

`setup.py` has: ```python install_requires=[ # fixed versions. 'fastavro==1.5.1', 'pandas>=1.1', # https://pandas.pydata.org/pandas-docs/version/1.1/getting_started/install.html#dependencies 'numpy>=1.15.4', ], ``` This causes a dependency resolution failure for me because I'm using another package that requires `fastavro>=1.5.4`....

deleted

I have my Avro Schema as below: `schema = { "namespace": "example.avro", "type": "record", "name": "IoTData", "fields": [ {"name": "nodeId", "type": ["null", "string"], "default": None}, {"name": "displayName", "type": ["null", "string"],...

numersoz

The latest release (1.7.2) is restrcting `fastavro~=1.5.1`, which translates to `>=1.5.1 ,

ghost

ValueError: snappy codec is supported but you need to install python-snappy

YuriyGavrilov

decimal logical type : TypeError: can only concatenate str (not "int") to str

1

am trying to convert an existing csv to avro using pandavro. am not able to resolve the below error: File "fastavro/_logical_writers.pyx", line 130, in fastavro._logical_writers.prepare_bytes_decimal File "fastavro/_logical_writers.pyx", line 143, in...

balaby25