AvroConvert icon indicating copy to clipboard operation
AvroConvert copied to clipboard

Issues with Azure ADX

Open wdcossey opened this issue 9 months ago • 7 comments

I'm having issues with Azure ADX.

I would like to write data (1000s, 100000s records) to a file that will be pushed to Azure ADX for processing.

Whilst the library is simple enough to get working, Azure does not like the schema that is given.

I simply tried serializing a list of objects (say 2-10) and wrote that to a file and uploaded it, it failed.

Writing a single object does however work.

I also tried Merge, that also failed to work.

My understanding is that ADX doesn't understand the array data type.

Is what I'm attempting to do even possible? I wouldn't want to send 10,000 individual files.

wdcossey avatar Oct 02 '23 20:10 wdcossey