incubator-graphar
incubator-graphar copied to clipboard
[Feat] Support more file formats for payload files
Is your feature request related to a problem? Please describe. The GraphAr's chunk files could be stored in ORC, parquet or CSV now. We can support more builtin file formats like Json, hdf5 and avro to enhance the capacity of GraphAr and satisfy different requirements for file formats.
Describe the solution you'd like Support more file types by extending the metadata information and implement related reading/writing functions with help of arrow or other third-party libraries.
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context Add any other context or screenshots about the feature request here.
HDF5 could be the first First priority and is the good first issue to address.