llama_index
llama_index copied to clipboard
[WIP] Add pandas-based tabular parser
As per the discussion in discord, this is a draft of a CSV parser that uses pandas for loading the CSV data.
If this goes in the right direction, we could also add an Excel / OpenDocument Table format in the same style. (And notebooks to showcase it, if that makes sense?)
I also fixed the documentation of the existing CSV parser.
@ephe-meral sorry just checking, is this ready to review?
@jerryjliu Yes please - my intention was to provide a conversation starting point, i.e. to potentially improve/iterate this to make it fit our needs. But functionality wise it could also be merged IMO, should already be useful (and certainly enough for my use case). I'll remove the WIP for now.