horaedb icon indicating copy to clipboard operation
horaedb copied to clipboard

Support bulkload data in some popular format

Open ShiKaiWi opened this issue 3 years ago • 2 comments

Describe This Problem

Currently, it is difficult to import data into ceresdb if the raw data is available in some popular format (CSV, parquet). And the only way is to parse the original data and write it to ceresdb by api.

Proposal

A bulkload api should be provided to do such things. User just tells ceresdb the data file path and its format, and ceresdb will do the bulkload work by itself.

Additional Context

Here is the similar feature provided by DuckDB: https://duckdb.org/docs/data/overview

ShiKaiWi avatar Oct 27 '22 07:10 ShiKaiWi

Previously discussed at https://github.com/CeresDB/ceresdb/issues/153#issuecomment-1207363994

jiacai2050 avatar Oct 27 '22 11:10 jiacai2050

#925 is part of this issue.

ShiKaiWi avatar Jun 01 '23 08:06 ShiKaiWi