databend
databend copied to clipboard
feat: remove streaming upload?
Summary
it is only used to load local files to Databend. instead user can
- upload to stage and run
copy into table instead. - if server runs locally only for test, user can copy into table from
fs://
cons compare with copy:
- slow because of only one ONE stream can be used, and can not ultilize cluster (unless user run multi post by himself)
- for parquet files, can not read the meta at file end until.
- it is a
insert, so no tracking of file paths like in copy.
Yes, but it would be better to introduce a settings like enable_streaming_upload, default is false.