lnx icon indicating copy to clipboard operation
lnx copied to clipboard

Import data from local file directly.

Open ChillFish8 opened this issue 3 years ago • 2 comments

As of right now you can only submit data to LNX over HTTP which makes it quite tedious for large dumped indexes where half your time is waiting on DIskIO to even read the data and send it over the network rather than for lnx to process. Similar to postgres' csv import system I think it would be a good idea.

ChillFish8 avatar Nov 01 '21 17:11 ChillFish8

Sending an array of 1000 documents or more at once reduces the network overhead and makes working with lnx already fun. Anyway I would love to import from database. I was wondering if I could create a rust comandline app that uses the internal API of lnx directly and offers a way to pass a SQL statement and DB driver settings.

keywan-ghadami-oxid avatar Jan 29 '22 23:01 keywan-ghadami-oxid

Sending an array of 1000 documents or more at once reduces the network overhead and makes working with lnx already fun. Anyway I would love to import from database. I was wondering if I could create a rust comandline app that uses the internal API of lnx directly and offers a way to pass a SQL statement and DB driver settings.

That might be a good idea to add to the lnx-cli tool. Which I'm aiming to sort of become the 'hub' for that sort of thing.

ChillFish8 avatar Jan 30 '22 10:01 ChillFish8