MarcelloDB icon indicating copy to clipboard operation
MarcelloDB copied to clipboard

Ability to perform a bulk insert?

Open MysterDru opened this issue 4 years ago • 1 comments

I'm currently exploring different "embedded" data options for my mobile application. Ideally I want to use a nosql data store, so i'm giving MarcelloDB a try.

Right now, i have a data collection of approximately 65000 records. From some basic testing, it looks like it takes about 0.015 seconds to insert a single record with an id and 1 index. With this many records that will take a somewhere around 15 minutes to process every record and save it to the database file(s) (if i'm doing my math right).

It looks like there is only a single persist method and you have to insert records individually. Is there a way to perform a bulk insert (something like an AddRange)?

MysterDru avatar May 04 '20 20:05 MysterDru

There is currently no bulk insert. MarcelloDB is pretty fast on read, but quite slow on write.

However, the datafiles should be portable. Meaning that you should be able to populate the data and distribute the actual file to the clients. If this 65000 records is a mostly static set of data, you could generate this set on the server (once a day or so) and have the clients download this initial set. If it fits your use-case of course.

markmeeus avatar May 05 '20 06:05 markmeeus