Restore data very slowly please help

[jinghuaz]

I now encounter a little trouble, I have from the awsdump table of data, now restored to the local dynalite very slow, I use the java program to write inside, is there any way to help me? Optimized at the speed of write recovery？Capacity of about 3T Tks a lot.

[jinghuaz]

hi mhart， can you help me?~ thank you very much.

[mhart]

@jinghuaz are you saying you're trying to load 3TB of data into dynalite?

[jinghuaz]

yup，sure.because we want dump from AWS ,then restore to dynalite. For local index,so,i want to talk about you and hope you can help me do this.now dump is very fast,but restore very slow,3 or 4 k/s.another you can tell me your weixin or facebook?

[jinghuaz]

@mhart,I want to know how can quickly restore or write to dynalite. LevelDB?

[mhart]

@jinghuaz right, dynalite uses levelup, which can use LevelDB if you specify --path when you start it (by default it's just in-memory)

dynalite uses sublevel to break the LevelDB into sub-tables for each of the DynamoDB tables and indexes. You can see how that structure works here:

https://github.com/mhart/dynalite/blob/master/db/index.js#L59-L81

[jinghuaz]

@mhart Do you have a wechat account?