chainquery icon indicating copy to clipboard operation
chainquery copied to clipboard

Host db checkpoints every 10K blocks for chainquery

Open tiger5226 opened this issue 6 years ago • 2 comments

As referenced here by Lenny, we should have a quicker way to get chainquery setup and running. Our production instance should create state backups every 10K blocks or so, so that we can then host for people to get it up and running faster.

We need to investigate what options MySQL offers for this and we need to run tests to make sure we are getting a benefit. should we do "incremental" or "up to" backups that we replace periodically.

tiger5226 avatar Oct 02 '18 23:10 tiger5226

I'll get something set up here via an S3 bucket. Using https://github.com/lbryio/lbry-docker at the very least.

Leopere avatar Oct 06 '18 21:10 Leopere

A quick update on this one. @Leopere and I got the dockerized Chainquery running on the dev instance of Chainquery. It is populating the database now. This is where we will be able to take snapshots. Still need to add Cron job to snap shot data directory and upload it to S3 from the dev environment. The snapshot currently there is corrupted.

tiger5226 avatar Nov 05 '18 02:11 tiger5226