syncstorage-rs icon indicating copy to clipboard operation
syncstorage-rs copied to clipboard

Document our Spanner architecture

Open pjenvey opened this issue 4 years ago • 5 comments

We've learned a lot about Spanner while building Durable Sync, let's extract our learnings into a high level doc describing our Spanner schema, decisions behind it, possible improvements, observations on its real world usage, etc. This could just be a .txt file living inside the repo.

Possibly a separate issue: we should document what Spanner metrics to monitor under load testing. This might be appropriate residing in our Runbook.

pjenvey avatar Apr 10 '20 23:04 pjenvey

@pjenvey I'd like to work on this because I have been meaning to get into Spanner and documenting it would be a great learning opportunity.

Emmanuel-Melon avatar Apr 10 '20 23:04 Emmanuel-Melon

@Emmanuel-Melon There is now an implementation of spanner that you can run locally. We haven't tried it yet, but if you would like to try to get it working and document it that would be helpful.

https://github.com/GoogleCloudPlatform/cloud-spanner-emulator

fzzzy avatar Apr 15 '20 14:04 fzzzy

@Emmanuel-Melon There is now an implementation of spanner that you can run locally. We haven't tried it yet, but if you would like to try to get it working and document it that would be helpful.

https://github.com/GoogleCloudPlatform/cloud-spanner-emulator Okay great, I'll run this then update you!

Emmanuel-Melon avatar Apr 15 '20 21:04 Emmanuel-Melon

@Emmanuel-Melon There is now an implementation of spanner that you can run locally. We haven't tried it yet, but if you would like to try to get it working and document it that would be helpful.

https://github.com/GoogleCloudPlatform/cloud-spanner-emulator

I just got it running locally.

Emmanuel-Melon avatar Apr 17 '20 03:04 Emmanuel-Melon

#877 added some documentation for batch commit (describing its count of mutations)

pjenvey avatar Oct 29 '20 23:10 pjenvey