parabol
parabol copied to clipboard
Stop writing User to rethink
Requires: #5384, #4867 and #5507
When all reads for User
come from PG we should stop writing to rethink
Acceptance criteria
- [ ]
db.write
anddb.writeTable
are removed - [ ] database/types/User.ts type is removed
@Dschoordsch by all means feel free to throw away the db.write
pattern & go directly to the database or a dataloader!
the db.write
pattern of caching the User object was primarily because I wanted to see if I could remove some pressure from RethinkDB. Postgres can certainly handle the additional queries so we don't need to cache so aggressively.
@Dschoordsch before we stop writing to rethink, I'd very much like to have hired our Data Architect and coordinate this making this change We have a bunch of queries in https://github.com/ParabolInc/parabol-data-notebooks we use to keep tabs on various low level metrics. It'd be great to:
- Get
User
moved over to a data warehouse or, failing that, - Update these notebooks to query from Postgres instead
Sure, I created #5507 so this is visible.
Stale issue
scrubbed, still a thing
@tghanken can we stop writing to User
in Rethink from your perspective?
@tghanken can we stop writing to
User
in Rethink from your perspective?
Yes, there's nothing on our end stopping this at this point.
@jordanh I still see this single User
read in the mentioned notebooks https://github.com/ParabolInc/parabol-data-notebooks/blob/44152c7e57bf4c4952b959f958ac818838be3d36/Marketing/Users%20Last%20Seen.ipynb Is this used?
I don't believe anyone is using those notebooks anymore. Everyone should now be reading from BigQuery instead. If necessary, I can submit a fix on that notebook code to move the read to Postgres, but I don't think it should stop us from moving forward with this issue.
Stale issue
fixed in #8116