audius-protocol icon indicating copy to clipboard operation
audius-protocol copied to clipboard

Published 20 hours ago • verified publisher icon AudiusProject

Backfill subscriptions

Open michellebrier opened this issue 2 years ago • 2 comments

Description

Backfill subscriptions table in discovery DB with data from Subscriptions in identity DB. Do not merge until after dual writes to identity and discovery have been turned on in the client. Before merging, update csvs with most recent data from Subscriptions in identity.

Size of prod csv is 5.6 MB

Tests

Ran + timed backfill on prod clone. Ran in ~10s (up and down) for 363,144 records.

Monitoring - How will this change be monitored? Are there sufficient logs / alerts?

michellebrier avatar Nov 10 '22 00:11 michellebrier

Sorry for delay... looks good!

If @dharit-tan has success with copy_from we can use that API in the future.

Yup it worked!! lmk if can help here. Also @michellebrier I added a migration for the audio_transactions_history backfillers so you might need to update your migration hashes.

dharit-tan avatar Dec 09 '22 19:12 dharit-tan