usaspending-api icon indicating copy to clipboard operation
usaspending-api copied to clipboard

Ftr/pipe 311 sam recipient load table from brokerdb

Open bkschmidt opened this issue 2 years ago • 0 comments

Description: Add support to load the sam_recipient table from broker to load_query_to_delta.py

Technical details: The high level tech approach for this story is to create a jdbc proxy view on the broker database sam_recipient table. Once this view has been created, SQL very similar to that in the existing restock_duns.sql file can be used to transform the data into the required schema. Requirements for PR merge:

  1. [x] Unit & integration tests updated
  2. [x] API documentation updated
  3. [x] Necessary PR reviewers:
    • [x] Backend
    • [ ] Frontend <OPTIONAL>
    • [ ] Operations <OPTIONAL>
    • [ ] Domain Expert <OPTIONAL>
  4. [x] Matview impact assessment completed
  5. [x] Frontend impact assessment completed
  6. [x] Data validation completed
  7. [x] Appropriate Operations ticket(s) created
  8. [x] Jira Ticket PIPE-311:
    • [x] Link to this Pull-Request
    • [x] Performance evaluation of affected (API | Script | Download)
    • [ ] Before / After data comparison

Area for explaining above N/A when needed:

bkschmidt avatar Jul 11 '22 20:07 bkschmidt