pdr-backend
pdr-backend copied to clipboard
[Lake][Subgraph] Clean up subgraph objects, use pydantic table objects instead.
Background / motivation
Subgraph objects (Prediction, Slot, Payout, Subscription) are unnecessary and redundant.
Subgraph fetching is part of data-integration, the flow should be:
- to validate it
- save it to CSV
- add to duckdb-lake
Perhaps, make sure that pydantic update is in place - #973
TODOs / DoD
- [ ] Remove redundant data objects inside subgraph
- [ ] Utilize pydantic objects for validating data coming from subgraph
- [ ] Update tests or anywhere else as required
@idiom-bytes I think this can be closed, right?
Yes it can, closing...