pdr-backend
pdr-backend copied to clipboard
[ETL][Lake] - Update existing code to query database by using PersistentDataStore.query_data
trafficstars
Motivation
- Review pds.query_data.
- Consider not returning a polars lazy_frame but something else... perhaps a generic pointer where you can then do more with it.
DoD:
- [ ] Updated existing logic that queries data from PDS/SQL, to get a better pointer to the data
- [ ] When using polars/pandas, the usage should be stable
- [ ] Tests are updated and passing