Idiom

[Lake][Incremental Pipeline] Use bronze_pdr_predictions to manage active checkpoint

7

### Background / motivation Inferring where to resume the pipeline from is having issues. It's not about "removing subscriptions" from this logic, we need to think about the system and...

[Lake][OHCLV] Update OHCLV data_factory to use csv_data_writer

3

### Motivation OHLCV is still writing/reading from parquet. We may instead want to use the CSVDataStore + PersistentDataStore to save/read from. But doing this right now is hard, OHLCV code...

[Lake][DuckDB] Verify lake functionality and behavior is working as expected

7

### Motivation To verify that - The lake is working reliably, as expected - The basic flows and tables are working reliably, as expected - The commands and lake behavior...

[Lake][Subgraph][App] Update app/ & drop: PredictSlot and subgraph. Use Slot & lake.

1

### Background / motivation There are various functions inside app + subgraph, that are queryng directly from subgraph + are using an object/data schema called PredictSlot. This was causing some...

[Epic][Lake][Analytics] Create Analytics Dapp with Predictoor Income plot

6

### Motivation We want to go from tables and etl, to apps with interactive plots. The two frameworks we may consider right now are Streamlit and Dash. ### Framework Considerations...

[Lake][Subgraph] Clean up subgraph objects, use pydantic table objects instead.

1

### Background / motivation Subgraph objects (Prediction, Slot, Payout, Subscription) are unnecessary and redundant. Subgraph fetching is part of data-integration, the flow should be: 1. to validate it 2. save...

Issue1002 - Create lake & etl readme

1

Fixes #1002 Changes proposed in this PR: - [x] Communicated basics of lake, etl, and overall predictoor job into a readme. - [x] Communicated how these components are different from...

[Lake][DuckDB] Readme and UX should be well documented and work end-to-end

1

### Background / motivation To integrate duckDB (#685)[https://github.com/oceanprotocol/pdr-backend/issues/685] the user should be able to follow the README.md, get their lake setup, and complete all the work end-to-end without any issues....

[Lake][Stats][App] Test app endpoint and document README.md for how to deploy/test it

1

### Background / motivation As a result of deploying duckdb, the `accuracy/app` has been updated to query from the lake. This means that at some point, we'll have to redeploy...

[Lake][Fetching vs Joining] Fetch available data from subgraph rather than joining w/ sql.

3

### Background / motivation 1. It's easier to just fetch the data already from subgraph rather than perform a join (more costly too). These, shouldn't have to be obtain through...