Reuven Gonzales

Partially completed by #1933 #1934 #1935

@ryscheng should we just close this now? We have links but I'm not sure it's "nice". Additionally we're missing links to downstream addresses.

This isn't high priority anymore but is likely still relevant. I don't remember the exact assets in question but I believe it's any asset using `IntervalGCSAsset` in dagster.

Docs: https://docs.dagster.io/guides/limiting-concurrency-in-data-pipelines

Hrm. This seems to be failing all default CI.

Closing this for now as it hasn't been fixed. Feel free to reopen if you can address build issues.

Note: https://dlthub.com/docs/dlt-ecosystem/table-formats/iceberg Not sure if that needs an additional step to commit it to the metastore.

Oh: https://dlthub.com/docs/plus/ecosystem/iceberg it's a paid product :(

From the dlt+ website: > Declarative yaml interfaces, disgusting.

I should probably fix this and record a loom so that anyone can do these things but we likely need to transition all data to this in bigquery due to...