ethereum-etl-airflow

ethereum-etl-airflow copied to clipboard

## What? This repo has a lot of under the hoods options and most of them are not expressed in detail. For example - AWS Variables and Steps - GCP...

r4881t

Step #1: airflow variables command error: argument COMMAND: invalid choice: '/home/airflow/gcs/data//airflow_variables.json' (choose from 'delete', 'export', 'get', 'import', 'list', 'set'), see help above. Step #1: command terminated with exit code 2...

azaidelson

Missing `blocks` table when running first time

1

Hi, I followed the steps for GCP and created the project and datasets. When running for first time, I get the error in **ethereum_verify_streaming_dag** ``` [2022-07-27 03:40:24,285] {taskinstance.py:670} INFO -...

r4881t

Create a function that generates SQL for a table definition that can be run in BigQuery

1

This will allow validating complex table definitions like these https://github.com/blockchain-etl/ethereum-etl-airflow/commit/ba6235d93c575e9d1958cd1d9c81da00f13cac29 in BigQuery, before a PR is created

medvedev1088

Issue: Permission bigquery.tables.create denied on dataset blockchain-etl-internal:common (or it may not exist).

1

The ethereum_amend_dag is using the blockchain-etl-internal table I assume to transform contract and token tables using contract abi. I do however end up with an issue it's trying to create...

zeedevio

I’m interested in the USD-ETH feed and would like to query the Aggregator_ETH_USD_event_AnswerUpdated event database to get updated ETH prices. When querying in BigQuery's console, the database doesn't appear to...

liambeckman199

Missing logs_by_topic table

3

Hi all, When attempting to run the DAGs for the first time, we are unable to see where the "logs_by_topic" table is getting populated for our log event. ``` WITH...

johnayoung

Why is ethereum_load_dag's start date different from the first run date?

2

 is this wrong or right?

wuminzhe

how much build these etl service, include bigquery service fee

navyxie

ethers.js doesn't yet support parsing anonymous events: https://github.com/ethers-io/ethers.js/blob/master/packages/abi/lib.esm/interface.js#L466 Ask in their support group how it can be done with ethers.js.

medvedev1088