polygon-etl icon indicating copy to clipboard operation
polygon-etl copied to clipboard

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Results 17 polygon-etl issues
Sort by recently updated
recently updated
newest added

Hi blockchain-etl team! I got a question - can I speed up somehow extractions of receipts and logs? Setup: -`polygonetl, version 3.4.2` (ran in a kubernetes pod with 3000Mi memory...

When i use the "export_all" command I am getting the following error for the receipts data (i could extract receipt data via the export receipts command) but would appreciate support...

Could you please help me with the following error `/lib/python3.9/site-packages/web3/manager.py", line 112, in request_blocking raise ValueError(response["error"]) ValueError: {'code': -32004, 'message': 'the method eth_newFilter does not exist/is not available'}` I get...

I followed the streaming documentation successfully and went through the dataflow documentation, but found it's both not up to date and doesn't work for me. #1 for the bigquery command,...

- upgrade requirements to match `composer-2.0.16-airflow-2.2.5` with `python 3.8.12` - update Airflow code (operators, hooks, etc) to pass DagBag tests TODO: - investigate and maybe fix (some) deprecation warnings in...

**Description:** I have deployed ERC-20 contract on the Polygon testnet (Mumbai) While testing different commands, i have noticed that calling: polygonetl filter_items -i contracts.csv -p "item['is_erc20'] or item['is_erc721']" | polygonetl...

**Description:** I have deployed ERC-20 contract on the Polygon testnet (Mumbai) While testing different commands, i have noticed that calling: `polygonetl export_contracts --contract-addresses contract_addresses.txt --provider-uri http://matic-mumbai.chainstacklabs.com --output contracts.csv` returns all...

This commit is similar to the EIP-1559 pull request for ethereum-etl: https://github.com/blockchain-etl/ethereum-etl/pull/256 The changes has been tested with `export_blocks_and_transactions` command. I created separate pull requests for airflow and dataflow changes,...

This change adds new fields introduced by EIP-1559 to dataflow module. It has a dependency on https://github.com/blockchain-etl/polygon-etl/pull/64. Reference change for Ethereum: - https://github.com/blockchain-etl/blockchain-etl-dataflow/pull/6