bifrost indexer error

[davidrhodus]

I am encountering an error with the Bifrost indexer. I am using the docker-compose file.

indexer_1 | 2021-12-20 23:33:34 RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: Unable to decode storage system.events:: createType(Vec<EventRecord>):: decodeU8a: failed at 0x00020000004600fe…: {"phase":"Phase","event":"Event","topics":"Vec<Hash>"}:: decodeU8a: failed at 0x0200feff500e183a… on topics: Vec<Hash>:: Vec length 1073709056 exceeds 65536 indexer_1 | 2021-12-20T23:33:34.223Z hydra-indexer:substrate-service Failed to execute "get block events of block "0xcef215527350d1066517de8f86bd0604817ab183f7654f835b980c3fe1d3f661"" after 4 attempts. Retries left: 2 indexer_1 | 2021-12-20T23:33:36.152Z hydra-indexer:substrate-service PING indexer_1 | 2021-12-20T23:33:36.422Z hydra-indexer:substrate-service PONG. Node health: {"peers":11,"isSyncing":false,"shouldHavePeers":true} indexer_1 | 2021-12-20 23:33:42 RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: Unable to decode storage system.events:: createType(Vec<EventRecord>):: decodeU8a: failed at 0x00020000004600fe…: {"phase":"Phase","event":"Event","topics":"Vec<Hash>"}:: decodeU8a: failed at 0x0200feff500e183a… on topics: Vec<Hash>:: Vec length 1073709056 exceeds 65536 indexer_1 | 2021-12-20T23:33:42.520Z hydra-indexer:substrate-service Failed to execute "get block events of block "0xcef215527350d1066517de8f86bd0604817ab183f7654f835b980c3fe1d3f661"" after 5 attempts. Retries left: 1 indexer_1 | 2021-12-20T23:33:44.162Z hydra-indexer:producer New finalized head: {"parentHash":"0x5dfe362fef5bd65f68d701387e60e381d7e91fa530bd52cff63a1dd4b0be66b8","number":990909,"stateRoot":"0x45cf8b2966f22216d42b9338a24b77801eada34b05391b1496a834fc0a2c603a","extrinsicsRoot":"0x4ed93d39bb87462a6bd663356be84879380b1e35d97c56a994a7f7afd6cf9591","digest":{"logs":[{"preRuntime":["0x61757261","0x3a6c250800000000"]},{"seal":["0x61757261","0xb0013c963c3f6bbc90323762905ecb415bab092f87ce296709e2f452ef2f116554a1a3cfc42b5d35aa417ad66624ba59d20575aa3f8eebc70c085c0343410780"]}]}}, height: 990909 indexer_1 | 2021-12-20T23:33:56.981Z hydra-indexer:producer New finalized head: {"parentHash":"0xe30f9d32eaf235b624e4c8a97ef0fb11a21677f9a9aa9d767058935d83e40d64","number":990910,"stateRoot":"0x9ade15e5b833bdc2726f28205ec4fb3cf89d002593d67bf46368b3ee8b050ad1","extrinsicsRoot":"0x6af3ba0be52092ed2be42217b27bf42a572c006f036bf558d623a6ada77982d0","digest":{"logs":[{"preRuntime":["0x61757261","0x3b6c250800000000"]},{"seal":["0x61757261","0xf678c895eb577132faec8d77c1f041b4883f2275dff602b01a455631d8b60b604efefcdbae760244ba45466da23f81a68e7ae546d5abe576633344076f23168a"]}]}}, height: 990910 indexer_1 | 2021-12-20 23:33:58 RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: Unable to decode storage system.events:: createType(Vec<EventRecord>):: decodeU8a: failed at 0x00020000004600fe…: {"phase":"Phase","event":"Event","topics":"Vec<Hash>"}:: decodeU8a: failed at 0x0200feff500e183a… on topics: Vec<Hash>:: Vec length 1073709056 exceeds 65536 indexer_1 | 2021-12-20T23:33:58.818Z hydra-indexer:substrate-service Failed to execute "get block events of block "0xcef215527350d1066517de8f86bd0604817ab183f7654f835b980c3fe1d3f661"" after 6 attempts. Retries left: 0 indexer_1 | 2021-12-20T23:33:58.818Z index-builder:pooled-executor Error during execution indexer_1 | 2021-12-20T23:33:58.818Z index-builder:indexer Index builder has been stopped indexer_1 | 2021-12-20T23:33:58.818Z hydra-indexer:producer Block producer has been stopped indexer_1 | 2021-12-20T23:33:58.819Z hydra-indexer:manager Stopping the indexer due to errors: {} name: Error, message: One of the workers have failed, stopping the pool. { indexer_1 | "attemptNumber": 4, indexer_1 | "retriesLeft": 0 indexer_1 | } name: Error, message: Unable to decode storage system.events:: createType(Vec<EventRecord>):: decodeU8a: failed at 0x00020000004600fe…: {"phase":"Phase","event":"Event","topics":"Vec<Hash>"}:: decodeU8a: failed at 0x0200feff500e183a… on topics: Vec<Hash>:: Vec length 1073709056 exceeds 65536, stack: Error: Unable to decode storage system.events:: createType(Vec<EventRecord>):: decodeU8a: failed at 0x00020000004600fe…: {"phase":"Phase","event":"Event","topics":"Vec<Hash>"}:: decodeU8a: failed at 0x0200feff500e183a… on topics: Vec<Hash>:: Vec length 1073709056 exceeds 65536 indexer_1 | at RpcCore._newType (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:454:13) indexer_1 | at RpcCore._formatStorageData (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:403:17) indexer_1 | at RpcCore._formatOutput (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:380:19) indexer_1 | at RpcCore._formatResult (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:238:27) indexer_1 | at callWithRegistry (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:259:19) indexer_1 | at processTicksAndRejections (internal/process/task_queues.js:95:5), stack: Error: One of the workers have failed, stopping the pool. { indexer_1 | "attemptNumber": 4, indexer_1 | "retriesLeft": 0 indexer_1 | } name: Error, message: Unable to decode storage system.events:: createType(Vec<EventRecord>):: decodeU8a: failed at 0x00020000004600fe…: {"phase":"Phase","event":"Event","topics":"Vec<Hash>"}:: decodeU8a: failed at 0x0200feff500e183a… on topics: Vec<Hash>:: Vec length 1073709056 exceeds 65536, stack: Error: Unable to decode storage system.events:: createType(Vec<EventRecord>):: decodeU8a: failed at 0x00020000004600fe…: {"phase":"Phase","event":"Event","topics":"Vec<Hash>"}:: decodeU8a: failed at 0x0200feff500e183a… on topics: Vec<Hash>:: Vec length 1073709056 exceeds 65536 indexer_1 | at RpcCore._newType (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:454:13) indexer_1 | at RpcCore._formatStorageData (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:403:17) indexer_1 | at RpcCore._formatOutput (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:380:19) indexer_1 | at RpcCore._formatResult (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:238:27) indexer_1 | at callWithRegistry (/hydra/node_modules/@polkadot/rpc-core/bundle.cjs:259:19) indexer_1 | at processTicksAndRejections (internal/process/task_queues.js:95:5) indexer_1 | at poller (/hydra/packages/hydra-indexer/lib/indexer/PooledExecutor.js:79:27) indexer_1 | at processTicksAndRejections (internal/process/task_queues.js:95:5) indexer_1 | at async Promise.all (index 0) indexer_1 | at async PooledExecutor.run (/hydra/packages/hydra-indexer/lib/indexer/PooledExecutor.js:88:9) indexer_1 | at async IndexBuilder.start (/hydra/packages/hydra-indexer/lib/indexer/IndexBuilder.js:53:13) indexer_1 | at async Function.index (/hydra/packages/hydra-indexer/lib/node/IndexerStarter.js:33:13) indexer_1 | at async runIndexer (/hydra/packages/hydra-indexer/lib/run.js:73:5) indexer_1 | at async /hydra/packages/hydra-indexer/lib/run.js:25:9 indexer_1 | at async Command. (/hydra/packages/hydra-indexer/lib/run.js:14:13) indexer_1 | 2021-12-20T23:33:58.819Z hydra-indexer:manager Cleaning up the indexer... indexer_1 | 2021-12-20T23:33:58.819Z index-builder:redis-factory Closing Redis connections indexer_1 | 2021-12-20T23:33:58.819Z hydra-indexer:substrate-service Stopping substrate service indexer_1 | 2021-12-20T23:33:58.819Z index-builder:indexer Index builder has been stopped indexer_1 | 2021-12-20T23:33:58.819Z hydra-indexer:producer Block producer is not started indexer_1 | 2021-12-20T23:33:58.819Z hydra-indexer:manager Closing the database connection indexer_1 | 2021-12-20T23:33:58.820Z hydra-indexer:substrate-service Api disconnected indexer_1 | 2021-12-20T23:33:58.820Z hydra-indexer:substrate-service Done indexer_1 | 2021-12-20T23:33:58.820Z hydra-indexer:manager Bye! indexer_1 | error Command failed with exit code 255. indexer_1 | info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command. bifrost_indexer_1 exited with code 255