blockchain2graph icon indicating copy to clipboard operation
blockchain2graph copied to clipboard

An Error ocurred while processing a Block: Origin Transaction not found

Open teachmlrepo opened this issue 5 years ago • 19 comments

Hello,

I receive a message on dasbhboard like An Error ocurred while processing a Block: Origin Transaction not found, and the block number 107906 is currently being processed for a long time Is this Normal behaviour is there any issue, I have a 32GB, 8 Core 1TB machine

with regards

teachmlrepo avatar Sep 10 '20 22:09 teachmlrepo

seems there was a big problem :( strange, it should not occur. I think you have to delete and restart. Really sorry. U r using the 3.0 release ?

straumat avatar Sep 11 '20 07:09 straumat

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

neo4j: image: neo4j:3.5.12 volumes: - ./data/neo4j:/var/lib/neo4j/data ports: - 7474:7474 - 7687:7687 environment: - NEO4J_AUTH=neo4j/neo4j123

I have used this docker-compose.yml https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports: - 8080:8080 links: - bitcoin-core - neo4j environment: - BITCOINCORE_HOSTNAME=bitcoin-core - BITCOINCORE_USERNAME=bitcoinrpc - BITCOINCORE_PASSWORD=JRkDy3tgCYdmCEqY1VdfdfhTswiRva

  • SPRING_DATA_NEO4J_URI=bolt://neo4j:neo4j123@neo4j:7687

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

I am using this docker-compose https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

I am using this docker-compose https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

teachmlrepo avatar Sep 11 '20 10:09 teachmlrepo

This should have never happend :( a transaction is missing but I use transaction so a block could not have a missing transaction :(

straumat avatar Sep 11 '20 15:09 straumat

Ok How can I ensure bitcoin is converted to a graph can I bypass this issue / avoid this issue to get a complete graph on my server Thanks

teachmlrepo avatar Sep 11 '20 22:09 teachmlrepo

Can you please let me know which version of bitcoin-core and bitcoin2graph should be used, I have tried 3.2.2 SNAPSHOT , with bitcoin-core 0.20.1 I get An error occurred while processing block : Error mapping GraphModel; nested exception is org.neo4j.ogm.exception.core.MappingException: Error mapping GraphModel

Hope this will not have any impact on building graph

teachmlrepo avatar Sep 13 '20 14:09 teachmlrepo

You should use the 3.0.0 release. and it's tested in bitcoin 0.18.

straumat avatar Sep 14 '20 07:09 straumat

Thank you

teachmlrepo avatar Sep 14 '20 10:09 teachmlrepo

I have used 3.0 and 0.18.1 the GUI says 100 007 blocks in bitcore

May I know if additional blocks aare added and updated in real time what is the max blocks expected as of today. Will the bitcioin core node in real itme update neo4j database ?

i see this log , I am confused why block size is not increasing

2020-09-15T10:30:56Z Pre-allocating up to position 0xf00000 in rev02239.dat bitcoin-core_1 | 2020-09-15T10:30:56Z UpdateTip: new best=000000000000000000096888085829a5027e71a4e16a2fdb5bca9c98fd7c74f1 height=648399 version=0x20800000 log2_work=92.28727 tx=568464980 date='2020-09-15T10:30:39Z' progress=1.000000 cache=626.6MiB(4650302txo) warning='70 of last 100 blocks have unexpected version' blockchain2graph-bitcoin-neo4j_1 | 10:34:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 10:34:43 - No block to process, Retrying in 10 minutes blockchain2graph-bitcoin-neo4j_1 | 10:44:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 10:44:43 - No block to process, Retrying in 10 minutes bitcoin-core_1 | 2020-09-15T10:46:34Z UpdateTip: new best=0000000000000000000665a961b2f59a498a7b47399e8a0b6779c1b16d66c116 height=648400 version=0x20800000 log2_work=92.287287 tx=568467913 date='2020-09-15T10:46:03Z' progress=1.000000 cache=627.0MiB(4654075txo) warning='70 of last 100 blocks have unexpected version' blockchain2graph-bitcoin-neo4j_1 | 10:54:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 10:54:43 - No block to process, Retrying in 10 minutes bitcoin-core_1 | 2020-09-15T10:57:20Z UpdateTip: new best=0000000000000000000c9065749e5011b9c5ca709265c9a965aad40c67374a59 height=648401 version=0x3fffe000 log2_work=92.287305 tx=568470671 date='2020-09-15T10:57:21Z' progress=1.000000 cache=627.3MiB(4656706txo) warning='70 of last 100 blocks have unexpected version' bitcoin-core_1 | 2020-09-15T11:00:30Z UpdateTip: new best=000000000000000000048996fe5ca412f21385d3088d05f87339d5a615d98f35 height=648402 version=0x3fff0000 log2_work=92.287323 tx=568473385 date='2020-09-15T11:00:21Z' progress=1.000000 cache=627.5MiB(4658059txo) warning='70 of last 100 blocks have unexpected version' blockchain2graph-bitcoin-neo4j_1 | 11:04:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 11:04:43 - No block to process, Retrying in 10 minutes bitcoin-core_1 | 2020-09-15T11:05:21Z UpdateTip: new best=000000000000000000064a661fa944becf36444edda3b936d2f6f510fa731656 height=648403 version=0x20800000 log2_work=92.287341 tx=568475914 date='2020-09-15T11:04:59Z' progress=1.000000 cache=628.5MiB(4666499txo) warning='70 of last 100 blocks have unexpected version'

WHere can i find some information related to these Thanks

teachmlrepo avatar Sep 15 '20 11:09 teachmlrepo

New blocks are added in real time. This message is strange : bitcoin-core_1 | 2020-09-15T11:05:21Z UpdateTip: new best=000000000000000000064a661fa944becf36444edda3b936d2f6f510fa731656 height=648403 version=0x20800000 log2_work=92.287341 tx=568475914 date='2020-09-15T11:04:59Z' progress=1.000000 cache=628.5MiB(4666499txo) warning='70 of last 100 blocks have unexpected version'

Can you check how many block you have in bitcoin core please ?

straumat avatar Sep 21 '20 07:09 straumat