Begin rewrites to fullnode indexer

[clay-aptos]

Description

Rewrite fullnode indexer setup to address customer feedback and start support for Docker.

Test Plan

Manual review and test.

---

This change is 

[clay-aptos]

plz change the command.

Done!

[clay-aptos]

please remove the TODOs or hide them.

I have moved them all to the corresponding issue: https://github.com/aptos-labs/aptos-core/issues/5395

[github-actions[bot]]

Forge is running suite land_blocking on 428edfc77261d6853b6709d15f5b84afb193ed5f

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite compat on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 428edfc77261d6853b6709d15f5b84afb193ed5f

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite land_blocking success on 428edfc77261d6853b6709d15f5b84afb193ed5f

performance benchmark with full nodes : 6539 TPS, 6041 ms latency, 17800 ms p99 latency,(!) expired 2120 out of 2794580 txns
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite compat success on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 428edfc77261d6853b6709d15f5b84afb193ed5f

Compatibility test results for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 428edfc77261d6853b6709d15f5b84afb193ed5f (PR)
1. Check liveness of validators at old version: testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b
compatibility::simple-validator-upgrade::liveness-check : 7308 TPS, 5277 ms latency, 6800 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: 428edfc77261d6853b6709d15f5b84afb193ed5f
compatibility::simple-validator-upgrade::single-validator-upgrade : 4656 TPS, 8975 ms latency, 11600 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: 428edfc77261d6853b6709d15f5b84afb193ed5f
compatibility::simple-validator-upgrade::half-validator-upgrade : 4934 TPS, 8401 ms latency, 10900 ms p99 latency,no expired txns
4. upgrading second batch to new version: 428edfc77261d6853b6709d15f5b84afb193ed5f
compatibility::simple-validator-upgrade::rest-validator-upgrade : 6390 TPS, 5885 ms latency, 10800 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 428edfc77261d6853b6709d15f5b84afb193ed5f passed
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite land_blocking on afb4bd667f4760895c3f7d87044aac595bd1701c

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite compat on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cf96cd48830cc1c3f1664ef8260f66b891cc33ac

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite land_blocking on cf96cd48830cc1c3f1664ef8260f66b891cc33ac

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite compat success on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cf96cd48830cc1c3f1664ef8260f66b891cc33ac

Compatibility test results for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cf96cd48830cc1c3f1664ef8260f66b891cc33ac (PR)
1. Check liveness of validators at old version: testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b
compatibility::simple-validator-upgrade::liveness-check : 6911 TPS, 5569 ms latency, 8200 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: cf96cd48830cc1c3f1664ef8260f66b891cc33ac
compatibility::simple-validator-upgrade::single-validator-upgrade : 4882 TPS, 8000 ms latency, 10400 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: cf96cd48830cc1c3f1664ef8260f66b891cc33ac
compatibility::simple-validator-upgrade::half-validator-upgrade : 5021 TPS, 7814 ms latency, 10500 ms p99 latency,no expired txns
4. upgrading second batch to new version: cf96cd48830cc1c3f1664ef8260f66b891cc33ac
compatibility::simple-validator-upgrade::rest-validator-upgrade : 6841 TPS, 5719 ms latency, 10800 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cf96cd48830cc1c3f1664ef8260f66b891cc33ac passed
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite land_blocking success on cf96cd48830cc1c3f1664ef8260f66b891cc33ac

performance benchmark with full nodes : 6713 TPS, 5950 ms latency, 10400 ms p99 latency,no expired txns
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite compat on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 168f324239fa157721176f5a21e20e8a17617f7e

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite land_blocking on 168f324239fa157721176f5a21e20e8a17617f7e

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite compat success on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 168f324239fa157721176f5a21e20e8a17617f7e

Compatibility test results for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 168f324239fa157721176f5a21e20e8a17617f7e (PR)
1. Check liveness of validators at old version: testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b
compatibility::simple-validator-upgrade::liveness-check : 7484 TPS, 5115 ms latency, 7600 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: 168f324239fa157721176f5a21e20e8a17617f7e
compatibility::simple-validator-upgrade::single-validator-upgrade : 4794 TPS, 8530 ms latency, 10900 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: 168f324239fa157721176f5a21e20e8a17617f7e
compatibility::simple-validator-upgrade::half-validator-upgrade : 4534 TPS, 9246 ms latency, 12100 ms p99 latency,no expired txns
4. upgrading second batch to new version: 168f324239fa157721176f5a21e20e8a17617f7e
compatibility::simple-validator-upgrade::rest-validator-upgrade : 7003 TPS, 5480 ms latency, 8400 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 168f324239fa157721176f5a21e20e8a17617f7e passed
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite land_blocking success on 168f324239fa157721176f5a21e20e8a17617f7e

performance benchmark with full nodes : 6614 TPS, 5961 ms latency, 20900 ms p99 latency,(!) expired 2556 out of 2826920 txns
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite land_blocking on cb2a9155d13d87859ca2bec2b30f44f7af02c09f

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

Forge is running suite compat on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cb2a9155d13d87859ca2bec2b30f44f7af02c09f

• Grafana dashboard (auto-refresh)
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite compat success on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cb2a9155d13d87859ca2bec2b30f44f7af02c09f

Compatibility test results for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cb2a9155d13d87859ca2bec2b30f44f7af02c09f (PR)
1. Check liveness of validators at old version: testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b
compatibility::simple-validator-upgrade::liveness-check : 7403 TPS, 5225 ms latency, 7100 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: cb2a9155d13d87859ca2bec2b30f44f7af02c09f
compatibility::simple-validator-upgrade::single-validator-upgrade : 4773 TPS, 8397 ms latency, 10600 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: cb2a9155d13d87859ca2bec2b30f44f7af02c09f
compatibility::simple-validator-upgrade::half-validator-upgrade : 4381 TPS, 9710 ms latency, 12800 ms p99 latency,no expired txns
4. upgrading second batch to new version: cb2a9155d13d87859ca2bec2b30f44f7af02c09f
compatibility::simple-validator-upgrade::rest-validator-upgrade : 6793 TPS, 5712 ms latency, 9300 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> cb2a9155d13d87859ca2bec2b30f44f7af02c09f passed
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions[bot]]

:white_check_mark: Forge suite land_blocking success on cb2a9155d13d87859ca2bec2b30f44f7af02c09f

performance benchmark with full nodes : 6758 TPS, 5621 ms latency, 17800 ms p99 latency,(!) expired 14534 out of 2900200 txns
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking