aptos-ait2 icon indicating copy to clipboard operation
aptos-ait2 copied to clipboard

Validator participation only decreases with time after the last update

Open veiodruida opened this issue 2 years ago • 7 comments

Hello team, My validator only decrease the participation since the last update, i was 80 and now i become 22%, and decreasing...

4 vCPUs @ 2.4Ghz 8 GB RAM 300 GB NVMe SSD Ubuntu 20.04 (LTS) x64 Located in Germany - Contabo

I'm running using Docker (image tag - testnet_f5d8013b0a1851da8e078394d83130d3adaf7670 ) Node Address - 69d7fb622a8f75c1d3267b3e5c723fb3ea0d07d1d34c9d866984c6cea3f8d834 My logs - https://drive.google.com/file/d/11e0bYs5YHZcERULKnbhdUCFNDLv3Of0E/view?usp=sharing

Thanks in advance, best regards

veiodruida avatar Jul 18 '22 14:07 veiodruida

we haven't been getting metrics from your node in the past two days, are you sure your node still running?

sherry-x avatar Jul 19 '22 06:07 sherry-x

@sherry-x Yes its live always. i try restart the validator since the last update several times, and prune volumes too.

veiodruida avatar Jul 19 '22 07:07 veiodruida

Hello , since the update to the commit my participation rate, which was 100%, has only gone down every day. I have been trying to restart my node every day. And I have updated it every time I asked. But I never managed to reverse the tendency. Do you have any other advice to share. Thank you in advance. https://discordapp.com/channels/945856774056083548/996186394168934530/998711315491201115 https://discordapp.com/channels/945856774056083548/996186394168934530/998711804786127040 https://discordapp.com/channels/945856774056083548/996186394168934530/998713174041841754 When I observe the other participants, the majority of them have the same concern Please help!

jackal786 avatar Jul 19 '22 10:07 jackal786

@sherry-x
I'm trying a new way to improve my participation. I am now using Haproxy to redirect the network to a new better server (8 cores, better connection in EUA)and I try again to sync the network using this new architecture. But the consensus doesn't increase and i see all the connections are established. What i missing? please help

tcp LISTEN 0 4096 38.242.135.185:6181 0.0.0.0:* users:(("haproxy",pid=8851,fd=9)) tcp ESTAB 0 0 38.242.135.185:6180 128.199.83.81:56660 users:(("haproxy",pid=8851,fd=223)) tcp ESTAB 0 0 38.242.135.185:6180 95.216.7.245:39456 users:(("haproxy",pid=8851,fd=146)) tcp ESTAB 0 0 38.242.135.185:6180 3.72.107.43:40386 users:(("haproxy",pid=8851,fd=167)) tcp ESTAB 0 0 38.242.135.185:6180 95.217.113.104:33666 users:(("haproxy",pid=8851,fd=246)) tcp ESTAB 0 0 38.242.135.185:40662 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=191)) tcp ESTAB 0 0 38.242.135.185:40772 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=333)) tcp ESTAB 0 0 38.242.135.185:40704 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=241)) tcp ESTAB 0 257 38.242.135.185:40470 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=100)) tcp ESTAB 0 0 38.242.135.185:6180 161.97.95.75:40150 users:(("haproxy",pid=8851,fd=56)) tcp ESTAB 0 0 38.242.135.185:6180 185.197.249.118:34188 users:(("haproxy",pid=8851,fd=140)) tcp ESTAB 0 0 38.242.135.185:6180 103.183.113.10:46600 users:(("haproxy",pid=8851,fd=217)) tcp ESTAB 0 0 38.242.135.185:40538 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=45)) tcp ESTAB 0 0 38.242.135.185:6180 88.99.216.174:55116 users:(("haproxy",pid=8851,fd=199)) tcp ESTAB 0 0 38.242.135.185:6180 185.209.164.103:53772 users:(("haproxy",pid=8851,fd=283)) tcp ESTAB 0 0 38.242.135.185:40472 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=102)) tcp ESTAB 0 0 38.242.135.185:40634 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=164)) tcp ESTAB 0 8690 38.242.135.185:40456 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=79)) tcp ESTAB 0 0 38.242.135.185:6180 65.108.136.146:33890 users:(("haproxy",pid=8851,fd=99)) tcp ESTAB 0 13126 38.242.135.185:40652 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=181)) tcp ESTAB 0 0 38.242.135.185:6180 147.182.201.72:49272 users:(("haproxy",pid=8851,fd=292)) tcp ESTAB 0 0 38.242.135.185:6180 187.150.103.113:33812 users:(("haproxy",pid=8851,fd=27)) tcp ESTAB 0 0 38.242.135.185:40710 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=248)) tcp ESTAB 0 0 38.242.135.185:6180 209.145.62.91:44138 users:(("haproxy",pid=8851,fd=44)) tcp ESTAB 0 0 38.242.135.185:40490 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=112)) tcp ESTAB 0 0 38.242.135.185:6180 35.165.24.123:58139 users:(("haproxy",pid=8851,fd=50)) tcp ESTAB 0 0 38.242.135.185:40464 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=88)) tcp ESTAB 0 0 38.242.135.185:6180 38.242.235.125:50042 users:(("haproxy",pid=8851,fd=206)) tcp ESTAB 0 0 38.242.135.185:40590 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=64)) tcp ESTAB 0 0 38.242.135.185:41138 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=265)) tcp ESTAB 0 0 38.242.135.185:40572 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=68)) tcp ESTAB 0 6655 38.242.135.185:40778 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=339)) tcp ESTAB 0 0 38.242.135.185:40636 144.126.141.112:6180 users:(("haproxy",pid=8851,fd=166))

veiodruida avatar Jul 19 '22 21:07 veiodruida

I find the solution by myself. My node is now increasing votes finally. But this only happens after the last code update, and migration to a new server with 8 vCPUs with Haproxy redirecting the network...

veiodruida avatar Jul 20 '22 16:07 veiodruida

Hello, the problem of the participation rate which was constantly decreasing as well as the number of votes which stagnated was partially solved with the upgrade of my vps. Indeed I have identified a great improvement because I managed to reverse this downward trend with the upgrade of my vps.
VPS before upgrade: CPU 6 cores | RAM 16 GB | DISK 400 GB (100% SSD) | PORTS 400 Mbit/s https://community.aptoslabs.com/it2 0x00c43abe20c134ef9fc62a5d04f52712c106126a8ca0b58ecd26cbfa13a5da46 | Liveness 100.00% | Participation 36.00% | Votes 29446 | 2022-07-20 6:39:43

VPS After UPGRADE: CPU 10 cores | RAM 60 GB | DISK 1600 GB (100% SSD) | PORTS 1000 Mbit/s https://community.aptoslabs.com/it2 0x00c43abe20c134ef9fc62a5d04f52712c106126a8ca0b58ecd26cbfa13a5da46 | Liveness 100.00% | Participation 44.00% | Votes 64471 | 2022-07-20 18:39:43

So I generated more than 35000 votes in 12 hours that's more than I generated since the beginning of the AIT2 (8 days)

But I'm still trying to understand how some people with a much less powerful vps have a higher participation rate and a better ranking: https://discordapp.com/channels/945856774056083548/996186394168934530/999255720908292097

There is a track mentioned on the discord, it is the geolocation of your server to an impact on the performance of your participation. For example I chose the area of Singapore for the location of my vps and another person tells me that his vps which is located in India has the same problem https://discordapp.com/channels/945856774056083548/996186394168934530/999310757399363685

Finally, it remains a possibility to explore. I hope the fact of having favored decentralization will not be fatal to us. In any case, this is a very nice experience that I live with a lot of rebound. I sincerely hope that everyone will have an opportunity to participate in the next incentivized testnet.

If you want to know more about the aptos project, feel free to join my tg: I'll be happy to help you launch your next validator node for AIT3 and help you prepare for it: You can have a visibility on my work on aptos: https://medium.com/coinmonks/tutorial-how-to-install-a-node-on-the-aptos-network-for-beginners-728c57344388 https://medium.com/@akabane.kurodo786/tutorial-how-to-install-a-validator-node-on-the-aptos-network-for-beginners-incentivized-436ed2965411 https://www.youtube.com/watch?v=qVuJNsoNesg https://www.youtube.com/watch?v=dv2FS2MJnYw https://www.youtube.com/watch?v=Bskk14EC3yI https://www.youtube.com/watch?v=dxmvbfsgcwo And of course as explained I will release other articles and videos to facilitate your participation in the next APTOS testnet (AIT3/4...)

As soon as I have more information I will send you a feedback....

jackal786 avatar Jul 20 '22 19:07 jackal786

Nice @jackal786 maybe in the next AIT it's better if the team be more "open" about it the REAL requirements for the servers

veiodruida avatar Jul 22 '22 21:07 veiodruida