aries-cloudagent-python icon indicating copy to clipboard operation
aries-cloudagent-python copied to clipboard

Slow performance with lots of connections

Open ianco opened this issue 3 years ago • 4 comments

From a discord chat:

We see the delay occurring during connection creation which I believe does not use the author/endorser transaction flow. We see the delay in the inviter agent side

we noticed that for the org that is 75 days old, it has 4832 connections in its ACAPY records. And it takes 20 seconds for it new invitations to become active.

and for an org that is newer and has only 450 connections, it takes a few seconds for the invites to become active.

is it possible that the many many connection records could be weighing down ACAPY performance when requests come in?

ianco avatar Sep 07 '22 18:09 ianco

I have seen such decreases in performance with older AcaPy versions (I believe prior 0.7.0) and when using the Indy SDK instead of the Askar wallet.

Which AcaPy version has been used and is it running with the Indy SDK or Askar wallet?

PaulWen avatar Sep 08 '22 07:09 PaulWen

From cchiu on Discord: "We are using an ACAPY image based off of v0.7.3. And we are hitting Sovrin Buildernet and Sovrin Mainnet as the ledgers (not sure if that is important or not)"

Not sure if it's indy or askar wallet.

ianco avatar Sep 08 '22 17:09 ianco

we are using indy wallet.

Just FYI, as follow up in the investigation and confirm the issue, we deleted the connections using ACAPY's API and found that it increased performance and we were able to create new ACTIVE connections within seconds instead of the 20 seconds that it took before.

cchiu3 avatar Sep 08 '22 17:09 cchiu3

My load tests for AcaPy version 0.7.3 + Indy wallet also show that the performance drops drastically over time: https://github.com/lissi-id/acapy-load-test-results/blob/main/AcaPy_0-7-4/Endurance_Test/04-0_7_3_indy-200rpm/report-test-results-0-END.pdf

If this is an option for you I can highly recommend switching to the Askar wallet as this has not this behavior yet: https://github.com/lissi-id/acapy-load-test-results/blob/main/AcaPy_0-7-4/Endurance_Test/02-0_7_4_askar_0_2_5-200rpm/report-test-results-0-6.pdf

PaulWen avatar Sep 08 '22 18:09 PaulWen

Lots of updates have been done in this area, including one specifically targetting lots of connections, and the use of Askar. Closing this issue -- please reopen with more details or open a new issue.

Thanks

swcurran avatar Dec 19 '23 00:12 swcurran