iavl icon indicating copy to clipboard operation
iavl copied to clipboard

cpu-time: investigate (*iavl.Node).get CPU consumption which shows up in profiles

Open odeke-em opened this issue 5 years ago • 5 comments

Summary of Bug

I attached some proprietary continuous profiling code to gaiad and started it, and it is running, from which I collect continuous profiles. The results of the consumption from iavl.Node show lots of time from iavl.Node operations consistently being consumed, across multiple profiles consistently. Screen Shot 2020-12-19 at 6 13 23 PM

Performance issues are (potential) security issues, and solving them always wins for everyone.

Profile

gaiad-cpuprof19.pdf

Version

At tip 25bb17d


For Admin Use

  • [x] Not duplicate issue
  • [x] Appropriate labels applied
  • [x] Appropriate contributors tagged
  • [x] Contributor assigned/self-assigned

odeke-em avatar Dec 20 '20 02:12 odeke-em

Is there an actionable here?

tac0turtle avatar Apr 12 '21 09:04 tac0turtle

Yes, still on my TODO list that I’ll tackle this quarter. Thanks for the ping.

On Mon, Apr 12, 2021 at 2:09 AM Marko @.***> wrote:

Is there an actionable here?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/cosmos/cosmos-sdk/issues/8204#issuecomment-817634273, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABFL3V3RVHUPEXGAYCUXJ23TIK2GHANCNFSM4VCXIOUQ .

odeke-em avatar Apr 12 '21 09:04 odeke-em

I'm not sure if its worth spending too much time within IAVL as we plan to migrate away from it

tac0turtle avatar Apr 12 '21 09:04 tac0turtle

cc @ValarDragon this would be included in your work correct?

tac0turtle avatar Jan 19 '22 10:01 tac0turtle

Yeah, my understanding is this is showing the time spent in a seek, of crawling the tree and at each layer doing a file open.

ValarDragon avatar Jan 19 '22 15:01 ValarDragon

closing this as we are working on data locality and general clean up of this repo

tac0turtle avatar Oct 09 '22 11:10 tac0turtle