parca icon indicating copy to clipboard operation
parca copied to clipboard

Parca UI unable to get ProfileTypes

Open gites opened this issue 2 years ago • 2 comments

Parca UI is unable to get ProfileTypes and displays Error! Failed to fetch error message.

I have been running Parca v0.16.2 for about a week. At the begging I was able to query the UI, but now is showing only ``Error! Failed to fetch` message (no query window even).

My setup have one instance of Parca server and multiple Parca scrapers sending pprof data to it (4 scrapers, ~110 pods per scraper). Storage backend is on S3 and right now it size is 667.0 GB.

Looks like web UI is unable to do http://localhost:7070/api/parca.query.v1alpha1.QueryService/ProfileTypes request.

Here are some screenshots from my browser: Screenshot 2023-03-22 at 14 02 11

Screenshot 2023-03-22 at 13 09 43

I didn't find anything in logs, but they are also attached. debug.log

gites avatar Mar 22 '23 13:03 gites

A couple of things to note:

  • We primarily recommend using Parca-Agent, it results in much less data needing to be stored (as only memory addresses are stored in object storage), rather than scraping, where all strings are stored directly in the stacktrace, which results in much more expensive storage.
  • Persistent storage is still an experimental feature, the limitations you are hitting are currently expected, and we're working hard to make persistence stable and query-able long term. We've focused this quarter on making actually writing to storage stable, which by our SLOs we've succeeded in, and next quarter is going to be about making queries from object storage fast.

brancz avatar Mar 23 '23 09:03 brancz