HPCPerfStats icon indicating copy to clipboard operation
HPCPerfStats copied to clipboard

Speedup query time

Open aruhela opened this issue 1 year ago • 1 comments

There are couple of things that can be done here. Feel free to add more.

  1. Filter out data which is least viewed or of less interests to the users.
  2. Use Ajax instead of Python web interface
  3. Some preprocessing of data at server end
  4. Processing data at client end. (This might be part of 2)
  5. New Indexing
  6. New DB design (not required as of now)
  7. Tuning Postgres for load sharing and scalability

aruhela avatar Oct 03 '24 20:10 aruhela

Updating from psycopg2 to psycopg3 (and removing pgcopy), will allow async copies which should speed up the db

stephenlienharrell avatar Nov 05 '24 18:11 stephenlienharrell