HPCPerfStats
HPCPerfStats copied to clipboard
Speedup query time
There are couple of things that can be done here. Feel free to add more.
- Filter out data which is least viewed or of less interests to the users.
- Use Ajax instead of Python web interface
- Some preprocessing of data at server end
- Processing data at client end. (This might be part of 2)
- New Indexing
- New DB design (not required as of now)
- Tuning Postgres for load sharing and scalability
Updating from psycopg2 to psycopg3 (and removing pgcopy), will allow async copies which should speed up the db