docker-speedtest-analyser icon indicating copy to clipboard operation
docker-speedtest-analyser copied to clipboard

New database system

Open roest01 opened this issue 7 years ago • 0 comments

docker-speedtest-analyser use a result.csv as database.

The default setting for a speedtest is 1/hour.

Data addet per speedtest ~35 bytes 35 * 24 = 840 bytes per day 840 * 365 = 306.500 bytes (306,5 kilobyte) per year

scaled up - every 5 minutes

The default setting for a speedtest is 12/hour. Data addet per speedtest ~35 bytes 35 * 12 = 420 per hour 420 * 24 = 10.080 bytes per day 10.080 * 365 = 3.679.200 bytes (3679,2 kilobyte / 3,6792 MB) per year

file based database system is acceptable when speedtest scaled up to run every 5 minutes for 75 years

to scale? the stored data and allow querying data this project may switch to another database system.

SQLite

  • old system 👎
  • reliable 👍
  • local 👍

lowdb

  • easy to use 👍
  • sql query style 👍
  • local file 👍
  • modern 👍
  • Important lowdb doesn't support Cluster and may have issues with very large JSON files (~200MB). 👎

influxdb

roest01 avatar Nov 01 '17 15:11 roest01