Configure self-hosted runner for benchmarks job

[SiarheiFedartsou]

Well, after a lot of attempts to make benchmarks stable when running GitHub-hosted runners I gave up and configured self-hosted runner which works on Raspberry Pi 5 right on my shelf:

It led to increased run time of benchmarks job, but results are much more stable: when running without code changes difference between master and PR is at glance <1% for most of benchmarks without jumps up to 10-20% as it happens with GitHub-hosted runner. When it comes to run time may be worth decreasing number of times we repeat benchmark: now it seems to be stable enough to run it say 3 times instead of current 5.

Important note: in general it is not recommended by GitHub to configure self-hosted runners for public repos due to security reasons. There is a risk that attacker can run malicious code on this runner simply creating PR from fork. I made some configuration changes to minimize security risks:

• maintainers approval is now required to run pull request CI if PR is from external contributor (I have changed it in repo settings, before it was enough to have one PR merged for contributor to be able to run CI without approval)
• this runner runs jobs triggered by myself or @DennisOSRM only - I think we should extend it in the future for the whole list of maintainers, but it was just quicker this way (and other folks are not really active recently)
• there are other security measures I don't want to speak publicly about(yes, security over obscurity!)

Benchmark Results

Benchmark	Base	PR
alias	aliased u32: 11105.3 plain u32: 11006.6 aliased double: 15129.4 plain double: 15172.3	aliased u32: 11127.8 plain u32: 11006.7 aliased double: 15095.2 plain double: 15108.1
e2e_match_ch	Ops: 27.06 ± 0.03 ops/s. Best: 27.09 ops/s Total: 4841.32ms ± 5.11ms. Best: 4836.51ms Min time: 3.32ms ± 0.03ms Mean time: 36.96ms ± 0.04ms Median time: 27.41ms ± 0.17ms 95th percentile: 120.13ms ± 0.32ms 99th percentile: 144.24ms ± 0.66ms Max time: 161.95ms ± 0.32ms	Ops: 27.06 ± 0.01 ops/s. Best: 27.07 ops/s Total: 4841.93ms ± 1.94ms. Best: 4838.83ms Min time: 3.39ms ± 0.02ms Mean time: 36.96ms ± 0.01ms Median time: 27.49ms ± 0.12ms 95th percentile: 120.64ms ± 0.28ms 99th percentile: 143.89ms ± 0.29ms Max time: 161.42ms ± 0.44ms
e2e_match_mld	Ops: 41.72 ± 0.02 ops/s. Best: 41.76 ops/s Total: 3140.00ms ± 1.70ms. Best: 3136.66ms Min time: 2.53ms ± 0.06ms Mean time: 23.97ms ± 0.01ms Median time: 12.54ms ± 0.13ms 95th percentile: 79.52ms ± 0.32ms 99th percentile: 90.89ms ± 0.37ms Max time: 105.98ms ± 0.56ms	Ops: 41.73 ± 0.02 ops/s. Best: 41.77 ops/s Total: 3139.32ms ± 1.68ms. Best: 3135.93ms Min time: 2.55ms ± 0.05ms Mean time: 23.96ms ± 0.01ms Median time: 12.49ms ± 0.10ms 95th percentile: 79.33ms ± 0.22ms 99th percentile: 90.75ms ± 0.28ms Max time: 105.61ms ± 0.55ms
e2e_nearest_ch	Ops: 630.80 ± 3.97 ops/s. Best: 636.36 ops/s Total: 1585.18ms ± 10.06ms. Best: 1571.43ms Min time: 1.30ms ± 0.01ms Mean time: 1.59ms ± 0.01ms Median time: 1.55ms ± 0.00ms 95th percentile: 1.98ms ± 0.02ms 99th percentile: 2.08ms ± 0.02ms Max time: 9.39ms ± 7.43ms	Ops: 636.29 ± 3.03 ops/s. Best: 639.36 ops/s Total: 1571.66ms ± 7.63ms. Best: 1564.08ms Min time: 1.29ms ± 0.00ms Mean time: 1.57ms ± 0.01ms Median time: 1.53ms ± 0.01ms 95th percentile: 1.94ms ± 0.01ms 99th percentile: 2.04ms ± 0.01ms Max time: 9.39ms ± 7.47ms
e2e_nearest_mld	Ops: 631.34 ± 4.36 ops/s. Best: 637.58 ops/s Total: 1583.56ms ± 10.84ms. Best: 1568.43ms Min time: 1.29ms ± 0.01ms Mean time: 1.58ms ± 0.01ms Median time: 1.54ms ± 0.01ms 95th percentile: 1.96ms ± 0.01ms 99th percentile: 2.06ms ± 0.01ms Max time: 9.40ms ± 7.51ms	Ops: 629.64 ± 4.88 ops/s. Best: 638.87 ops/s Total: 1588.17ms ± 12.63ms. Best: 1565.25ms Min time: 1.30ms ± 0.01ms Mean time: 1.59ms ± 0.01ms Median time: 1.55ms ± 0.01ms 95th percentile: 1.97ms ± 0.01ms 99th percentile: 2.06ms ± 0.01ms Max time: 9.37ms ± 7.42ms
e2e_route_ch	Ops: 211.24 ± 0.50 ops/s. Best: 211.90 ops/s Total: 4734.05ms ± 11.50ms. Best: 4719.25ms Min time: 1.85ms ± 0.04ms Mean time: 4.73ms ± 0.01ms Median time: 4.84ms ± 0.01ms 95th percentile: 6.24ms ± 0.02ms 99th percentile: 6.78ms ± 0.02ms Max time: 13.56ms ± 6.26ms	Ops: 211.38 ± 0.31 ops/s. Best: 211.89 ops/s Total: 4730.75ms ± 6.96ms. Best: 4719.40ms Min time: 1.89ms ± 0.03ms Mean time: 4.73ms ± 0.01ms Median time: 4.83ms ± 0.01ms 95th percentile: 6.25ms ± 0.01ms 99th percentile: 6.81ms ± 0.03ms Max time: 13.51ms ± 6.26ms
e2e_route_mld	Ops: 174.07 ± 0.33 ops/s. Best: 174.42 ops/s Total: 5744.94ms ± 11.09ms. Best: 5733.25ms Min time: 1.88ms ± 0.05ms Mean time: 5.74ms ± 0.01ms Median time: 5.86ms ± 0.01ms 95th percentile: 7.88ms ± 0.02ms 99th percentile: 8.44ms ± 0.10ms Max time: 14.95ms ± 5.93ms	Ops: 173.91 ± 0.36 ops/s. Best: 174.59 ops/s Total: 5750.24ms ± 12.74ms. Best: 5727.61ms Min time: 1.89ms ± 0.06ms Mean time: 5.75ms ± 0.01ms Median time: 5.86ms ± 0.02ms 95th percentile: 7.88ms ± 0.01ms 99th percentile: 8.40ms ± 0.08ms Max time: 14.89ms ± 5.84ms
e2e_table_ch	Ops: 216.96 ± 0.50 ops/s. Best: 217.62 ops/s Total: 4609.13ms ± 10.61ms. Best: 4595.17ms Min time: 2.43ms ± 0.04ms Mean time: 4.61ms ± 0.01ms Median time: 4.60ms ± 0.01ms 95th percentile: 6.25ms ± 0.02ms 99th percentile: 6.60ms ± 0.03ms Max time: 13.75ms ± 7.08ms	Ops: 217.27 ± 0.46 ops/s. Best: 218.01 ops/s Total: 4602.68ms ± 10.10ms. Best: 4587.00ms Min time: 2.40ms ± 0.03ms Mean time: 4.60ms ± 0.01ms Median time: 4.59ms ± 0.01ms 95th percentile: 6.24ms ± 0.01ms 99th percentile: 6.61ms ± 0.04ms Max time: 13.78ms ± 7.08ms
e2e_table_mld	Ops: 71.24 ± 0.04 ops/s. Best: 71.32 ops/s Total: 14036.19ms ± 8.07ms. Best: 14022.06ms Min time: 5.59ms ± 0.03ms Mean time: 14.04ms ± 0.01ms Median time: 14.00ms ± 0.03ms 95th percentile: 21.51ms ± 0.03ms 99th percentile: 22.90ms ± 0.08ms Max time: 29.69ms ± 6.23ms	Ops: 70.89 ± 0.03 ops/s. Best: 70.93 ops/s Total: 14106.07ms ± 5.91ms. Best: 14098.34ms Min time: 5.65ms ± 0.05ms Mean time: 14.11ms ± 0.01ms Median time: 14.08ms ± 0.02ms 95th percentile: 21.62ms ± 0.02ms 99th percentile: 23.05ms ± 0.10ms Max time: 29.90ms ± 6.06ms
e2e_trip_ch	Ops: 59.86 ± 0.03 ops/s. Best: 59.92 ops/s Total: 16706.56ms ± 9.14ms. Best: 16688.41ms Min time: 2.47ms ± 0.17ms Mean time: 16.71ms ± 0.01ms Median time: 15.89ms ± 0.02ms 95th percentile: 29.47ms ± 0.03ms 99th percentile: 31.65ms ± 0.09ms Max time: 33.89ms ± 1.11ms	Ops: 59.77 ± 0.02 ops/s. Best: 59.81 ops/s Total: 16731.99ms ± 6.50ms. Best: 16720.11ms Min time: 2.44ms ± 0.20ms Mean time: 16.73ms ± 0.01ms Median time: 15.94ms ± 0.03ms 95th percentile: 29.54ms ± 0.04ms 99th percentile: 31.65ms ± 0.14ms Max time: 33.92ms ± 1.11ms
e2e_trip_mld	Ops: 36.00 ± 0.01 ops/s. Best: 36.01 ops/s Total: 27781.41ms ± 6.86ms. Best: 27770.11ms Min time: 2.44ms ± 0.16ms Mean time: 27.78ms ± 0.01ms Median time: 27.04ms ± 0.04ms 95th percentile: 45.47ms ± 0.04ms 99th percentile: 47.93ms ± 0.07ms Max time: 51.28ms ± 0.17ms	Ops: 35.87 ± 0.02 ops/s. Best: 35.89 ops/s Total: 27881.18ms ± 12.13ms. Best: 27864.61ms Min time: 2.43ms ± 0.17ms Mean time: 27.88ms ± 0.01ms Median time: 27.21ms ± 0.07ms 95th percentile: 45.55ms ± 0.06ms 99th percentile: 48.04ms ± 0.09ms Max time: 51.37ms ± 0.20ms
json-render	String: 10.978ms Stringstream: 15.9458ms Vector: 11.5778ms	String: 10.9702ms Stringstream: 15.8581ms Vector: 11.729ms
match_ch	Default radius: 7.27627ms/req at 82 coordinate 0.0887349ms/coordinate Radius 10m: 25.7643ms/req at 82 coordinate 0.314199ms/coordinate	Default radius: 7.30086ms/req at 82 coordinate 0.0890349ms/coordinate Radius 10m: 25.7882ms/req at 82 coordinate 0.31449ms/coordinate
match_mld	Default radius: 4.63454ms/req at 82 coordinate 0.0565188ms/coordinate Radius 10m: 17.2755ms/req at 82 coordinate 0.210676ms/coordinate	Default radius: 4.83021ms/req at 82 coordinate 0.058905ms/coordinate Radius 10m: 18.4878ms/req at 82 coordinate 0.22546ms/coordinate
osrm_contract	Time: 190.33s Peak RAM: 193.98MB	Time: 190.46s Peak RAM: 194.00MB
osrm_customize	Time: 2.63s Peak RAM: 110.89MB	Time: 2.63s Peak RAM: 110.89MB
osrm_extract	Time: 24.02s Peak RAM: 392.92MB	Time: 24.08s Peak RAM: 394.12MB
osrm_partition	Time: 5.85s Peak RAM: 118.82MB	Time: 5.87s Peak RAM: 119.76MB
packedvector	random write: std::vector 183714 ms util::packed_vector 373246 ms slowdown: 2.03167 random read: std::vector 100494 ms util::packed_vector 190406 ms slowdown: 1.8947	random write: std::vector 183974 ms util::packed_vector 372604 ms slowdown: 2.02531 random read: std::vector 100547 ms util::packed_vector 190480 ms slowdown: 1.89444
random_match_ch	500 matches, default radius ops: 127.64 ± 0.18 ops/s. best: 127.85ops/s. total: 446.58 ± 0.61ms. best: 445.85ms. avg: 7.83 ± 0.01ms min: 0.25 ± 0.00ms max: 47.01 ± 0.06ms p99: 47.01 ± 0.06ms 500 matches, radius=10 ops: 36.61 ± 0.05 ops/s. best: 36.69ops/s. total: 1748.00 ± 2.21ms. best: 1744.15ms. avg: 27.31 ± 0.03ms min: 0.27 ± 0.00ms max: 452.67 ± 0.88ms p99: 452.67 ± 0.88ms 500 matches, radius=20 ops: 8.57 ± 0.01 ops/s. best: 8.58ops/s. total: 7582.98 ± 5.57ms. best: 7573.14ms. avg: 116.66 ± 0.09ms min: 0.47 ± 0.00ms max: 2357.39 ± 1.17ms p99: 2357.39 ± 1.17ms	500 matches, default radius ops: 127.56 ± 0.18 ops/s. best: 127.82ops/s. total: 446.85 ± 0.66ms. best: 445.94ms. avg: 7.84 ± 0.01ms min: 0.25 ± 0.00ms max: 47.03 ± 0.08ms p99: 47.03 ± 0.08ms 500 matches, radius=10 ops: 36.63 ± 0.03 ops/s. best: 36.68ops/s. total: 1747.33 ± 1.47ms. best: 1744.86ms. avg: 27.30 ± 0.02ms min: 0.26 ± 0.00ms max: 451.89 ± 0.50ms p99: 451.89 ± 0.50ms 500 matches, radius=20 ops: 8.57 ± 0.01 ops/s. best: 8.58ops/s. total: 7581.92 ± 9.29ms. best: 7573.07ms. avg: 116.64 ± 0.14ms min: 0.47 ± 0.00ms max: 2354.31 ± 3.58ms p99: 2354.31 ± 3.58ms
random_match_mld	500 matches, default radius ops: 199.79 ± 0.38 ops/s. best: 200.09ops/s. total: 285.30 ± 0.55ms. best: 284.86ms. avg: 5.01 ± 0.01ms min: 0.20 ± 0.00ms max: 28.58 ± 0.04ms p99: 28.58 ± 0.04ms 500 matches, radius=10 ops: 70.67 ± 0.04 ops/s. best: 70.74ops/s. total: 905.57 ± 0.59ms. best: 904.67ms. avg: 14.15 ± 0.01ms min: 0.25 ± 0.00ms max: 170.83 ± 0.45ms p99: 170.83 ± 0.45ms 500 matches, radius=20 ops: 14.54 ± 0.01 ops/s. best: 14.55ops/s. total: 4471.44 ± 2.69ms. best: 4466.54ms. avg: 68.79 ± 0.04ms min: 0.31 ± 0.00ms max: 894.30 ± 1.29ms p99: 894.30 ± 1.29ms	500 matches, default radius ops: 198.83 ± 0.37 ops/s. best: 199.14ops/s. total: 286.68 ± 0.54ms. best: 286.23ms. avg: 5.03 ± 0.01ms min: 0.20 ± 0.00ms max: 28.69 ± 0.03ms p99: 28.69 ± 0.03ms 500 matches, radius=10 ops: 70.33 ± 0.05 ops/s. best: 70.42ops/s. total: 909.95 ± 0.65ms. best: 908.81ms. avg: 14.22 ± 0.01ms min: 0.25 ± 0.00ms max: 171.61 ± 0.29ms p99: 171.61 ± 0.29ms 500 matches, radius=20 ops: 14.47 ± 0.01 ops/s. best: 14.49ops/s. total: 4492.24 ± 3.72ms. best: 4485.96ms. avg: 69.11 ± 0.06ms min: 0.32 ± 0.00ms max: 898.11 ± 1.46ms p99: 898.11 ± 1.46ms
random_nearest_ch	10000 nearest, number_of_results=1 ops: 19086.40 ± 31.35 ops/s. best: 19119.93ops/s. total: 523.94 ± 0.86ms. best: 523.01ms. avg: 0.05 ± 0.00ms min: 0.02 ± 0.00ms max: 0.17 ± 0.00ms p99: 0.13 ± 0.00ms 10000 nearest, number_of_results=5 ops: 14249.99 ± 7.91 ops/s. best: 14258.46ops/s. total: 701.76 ± 0.39ms. best: 701.34ms. avg: 0.07 ± 0.00ms min: 0.03 ± 0.00ms max: 0.18 ± 0.00ms p99: 0.15 ± 0.00ms 10000 nearest, number_of_results=10 ops: 11208.47 ± 2.17 ops/s. best: 11211.54ops/s. total: 892.18 ± 0.17ms. best: 891.94ms. avg: 0.09 ± 0.00ms min: 0.04 ± 0.00ms max: 0.20 ± 0.00ms p99: 0.16 ± 0.00ms	10000 nearest, number_of_results=1 ops: 19040.88 ± 29.04 ops/s. best: 19069.92ops/s. total: 525.19 ± 0.80ms. best: 524.39ms. avg: 0.05 ± 0.00ms min: 0.02 ± 0.00ms max: 0.17 ± 0.00ms p99: 0.13 ± 0.00ms 10000 nearest, number_of_results=5 ops: 14218.85 ± 5.25 ops/s. best: 14226.42ops/s. total: 703.29 ± 0.26ms. best: 702.92ms. avg: 0.07 ± 0.00ms min: 0.03 ± 0.00ms max: 0.18 ± 0.00ms p99: 0.15 ± 0.00ms 10000 nearest, number_of_results=10 ops: 11179.33 ± 3.37 ops/s. best: 11184.75ops/s. total: 894.51 ± 0.27ms. best: 894.07ms. avg: 0.09 ± 0.00ms min: 0.04 ± 0.00ms max: 0.20 ± 0.00ms p99: 0.16 ± 0.00ms
random_nearest_mld	10000 nearest, number_of_results=1 ops: 19077.12 ± 35.69 ops/s. best: 19115.90ops/s. total: 524.19 ± 1.02ms. best: 523.12ms. avg: 0.05 ± 0.00ms min: 0.02 ± 0.00ms max: 0.17 ± 0.00ms p99: 0.13 ± 0.00ms 10000 nearest, number_of_results=5 ops: 14245.03 ± 7.88 ops/s. best: 14259.52ops/s. total: 702.00 ± 0.39ms. best: 701.29ms. avg: 0.07 ± 0.00ms min: 0.03 ± 0.00ms max: 0.18 ± 0.00ms p99: 0.15 ± 0.00ms 10000 nearest, number_of_results=10 ops: 11201.48 ± 3.36 ops/s. best: 11207.11ops/s. total: 892.74 ± 0.27ms. best: 892.29ms. avg: 0.09 ± 0.00ms min: 0.04 ± 0.00ms max: 0.20 ± 0.00ms p99: 0.16 ± 0.00ms	10000 nearest, number_of_results=1 ops: 19043.53 ± 30.65 ops/s. best: 19070.63ops/s. total: 525.11 ± 0.85ms. best: 524.37ms. avg: 0.05 ± 0.00ms min: 0.02 ± 0.00ms max: 0.17 ± 0.00ms p99: 0.13 ± 0.00ms 10000 nearest, number_of_results=5 ops: 14215.29 ± 10.56 ops/s. best: 14233.84ops/s. total: 703.47 ± 0.52ms. best: 702.55ms. avg: 0.07 ± 0.00ms min: 0.03 ± 0.00ms max: 0.18 ± 0.00ms p99: 0.15 ± 0.00ms 10000 nearest, number_of_results=10 ops: 11176.59 ± 3.97 ops/s. best: 11181.07ops/s. total: 894.73 ± 0.32ms. best: 894.37ms. avg: 0.09 ± 0.00ms min: 0.04 ± 0.00ms max: 0.20 ± 0.00ms p99: 0.16 ± 0.00ms
random_route_ch	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true ops: 278.76 ± 0.16 ops/s. best: 278.95ops/s. total: 3529.98 ± 1.99ms. best: 3527.47ms. avg: 3.59 ± 0.00ms min: 0.51 ± 0.00ms max: 6.18 ± 0.03ms p99: 5.34 ± 0.01ms 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true ops: 311.76 ± 0.11 ops/s. best: 311.90ops/s. total: 3207.59 ± 1.09ms. best: 3206.12ms. avg: 3.21 ± 0.00ms min: 0.09 ± 0.00ms max: 7.06 ± 0.04ms p99: 6.66 ± 0.01ms 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false ops: 597.26 ± 0.19 ops/s. best: 597.52ops/s. total: 1647.54 ± 0.55ms. best: 1646.80ms. avg: 1.67 ± 0.00ms min: 0.35 ± 0.01ms max: 2.54 ± 0.00ms p99: 2.37 ± 0.01ms 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false ops: 606.73 ± 0.05 ops/s. best: 606.80ops/s. total: 1648.18 ± 0.14ms. best: 1648.00ms. avg: 1.65 ± 0.00ms min: 0.07 ± 0.00ms max: 4.02 ± 0.01ms p99: 3.90 ± 0.01ms	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true ops: 278.72 ± 0.44 ops/s. best: 279.24ops/s. total: 3530.39 ± 5.63ms. best: 3523.85ms. avg: 3.59 ± 0.01ms min: 0.50 ± 0.00ms max: 6.17 ± 0.02ms p99: 5.35 ± 0.02ms 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true ops: 312.11 ± 0.07 ops/s. best: 312.21ops/s. total: 3204.02 ± 0.71ms. best: 3202.93ms. avg: 3.20 ± 0.00ms min: 0.09 ± 0.00ms max: 7.08 ± 0.02ms p99: 6.68 ± 0.01ms 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false ops: 598.06 ± 0.13 ops/s. best: 598.22ops/s. total: 1645.32 ± 0.36ms. best: 1644.89ms. avg: 1.67 ± 0.00ms min: 0.35 ± 0.01ms max: 2.53 ± 0.00ms p99: 2.37 ± 0.00ms 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false ops: 607.44 ± 0.09 ops/s. best: 607.61ops/s. total: 1646.25 ± 0.24ms. best: 1645.80ms. avg: 1.65 ± 0.00ms min: 0.07 ± 0.00ms max: 4.03 ± 0.00ms p99: 3.90 ± 0.01ms
random_route_mld	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true ops: 142.75 ± 0.01 ops/s. best: 142.77ops/s. total: 6893.08 ± 0.59ms. best: 6892.34ms. avg: 7.01 ± 0.00ms min: 0.48 ± 0.00ms max: 14.63 ± 0.02ms p99: 11.27 ± 0.01ms 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true ops: 139.16 ± 0.04 ops/s. best: 139.24ops/s. total: 7185.96 ± 1.89ms. best: 7182.03ms. avg: 7.19 ± 0.00ms min: 0.08 ± 0.00ms max: 16.43 ± 0.07ms p99: 14.79 ± 0.01ms 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false ops: 201.91 ± 0.03 ops/s. best: 201.96ops/s. total: 4873.49 ± 0.69ms. best: 4872.31ms. avg: 4.95 ± 0.00ms min: 0.40 ± 0.00ms max: 11.73 ± 0.01ms p99: 8.32 ± 0.01ms 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false ops: 177.53 ± 0.11 ops/s. best: 177.65ops/s. total: 5632.75 ± 3.48ms. best: 5629.11ms. avg: 5.63 ± 0.00ms min: 0.06 ± 0.00ms max: 12.89 ± 0.16ms p99: 11.21 ± 0.05ms	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true ops: 142.41 ± 0.03 ops/s. best: 142.45ops/s. total: 6909.39 ± 1.56ms. best: 6907.71ms. avg: 7.02 ± 0.00ms min: 0.48 ± 0.01ms max: 14.63 ± 0.01ms p99: 11.30 ± 0.01ms 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true ops: 138.84 ± 0.05 ops/s. best: 138.95ops/s. total: 7202.74 ± 2.75ms. best: 7196.77ms. avg: 7.20 ± 0.00ms min: 0.08 ± 0.00ms max: 16.72 ± 0.27ms p99: 14.84 ± 0.04ms 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false ops: 201.61 ± 0.02 ops/s. best: 201.64ops/s. total: 4880.78 ± 0.43ms. best: 4879.94ms. avg: 4.96 ± 0.00ms min: 0.40 ± 0.01ms max: 11.75 ± 0.01ms p99: 8.34 ± 0.01ms 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false ops: 177.60 ± 0.10 ops/s. best: 177.74ops/s. total: 5630.72 ± 3.28ms. best: 5626.22ms. avg: 5.63 ± 0.00ms min: 0.06 ± 0.00ms max: 12.69 ± 0.18ms p99: 11.21 ± 0.04ms
random_table_ch	250 tables, 3 coordinates ops: 1147.74 ± 4.32 ops/s. best: 1151.44ops/s. total: 217.82 ± 0.82ms. best: 217.12ms. avg: 0.87 ± 0.00ms min: 0.63 ± 0.00ms max: 1.28 ± 0.14ms p99: 1.08 ± 0.01ms 250 tables, 25 coordinates ops: 128.73 ± 0.05 ops/s. best: 128.81ops/s. total: 1942.03 ± 0.71ms. best: 1940.83ms. avg: 7.77 ± 0.00ms min: 7.16 ± 0.01ms max: 8.34 ± 0.01ms p99: 8.32 ± 0.00ms 250 tables, 50 coordinates ops: 62.46 ± 0.01 ops/s. best: 62.48ops/s. total: 4002.50 ± 0.88ms. best: 4001.37ms. avg: 16.01 ± 0.00ms min: 15.13 ± 0.01ms max: 17.02 ± 0.01ms p99: 16.99 ± 0.01ms	250 tables, 3 coordinates ops: 1146.87 ± 5.18 ops/s. best: 1150.80ops/s. total: 217.99 ± 0.99ms. best: 217.24ms. avg: 0.87 ± 0.00ms min: 0.63 ± 0.00ms max: 1.28 ± 0.15ms p99: 1.08 ± 0.01ms 250 tables, 25 coordinates ops: 128.34 ± 0.04 ops/s. best: 128.39ops/s. total: 1947.88 ± 0.66ms. best: 1947.20ms. avg: 7.79 ± 0.00ms min: 7.19 ± 0.01ms max: 8.37 ± 0.02ms p99: 8.34 ± 0.01ms 250 tables, 50 coordinates ops: 62.52 ± 0.00 ops/s. best: 62.52ops/s. total: 3998.83 ± 0.25ms. best: 3998.54ms. avg: 16.00 ± 0.00ms min: 15.18 ± 0.01ms max: 17.00 ± 0.01ms p99: 16.97 ± 0.00ms
random_table_mld	250 tables, 3 coordinates ops: 230.08 ± 0.29 ops/s. best: 230.36ops/s. total: 1086.58 ± 1.39ms. best: 1085.28ms. avg: 4.35 ± 0.01ms min: 3.23 ± 0.01ms max: 6.00 ± 0.01ms p99: 5.74 ± 0.01ms 250 tables, 25 coordinates ops: 24.63 ± 0.00 ops/s. best: 24.64ops/s. total: 10149.03 ± 0.66ms. best: 10148.13ms. avg: 40.60 ± 0.00ms min: 35.71 ± 0.04ms max: 47.27 ± 0.02ms p99: 45.69 ± 0.04ms 250 tables, 50 coordinates ops: 11.41 ± 0.00 ops/s. best: 11.41ops/s. total: 21903.79 ± 2.52ms. best: 21901.42ms. avg: 87.62 ± 0.01ms min: 80.35 ± 0.06ms max: 95.51 ± 0.03ms p99: 94.24 ± 0.09ms	250 tables, 3 coordinates ops: 230.91 ± 0.24 ops/s. best: 231.13ops/s. total: 1082.67 ± 1.17ms. best: 1081.66ms. avg: 4.33 ± 0.00ms min: 3.24 ± 0.01ms max: 5.94 ± 0.01ms p99: 5.68 ± 0.01ms 250 tables, 25 coordinates ops: 24.65 ± 0.02 ops/s. best: 24.68ops/s. total: 10143.60 ± 8.76ms. best: 10128.20ms. avg: 40.57 ± 0.04ms min: 35.71 ± 0.14ms max: 47.05 ± 0.02ms p99: 45.58 ± 0.15ms 250 tables, 50 coordinates ops: 11.42 ± 0.00 ops/s. best: 11.43ops/s. total: 21883.07 ± 6.81ms. best: 21870.69ms. avg: 87.53 ± 0.03ms min: 80.19 ± 0.06ms max: 95.71 ± 0.46ms p99: 94.54 ± 0.25ms
random_trip_ch	250 trips, 3 coordinates ops: 314.45 ± 0.37 ops/s. best: 314.75ops/s. total: 795.04 ± 0.95ms. best: 794.28ms. avg: 3.18 ± 0.00ms min: 1.58 ± 0.01ms max: 4.38 ± 0.01ms p99: 4.28 ± 0.01ms 250 trips, 5 coordinates ops: 205.43 ± 0.03 ops/s. best: 205.48ops/s. total: 1216.96 ± 0.20ms. best: 1216.64ms. avg: 4.87 ± 0.00ms min: 2.99 ± 0.01ms max: 6.19 ± 0.02ms p99: 6.13 ± 0.00ms	250 trips, 3 coordinates ops: 314.78 ± 0.34 ops/s. best: 315.07ops/s. total: 794.20 ± 0.86ms. best: 793.47ms. avg: 3.18 ± 0.00ms min: 1.58 ± 0.01ms max: 4.38 ± 0.02ms p99: 4.28 ± 0.01ms 250 trips, 5 coordinates ops: 205.52 ± 0.07 ops/s. best: 205.59ops/s. total: 1216.45 ± 0.39ms. best: 1216.02ms. avg: 4.87 ± 0.00ms min: 2.99 ± 0.01ms max: 6.18 ± 0.01ms p99: 6.12 ± 0.01ms
random_trip_mld	250 trips, 3 coordinates ops: 105.93 ± 0.05 ops/s. best: 105.98ops/s. total: 2360.13 ± 1.10ms. best: 2358.86ms. avg: 9.44 ± 0.00ms min: 6.06 ± 0.01ms max: 12.54 ± 0.06ms p99: 12.43 ± 0.01ms 250 trips, 5 coordinates ops: 68.62 ± 0.02 ops/s. best: 68.64ops/s. total: 3643.26 ± 1.04ms. best: 3642.03ms. avg: 14.57 ± 0.00ms min: 9.70 ± 0.02ms max: 18.35 ± 0.02ms p99: 17.90 ± 0.03ms	250 trips, 3 coordinates ops: 106.26 ± 0.08 ops/s. best: 106.35ops/s. total: 2352.81 ± 1.72ms. best: 2350.82ms. avg: 9.41 ± 0.01ms min: 6.03 ± 0.01ms max: 12.44 ± 0.06ms p99: 12.37 ± 0.03ms 250 trips, 5 coordinates ops: 68.85 ± 0.01 ops/s. best: 68.87ops/s. total: 3631.01 ± 0.58ms. best: 3630.03ms. avg: 14.52 ± 0.00ms min: 9.69 ± 0.01ms max: 18.25 ± 0.02ms p99: 17.84 ± 0.03ms
route_ch	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true 680.538ms 0.680538ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true 828.297ms 0.828297ms/req 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false 268.055ms 0.268055ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false 234.118ms 0.234118ms/req	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true 684.093ms 0.684093ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true 830.826ms 0.830826ms/req 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false 270.054ms 0.270054ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false 235.6ms 0.2356ms/req
route_mld	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true 857.525ms 0.857525ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true 1086.33ms 1.08633ms/req 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false 442.293ms 0.442293ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false 478.008ms 0.478008ms/req	1000 routes, 3 coordinates, no alternatives, overview=full, steps=true 868.739ms 0.868739ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true 1111.39ms 1.11139ms/req 1000 routes, 3 coordinates, no alternatives, overview=false, steps=false 454.359ms 0.454359ms/req 1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false 502.601ms 0.502601ms/req
rtree	1 result: 256.139ms -> 0.0256139 ms/query 10 results: 290.095ms -> 0.0290095 ms/query	1 result: 257.604ms -> 0.0257604 ms/query 10 results: 291.733ms -> 0.0291733 ms/query