FrameworkBenchmarks

FrameworkBenchmarks copied to clipboard

Ur/Web updates

6

Hello! I am interested in getting the Ur/Web benchmark back up and running, I noticed the error at: https://tfb-status.techempower.com/unzip/results.2022-03-21-18-55-25-452.zip/results/20220316112215/urweb-cache/cached-query/verification.txt This is just the first step to update the code to...

sheganinans

PHP 8.1 update [info]

2

## PHP 8.1 As the `ppa:ondrej/php` include now `php8.1-rc5`, I'm starting to test the frameworks for the benchmark. PHP 8.1 final will be released 25th of this month. If you...

joanhey

[Requirements] Add that Response cache is not permitted in Fortunes test

19

[Fortunes Requirements ](https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#fortunes) It's obvious that want to test server-side templates, XSS countermeasures,... and that it need to be executed in each request and not test the template cache. And...

joanhey

Include memory usage in results

2

Given that memory is often limited on VPS machines, I think it would be beneficial to include peak memory usage in the results. Would it be feasible to add this?...

frmdstryr

Loosen Update verification

16

Since the update is random values; perhaps lower the threshold a little (e.g. 95%) e.g. the last tfb run failed Rails for updating too few rows (1 short) https://tfb-status.techempower.com/unzip/results.2020-07-12-19-02-35-234.zip/results/20200708175354/rails/update/verification.txt ```...

benaadams

Add SqlServer on Linux DB?

26

Could a SqlServer DB be added? Based on docker `FROM microsoft/mssql-server-linux:latest`

benaadams

Update Citrine to Ubuntu 22.04

3

### Why? For the kernel. The new kernel in 22.04 fix a lot of performance degradation, from the Spectre / Meltdown Mitigation security fixes. That we noted from round [18](https://www.techempower.com/benchmarks/#section=data-r18&hw=ph&test=fortune)...

joanhey

wrk is the bottleneck for plaintext test and json test

15

As we can see that the top tests of plaintext and json are so close, the wrk become the bottleneck of those tests. I think we should make the server...

Xudong-Huang

Possible issue with latency benchmarking

2

I'm looking at the visualization of results from continuous tests f26afdb3-7c19-4c20-84de-228b10434f84 and 3da523ee-fff1-45d8-9044-7feb532bf9ee, two recent consecutive runs. I noticed in the JSON Latency chart that the onion framework went from...

amichair

Requirements in Fortunes test

3

Some frameworks bypass the template engine. I understand it in platforms. But in micro and full frameworks they have a template engine. If they don't use it for the fortunes,...

joanhey