FrameworkBenchmarks

FrameworkBenchmarks copied to clipboard

TLS/SSL test type(s)

15

This issue is for planning a new test type that exercises TLS (SSL), which was suggested as test type 10 on issue #133. I recommend reviewing the comment thread for...

bhauer

Cached Queries UI incorrect?

1

Cached queries is run in sets of 1, 10, 20, 50, 100  With the value used being 100  However the UI suggests its 20 queries rather than 100...

benaadams

Normalize JVM options for all JVM-based tests

9

Hi All - I'm raising this issue in regards to some of the JVM tests I've seen. It's going to be impossible to gain a true benchmark comparison of the...

emilypi

New classification for implementation types

6

I would like to suggest a new way to classify the implementations of this benchmark, primarily to exclude those implementations which are just simple wrappers over existing libraries implemented in...

dom96

Help us select frameworks for measuring hardware performance (TPR)

14

We are presently working on enhancing the TFB toolset to yield a measurement of the performance of the hardware environment (in addition to our measurement of specific frameworks). This is...

bhauer

Changes / Updates / Dates for Round 19

24

I'll be editing this pinned issue to link to other issues or pull requests that may affect tests for this round. **Round 19 testing will begin on or around May...

NateBrady23

Increase the concurrency of some tests.

2

I found in the `db` and `fortune` test that the number of client connections is not enough to measure the highest performance of some frameworks (especially the frameworks at the...

an-tao

Any change in azure ? [question]

4

In the **last azure run there is a global notable increase** in all frameworks. It would be useful to know what change has achieved these results. Last run started 2020-04-17...

joanhey

New benchmark idea (low from benchmark harness authors)

2

Here's an idea for a new benchmark: - Require frameworks to implement JSON, Queries, Fortunes, and Plaintext. - Make requests in an arbitrary order for each endpoint (e.g. /json, /queries?queries=10,...

lpereira

Clarify plaintext urls specifications

3

The specs currently suggest routes like `/plaintext`, `/json`, ... However since Plaintext is network-bound right now, using smaller ones makes a difference, which can be seen with pico.v and that...

sebastienros