rdf4j icon indicating copy to clipboard operation
rdf4j copied to clipboard

Measure current performance on main branch

Open hmottestad opened this issue 2 years ago • 1 comments

Run the benchmarks on the main branch.

hmottestad avatar Jun 06 '23 14:06 hmottestad

MemoryStore

Benchmark                                                     Mode  Cnt     Score    Error  Units
QueryBenchmark.complexQuery                                   avgt   15     1.516 ±  0.041  ms/op
QueryBenchmark.different_datasets_with_similar_distributions  avgt   15     0.750 ±  0.004  ms/op
QueryBenchmark.groupByQuery                                   avgt   15     0.997 ±  0.009  ms/op
QueryBenchmark.long_chain                                     avgt   15   258.640 ±  2.126  ms/op
QueryBenchmark.lots_of_optional                               avgt   15    53.451 ±  0.422  ms/op
QueryBenchmark.minus                                          avgt   15  2437.117 ± 77.652  ms/op
QueryBenchmark.nested_optionals                               avgt   15    71.964 ±  0.199  ms/op
QueryBenchmark.pathExpressionQuery1                           avgt   15     7.265 ±  0.032  ms/op
QueryBenchmark.pathExpressionQuery2                           avgt   15     1.132 ±  0.006  ms/op
QueryBenchmark.query_distinct_predicates                      avgt   15    62.500 ±  0.987  ms/op
QueryBenchmark.simple_filter_not                              avgt   15     3.021 ±  0.110  ms/op
Benchmark                                    Mode  Cnt   Score   Error  Units
ParallelQueryBenchmark.mixedQueriesAndReads  avgt   15  22.401 ± 1.031  ms/op
Benchmark                                         Mode  Cnt   Score   Error  Units
SparqlOverheadBenchmark.getAllStatementSparql     avgt   15  25.238 ± 0.711  ms/op
SparqlOverheadBenchmark.getAllStatementsDirectly  avgt   15  11.404 ± 0.850  ms/op
SparqlOverheadBenchmark.queryWithManyVars         avgt   15   0.258 ± 0.004  ms/op
# Benchmark: org.eclipse.rdf4j.sail.memory.benchmark.OOMBenchmark.sortAllObjectsWithSparql
Count: 32

# Benchmark: org.eclipse.rdf4j.sail.memory.benchmark.OOMBenchmark.sortDirectly
Count: 111
Benchmark                                                      Mode  Cnt    Score    Error  Units
ParallelMixedReadWriteBenchmark.mixedQueriesAndReadsAndWrites  avgt   15  976.187 ± 38.334  ms/op
Benchmark                                                    Mode  Cnt   Score   Error  Units
QueryWriteBenchmark.removeByQuery                            avgt   15   4.512 ± 0.058  ms/op
QueryWriteBenchmark.removeByQueryReadCommitted               avgt   15  15.444 ± 0.269  ms/op
QueryWriteBenchmark.simpleUpdateQueryIsolationNone           avgt   15  20.377 ± 0.137  ms/op
QueryWriteBenchmark.simpleUpdateQueryIsolationReadCommitted  avgt   15  38.079 ± 1.446  ms/op

Benchmark                                               Mode  Cnt  Score   Error  Units
ConcurrentQueryBenchmark.getNamespaces                  avgt   15  0.901 ± 0.062  ms/op
ConcurrentQueryBenchmark.getNamespacesSharedConnection  avgt   15  1.328 ± 0.074  ms/op
ConcurrentQueryBenchmark.hasStatement                   avgt   15  0.935 ± 0.099  ms/op
ConcurrentQueryBenchmark.hasStatementSharedConnection   avgt   15  1.047 ± 0.079  ms/op

hmottestad avatar Jun 06 '23 14:06 hmottestad