hpx icon indicating copy to clipboard operation
hpx copied to clipboard

Preparing for V1.11.0 release

Open hkaiser opened this issue 7 months ago • 7 comments

hkaiser avatar May 13 '25 18:05 hkaiser

Performance test report

HPX Performance

Comparison

BENCHMARKFORK_JOIN_EXECUTORPARALLEL_EXECUTORSCHEDULER_EXECUTOR
For Each(=)(=)(=)

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-13T18:54:25+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b69f3104a78441b23118c9ceaee1ad898566705ea33
Datetime2025-01-27T09:56:10.969382-06:002025-05-13T13:59:52.248840-05:00
Envfile
Clusternamerostamrostam
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu

Comparison

BENCHMARKNO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch=

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-13T18:54:25+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b69f3104a78441b23118c9ceaee1ad898566705ea33
Datetime2025-01-27T09:58:01.174130-06:002025-05-13T14:01:41.901020-05:00
Envfile
Clusternamerostamrostam
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu

Comparison

BENCHMARKFORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATORPARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATORSCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add(=)(=)(=)
Stream Benchmark - Scale=-=
Stream Benchmark - Triad(=)(=)(=)
Stream Benchmark - Copy(=)(=)=

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-13T18:54:25+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b69f3104a78441b23118c9ceaee1ad898566705ea33
Datetime2025-01-27T09:58:21.725422-06:002025-05-13T14:02:02.193504-05:00
Envfile
Clusternamerostamrostam
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu

Explanation of Symbols

SymbolMEANING
=No performance change (confidence interval within ±1%)
(=)Probably no performance change (confidence interval within ±2%)
(+)/(-)Very small performance improvement/degradation (≤1%)
+/-Small performance improvement/degradation (≤5%)
++/--Large performance improvement/degradation (≤10%)
+++/---Very large performance improvement/degradation (>10%)
?Probably no change, but quite large uncertainty (confidence interval with ±5%)
??Unclear result, very large uncertainty (±10%)
???Something unexpected…

StellarBot avatar May 13 '25 19:05 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARKFORK_JOIN_EXECUTORPARALLEL_EXECUTORSCHEDULER_EXECUTOR
For Each(=)(=)(=)

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-13T21:00:58+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b6947d692773357bfaf7e1d9196e5d634a41af3aac6
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Clusternamerostamrostam
Datetime2025-01-27T09:56:10.969382-06:002025-05-13T17:22:50.672382-05:00
Envfile
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu

Comparison

BENCHMARKNO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch(=)

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-13T21:00:58+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b6947d692773357bfaf7e1d9196e5d634a41af3aac6
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Clusternamerostamrostam
Datetime2025-01-27T09:58:01.174130-06:002025-05-13T17:24:41.383935-05:00
Envfile
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu

Comparison

BENCHMARKFORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATORPARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATORSCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add(=)(=)(=)
Stream Benchmark - Scale(=)--=
Stream Benchmark - Triad(=)(=)(=)
Stream Benchmark - Copy===

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-13T21:00:58+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b6947d692773357bfaf7e1d9196e5d634a41af3aac6
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Clusternamerostamrostam
Datetime2025-01-27T09:58:21.725422-06:002025-05-13T17:25:01.649876-05:00
Envfile
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu

Explanation of Symbols

SymbolMEANING
=No performance change (confidence interval within ±1%)
(=)Probably no performance change (confidence interval within ±2%)
(+)/(-)Very small performance improvement/degradation (≤1%)
+/-Small performance improvement/degradation (≤5%)
++/--Large performance improvement/degradation (≤10%)
+++/---Very large performance improvement/degradation (>10%)
?Probably no change, but quite large uncertainty (confidence interval with ±5%)
??Unclear result, very large uncertainty (±10%)
???Something unexpected…

StellarBot avatar May 13 '25 22:05 StellarBot

Coverage summary from Codacy

See diff coverage on Codacy

Coverage variation Diff coverage
:white_check_mark: -0.80% :white_check_mark: 77.78%
Coverage variation details
Coverable lines Covered lines Coverage
Common ancestor commit (15afc8be41b0668584dfafe2d8cf6ffb75dfb715) 244963 210174 85.80%
Head commit (f6171c49b61db0a9ca794bfd72519647b9687384) 195781 (-49182) 166418 (-43756) 85.00% (-0.80%)

Coverage variation is the difference between the coverage for the head and common ancestor commits of the pull request branch: <coverage of head commit> - <coverage of common ancestor commit>

Diff coverage details
Coverable lines Covered lines Diff coverage
Pull request (#6703) 27 21 77.78%

Diff coverage is the percentage of lines that are covered by tests out of the coverable lines that the pull request added or modified: <covered lines added or modified>/<coverable lines added or modified> * 100%

See your quality gate settings    Change summary preferences

codacy-production[bot] avatar May 14 '25 00:05 codacy-production[bot]

retest lsu

hkaiser avatar May 17 '25 15:05 hkaiser

Performance test report

HPX Performance

Comparison

BENCHMARKFORK_JOIN_EXECUTORPARALLEL_EXECUTORSCHEDULER_EXECUTOR
For Each(=)(=)(=)

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-15T17:20:49+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b696feeb642280182d5a09e6b7feb3cd4300cc9dd43
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu
Clusternamerostamrostam
Datetime2025-01-27T09:56:10.969382-06:002025-05-17T10:39:45.438769-05:00
Envfile

Comparison

BENCHMARKNO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch(=)

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-15T17:20:49+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b696feeb642280182d5a09e6b7feb3cd4300cc9dd43
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu
Clusternamerostamrostam
Datetime2025-01-27T09:58:01.174130-06:002025-05-17T10:41:34.648098-05:00
Envfile

Comparison

BENCHMARKFORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATORPARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATORSCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add(=)(=)(=)
Stream Benchmark - Scale(=)-=
Stream Benchmark - Triad==(=)
Stream Benchmark - Copy(=)(=)(=)

Info

PropertyBeforeAfter
HPX Datetime2025-01-27T15:49:39+00:002025-05-15T17:20:49+00:00
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b696feeb642280182d5a09e6b7feb3cd4300cc9dd43
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu
Clusternamerostamrostam
Datetime2025-01-27T09:58:21.725422-06:002025-05-17T10:41:55.598035-05:00
Envfile

Explanation of Symbols

SymbolMEANING
=No performance change (confidence interval within ±1%)
(=)Probably no performance change (confidence interval within ±2%)
(+)/(-)Very small performance improvement/degradation (≤1%)
+/-Small performance improvement/degradation (≤5%)
++/--Large performance improvement/degradation (≤10%)
+++/---Very large performance improvement/degradation (>10%)
?Probably no change, but quite large uncertainty (confidence interval with ±5%)
??Unclear result, very large uncertainty (±10%)
???Something unexpected…

StellarBot avatar May 17 '25 15:05 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARKFORK_JOIN_EXECUTORPARALLEL_EXECUTORSCHEDULER_EXECUTOR
For Each(=)(=)(=)

Info

PropertyBeforeAfter
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b69123ea75be7a4de576ccfe8372d2b67182da95d7f
HPX Datetime2025-01-27T15:49:39+00:002025-05-17T23:56:30+00:00
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Datetime2025-01-27T09:56:10.969382-06:002025-05-17T19:31:58.291363-05:00
Clusternamerostamrostam
Envfile

Comparison

BENCHMARKNO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch=

Info

PropertyBeforeAfter
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b69123ea75be7a4de576ccfe8372d2b67182da95d7f
HPX Datetime2025-01-27T15:49:39+00:002025-05-17T23:56:30+00:00
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Datetime2025-01-27T09:58:01.174130-06:002025-05-17T19:33:48.282022-05:00
Clusternamerostamrostam
Envfile

Comparison

BENCHMARKFORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATORPARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATORSCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add(=)(=)(=)
Stream Benchmark - Scale(=)-=
Stream Benchmark - Triad(=)(=)(=)
Stream Benchmark - Copy(=)=(=)

Info

PropertyBeforeAfter
HPX Commitaf29eae7e863b7d0f25ced593281a628e4908b69123ea75be7a4de576ccfe8372d2b67182da95d7f
HPX Datetime2025-01-27T15:49:39+00:002025-05-17T23:56:30+00:00
Hostnamemedusa08.rostam.cct.lsu.edumedusa08.rostam.cct.lsu.edu
Compiler/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8/opt/apps/llvm/18.1.8/bin/clang++ 18.1.8
Datetime2025-01-27T09:58:21.725422-06:002025-05-17T19:34:08.606577-05:00
Clusternamerostamrostam
Envfile

Explanation of Symbols

SymbolMEANING
=No performance change (confidence interval within ±1%)
(=)Probably no performance change (confidence interval within ±2%)
(+)/(-)Very small performance improvement/degradation (≤1%)
+/-Small performance improvement/degradation (≤5%)
++/--Large performance improvement/degradation (≤10%)
+++/---Very large performance improvement/degradation (>10%)
?Probably no change, but quite large uncertainty (confidence interval with ±5%)
??Unclear result, very large uncertainty (±10%)
???Something unexpected…

StellarBot avatar May 18 '25 00:05 StellarBot

retest LSU

hkaiser avatar Jun 05 '25 15:06 hkaiser