Apr 18 '22 17:04 hkaiser

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	(=)	(=)

Info

Property	Before	After
HPX Commit	a68196882e3e093ba44367f6675f538d613c9aa3	a63a288931c748a8a63ce27de0991c7a1c377dbc
HPX Datetime	2022-02-09T15:45:06+00:00	2022-04-18T18:19:32+00:00
Clustername	daint	daint
Hostname	nid00729	nid00025
Envfile
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Datetime	2022-02-09T17:03:21.440240+01:00	2022-04-18T20:30:50.793112+02:00

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	---

Info

Property	Before	After
HPX Commit	96a2e4bd1c76207dea8d5302784962c927882406	a63a288931c748a8a63ce27de0991c7a1c377dbc
HPX Datetime	2021-11-11T08:14:57+00:00	2022-04-18T18:19:32+00:00
Clustername	daint	daint
Hostname	nid00006	nid00025
Envfile
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Datetime	2021-11-11T09:28:13.071121+01:00	2022-04-18T20:31:10.265794+02:00

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	(=)	(=)
Stream Benchmark - Scale	(=)	(=)	(=)
Stream Benchmark - Triad	(=)	(=)	(=)
Stream Benchmark - Copy	(=)	(=)	(=)

Info

Property	Before	After
HPX Commit	71d8dbe40b737be02ea734f9d98fcc0b1e21f01a	a63a288931c748a8a63ce27de0991c7a1c377dbc
HPX Datetime	2021-11-10T19:14:21+00:00	2022-04-18T18:19:32+00:00
Clustername	daint	daint
Hostname	nid00120	nid00025
Envfile
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Datetime	2021-11-10T20:28:18.266961+01:00	2022-04-18T20:31:25.403452+02:00

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Apr 18 '22 18:04 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	(=)	(=)

Info

Property	Before	After
HPX Commit	a68196882e3e093ba44367f6675f538d613c9aa3	7decf0049f1c6e157548539b4817df7e56f8296e
HPX Datetime	2022-02-09T15:45:06+00:00	2022-08-27T16:00:38+00:00
Envfile
Clustername	daint	daint
Datetime	2022-02-09T17:03:21.440240+01:00	2022-08-27T23:41:11.544052+02:00
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Hostname	nid00729	nid01596

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	---

Info

Property	Before	After
HPX Commit	96a2e4bd1c76207dea8d5302784962c927882406	7decf0049f1c6e157548539b4817df7e56f8296e
HPX Datetime	2021-11-11T08:14:57+00:00	2022-08-27T16:00:38+00:00
Envfile
Clustername	daint	daint
Datetime	2021-11-11T09:28:13.071121+01:00	2022-08-27T23:41:31.288990+02:00
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Hostname	nid00006	nid01596

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	(=)	(=)
Stream Benchmark - Scale	(=)	(=)	(=)
Stream Benchmark - Triad	(=)	(=)	(=)
Stream Benchmark - Copy	(=)	(=)	(=)

Info

Property	Before	After
HPX Commit	71d8dbe40b737be02ea734f9d98fcc0b1e21f01a	7decf0049f1c6e157548539b4817df7e56f8296e
HPX Datetime	2021-11-10T19:14:21+00:00	2022-08-27T16:00:38+00:00
Envfile
Clustername	daint	daint
Datetime	2021-11-10T20:28:18.266961+01:00	2022-08-27T23:41:46.571435+02:00
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Hostname	nid00120	nid01596

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Aug 27 '22 21:08 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	(=)	(=)

Info

Property	Before	After
HPX Datetime	2022-05-31T12:57:29+00:00	2022-10-06T14:35:34+00:00
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	8b282d834e0bdfc2b69f5203c0cad37eb0cc49c4
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Datetime	2022-05-31T15:13:01.357969+02:00	2022-10-06T16:54:20.908717+02:00
Hostname	nid01193	nid00103
Envfile
Clustername	daint	daint

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	--

Info

Property	Before	After
HPX Datetime	2022-05-31T12:57:29+00:00	2022-10-06T14:35:34+00:00
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	8b282d834e0bdfc2b69f5203c0cad37eb0cc49c4
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Datetime	2022-05-31T15:13:18.026239+02:00	2022-10-06T16:54:39.072984+02:00
Hostname	nid01193	nid00103
Envfile
Clustername	daint	daint

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	(=)	(=)
Stream Benchmark - Scale	(=)	(=)	(=)
Stream Benchmark - Triad	(=)	(=)	(=)
Stream Benchmark - Copy	(=)	(=)	(=)

Info

Property	Before	After
HPX Datetime	2021-11-10T19:14:21+00:00	2022-10-06T14:35:34+00:00
HPX Commit	71d8dbe40b737be02ea734f9d98fcc0b1e21f01a	8b282d834e0bdfc2b69f5203c0cad37eb0cc49c4
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Datetime	2021-11-10T20:28:18.266961+01:00	2022-10-06T16:54:54.199073+02:00
Hostname	nid00120	nid00103
Envfile
Clustername	daint	daint

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Oct 06 '22 14:10 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	(=)	(=)

Info

Property	Before	After
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	707eb471ac1bab4cf820d1f5461bbb82d81c7967
HPX Datetime	2022-05-31T12:57:29+00:00	2022-12-20T20:32:07+00:00
Datetime	2022-05-31T15:13:01.357969+02:00	2022-12-20T22:06:00.829334+01:00
Clustername	daint	daint
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Hostname	nid01193	nid00475
Envfile

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	-

Info

Property	Before	After
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	707eb471ac1bab4cf820d1f5461bbb82d81c7967
HPX Datetime	2022-05-31T12:57:29+00:00	2022-12-20T20:32:07+00:00
Datetime	2022-05-31T15:13:18.026239+02:00	2022-12-20T22:06:18.906805+01:00
Clustername	daint	daint
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Hostname	nid01193	nid00475
Envfile

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	(=)	(=)
Stream Benchmark - Scale	(=)	(=)	(=)
Stream Benchmark - Triad	(=)	(=)	(=)
Stream Benchmark - Copy	(=)	(=)	(=)

Info

Property	Before	After
HPX Commit	71d8dbe40b737be02ea734f9d98fcc0b1e21f01a	707eb471ac1bab4cf820d1f5461bbb82d81c7967
HPX Datetime	2021-11-10T19:14:21+00:00	2022-12-20T20:32:07+00:00
Datetime	2021-11-10T20:28:18.266961+01:00	2022-12-20T22:06:34.632475+01:00
Clustername	daint	daint
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Hostname	nid00120	nid00475
Envfile

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Dec 20 '22 21:12 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Datetime	2022-05-31T12:57:29+00:00	2023-01-10T19:34:19+00:00
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	31851573442a71f8a94b1ae43d7f4fbfb49bb4c4
Clustername	daint	daint
Hostname	nid01193	nid00433
Envfile
Datetime	2022-05-31T15:13:01.357969+02:00	2023-01-10T20:47:06.525961+01:00
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	--

Info

Property	Before	After
HPX Datetime	2022-05-31T12:57:29+00:00	2023-01-10T19:34:19+00:00
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	31851573442a71f8a94b1ae43d7f4fbfb49bb4c4
Clustername	daint	daint
Hostname	nid01193	nid00433
Envfile
Datetime	2022-05-31T15:13:18.026239+02:00	2023-01-10T20:47:25.273849+01:00
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	+	(=)
Stream Benchmark - Scale	(=)	+++	(=)
Stream Benchmark - Triad	(=)	++	(=)
Stream Benchmark - Copy	(=)	++	(=)

Info

Property	Before	After
HPX Datetime	2021-11-10T19:14:21+00:00	2023-01-10T19:34:19+00:00
HPX Commit	71d8dbe40b737be02ea734f9d98fcc0b1e21f01a	31851573442a71f8a94b1ae43d7f4fbfb49bb4c4
Clustername	daint	daint
Hostname	nid00120	nid00433
Envfile
Datetime	2021-11-10T20:28:18.266961+01:00	2023-01-10T20:47:40.483174+01:00
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 10 '23 19:01 StellarBot

@Pansysk75 perfect! This seems to work as expected now! Thanks a lot!

Jan 10 '23 20:01 hkaiser

@Pansysk75 perfect! This seems to work as expected now! Thanks a lot!

I think the above StellarBot comment was from the Daint cluster and not from Rostam. The Rostam Jenkins has't picked up on it yet, maybe it needs a " retest "?

Jan 10 '23 21:01 Pansysk75

retest

Jan 10 '23 21:01 Pansysk75

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-05-31T12:57:29+00:00	2023-01-11T06:56:41+00:00
Envfile
Hostname	nid01193	nid00433
Datetime	2022-05-31T15:13:01.357969+02:00	2023-01-11T09:02:25.761488+01:00
Clustername	daint	daint
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	-

Info

Property	Before	After
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-05-31T12:57:29+00:00	2023-01-11T06:56:41+00:00
Envfile
Hostname	nid01193	nid00433
Datetime	2022-05-31T15:13:18.026239+02:00	2023-01-11T09:02:43.799603+01:00
Clustername	daint	daint
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	+	=
Stream Benchmark - Scale	(=)	+++	(=)
Stream Benchmark - Triad	(=)	++	(=)
Stream Benchmark - Copy	(=)	++	(=)

Info

Property	Before	After
HPX Commit	71d8dbe40b737be02ea734f9d98fcc0b1e21f01a	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2021-11-10T19:14:21+00:00	2023-01-11T06:56:41+00:00
Envfile
Hostname	nid00120	nid00433
Datetime	2021-11-10T20:28:18.266961+01:00	2023-01-11T09:02:59.266654+01:00
Clustername	daint	daint
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 11 '23 08:01 StellarBot

retest lsu

Jan 11 '23 08:01 Pansysk75

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Commit	b4684c6aede321df37bd7ad037bb27d32ee3f7df	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-12-17T16:48:13+00:00	2023-01-11T06:56:41+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Clustername	rostam	rostam
Datetime	2022-12-18T07:21:36.902432-06:00	2023-01-11T02:53:08.258896-06:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Envfile

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	++

Info

Property	Before	After
HPX Commit	b4684c6aede321df37bd7ad037bb27d32ee3f7df	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-12-17T16:48:13+00:00	2023-01-11T06:56:41+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Clustername	rostam	rostam
Datetime	2022-12-18T07:21:52.654946-06:00	2023-01-11T02:53:23.302050-06:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Envfile

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	++	++	+++
Stream Benchmark - Scale	(=)	+++	(=)
Stream Benchmark - Triad	+	++	+++
Stream Benchmark - Copy	+	++	+

Info

Property	Before	After
HPX Commit	b4684c6aede321df37bd7ad037bb27d32ee3f7df	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-12-17T16:48:13+00:00	2023-01-11T06:56:41+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Clustername	rostam	rostam
Datetime	2022-12-18T07:22:09.486722-06:00	2023-01-11T02:53:38.470827-06:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Envfile

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 11 '23 08:01 StellarBot

@hkaiser Ok, it seems to work all the way through. The report results seem a bit off, I'll need to check whether that's due to general inconsistency or due to a bad performance reference.

Jan 11 '23 10:01 Pansysk75

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Commit	b4684c6aede321df37bd7ad037bb27d32ee3f7df	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-12-17T16:48:13+00:00	2023-01-11T06:56:41+00:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Clustername	rostam	rostam
Envfile
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2022-12-18T07:21:36.902432-06:00	2023-01-11T04:55:53.837866-06:00

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	++

Info

Property	Before	After
HPX Commit	b4684c6aede321df37bd7ad037bb27d32ee3f7df	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-12-17T16:48:13+00:00	2023-01-11T06:56:41+00:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Clustername	rostam	rostam
Envfile
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2022-12-18T07:21:52.654946-06:00	2023-01-11T04:56:08.408130-06:00

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	+++	+++	+++
Stream Benchmark - Scale	+	+++	(=)
Stream Benchmark - Triad	+++	+++	+++
Stream Benchmark - Copy	+	++	+

Info

Property	Before	After
HPX Commit	b4684c6aede321df37bd7ad037bb27d32ee3f7df	45bd30da9c46dfae7fc4d9de8d3d714be8ba58f0
HPX Datetime	2022-12-17T16:48:13+00:00	2023-01-11T06:56:41+00:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Clustername	rostam	rostam
Envfile
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2022-12-18T07:22:09.486722-06:00	2023-01-11T04:56:23.575610-06:00

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 11 '23 10:01 StellarBot

Ok, it seems to work all the way through.

Great!

The report results seem a bit off, I'll need to check whether that's due to general inconsistency or due to a bad performance reference.

The current reference contained in this PR was copied from the Daint performance tests. We need to create a new reference set based on the data collected on Rostam.

Jan 11 '23 12:01 hkaiser

@Pansysk75 also, please let me know once you think that this can be merged.

Jan 11 '23 12:01 hkaiser

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-12T23:07:58+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2023-01-12T16:43:21.532200-06:00	2023-01-12T20:08:28.388535-06:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Envfile
Clustername	rostam	rostam

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	+

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-12T23:07:58+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2023-01-12T16:43:36.507183-06:00	2023-01-12T20:08:43.186865-06:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Envfile
Clustername	rostam	rostam

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	+++	(=)
Stream Benchmark - Scale	(=)	++	(=)
Stream Benchmark - Triad	(=)	++	(=)
Stream Benchmark - Copy	(=)	++	(=)

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-12T23:07:58+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2023-01-12T16:43:52.126933-06:00	2023-01-12T20:08:58.321911-06:00
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Envfile
Clustername	rostam	rostam

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 13 '23 02:01 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-12T23:07:58+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Clustername	rostam	rostam
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Datetime	2023-01-12T16:43:21.532200-06:00	2023-01-13T04:10:15.951027-06:00
Envfile

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	-

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-12T23:07:58+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Clustername	rostam	rostam
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Datetime	2023-01-12T16:43:36.507183-06:00	2023-01-13T04:10:31.068958-06:00
Envfile

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	+++	---
Stream Benchmark - Scale	(=)	+++	=
Stream Benchmark - Triad	(=)	+++	---
Stream Benchmark - Copy	-	++	(=)

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-12T23:07:58+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Clustername	rostam	rostam
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Datetime	2023-01-12T16:43:52.126933-06:00	2023-01-13T04:10:46.398919-06:00
Envfile

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 13 '23 10:01 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Datetime	2022-05-31T12:57:29+00:00	2023-01-13T10:22:47+00:00
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	c5af9e52d0869e2ff594a38dab392b837a41ee48
Datetime	2022-05-31T15:13:01.357969+02:00	2023-01-13T11:37:44.381088+01:00
Hostname	nid01193	nid00005
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Clustername	daint	daint
Envfile

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	--

Info

Property	Before	After
HPX Datetime	2022-05-31T12:57:29+00:00	2023-01-13T10:22:47+00:00
HPX Commit	d5655f89770ba953e8de3ceb349567d5fcb74a95	c5af9e52d0869e2ff594a38dab392b837a41ee48
Datetime	2022-05-31T15:13:18.026239+02:00	2023-01-13T11:38:02.475649+01:00
Hostname	nid01193	nid00005
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Clustername	daint	daint
Envfile

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	+	(=)
Stream Benchmark - Scale	(=)	+++	(=)
Stream Benchmark - Triad	(=)	++	(=)
Stream Benchmark - Copy	(=)	++	(=)

Info

Property	Before	After
HPX Datetime	2021-11-10T19:14:21+00:00	2023-01-13T10:22:47+00:00
HPX Commit	71d8dbe40b737be02ea734f9d98fcc0b1e21f01a	c5af9e52d0869e2ff594a38dab392b837a41ee48
Datetime	2021-11-10T20:28:18.266961+01:00	2023-01-13T11:38:18.190082+01:00
Hostname	nid00120	nid00005
Compiler	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0	/apps/daint/SSL/HPX/packages/llvm-11.0.0/bin/clang++ 11.0.0
Clustername	daint	daint
Envfile

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 13 '23 10:01 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	(=)	+	(=)

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	c5af9e52d0869e2ff594a38dab392b837a41ee48
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-13T10:22:47+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Envfile
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Datetime	2023-01-12T16:43:21.532200-06:00	2023-01-13T05:01:06.388335-06:00
Clustername	rostam	rostam

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	?

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	c5af9e52d0869e2ff594a38dab392b837a41ee48
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-13T10:22:47+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Envfile
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Datetime	2023-01-12T16:43:36.507183-06:00	2023-01-13T05:01:21.578883-06:00
Clustername	rostam	rostam

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	-	+	--
Stream Benchmark - Scale	(=)	+++	(=)
Stream Benchmark - Triad	-	+	--
Stream Benchmark - Copy	-	++	(=)

Info

Property	Before	After
HPX Commit	cbd11074c7c09d623e3f58528a0c99f8c9734e89	c5af9e52d0869e2ff594a38dab392b837a41ee48
HPX Datetime	2023-01-11T06:55:59+00:00	2023-01-13T10:22:47+00:00
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Envfile
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu
Datetime	2023-01-12T16:43:52.126933-06:00	2023-01-13T05:01:37.456335-06:00
Clustername	rostam	rostam

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 13 '23 11:01 StellarBot

Performance test report

HPX Performance

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR	PARALLEL_EXECUTOR	SCHEDULER_EXECUTOR
For Each	=	??	(=)

Info

Property	Before	After
HPX Datetime	2023-01-12T23:07:58+00:00	2023-01-13T13:36:25+00:00
HPX Commit	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee	564d7e553ddfffc1955bd129b30338667a8be15f
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2023-01-13T04:10:15.951027-06:00	2023-01-13T08:02:00.949750-06:00
Clustername	rostam	rostam
Envfile
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu

Comparison

BENCHMARK	NO-EXECUTOR
Future Overhead - Create Thread Hierarchical - Latch	(=)

Info

Property	Before	After
HPX Datetime	2023-01-12T23:07:58+00:00	2023-01-13T13:36:25+00:00
HPX Commit	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee	564d7e553ddfffc1955bd129b30338667a8be15f
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2023-01-13T04:10:31.068958-06:00	2023-01-13T08:02:16.192478-06:00
Clustername	rostam	rostam
Envfile
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu

Comparison

BENCHMARK	FORK_JOIN_EXECUTOR_DEFAULT_FORK_JOIN_POLICY_ALLOCATOR	PARALLEL_EXECUTOR_DEFAULT_PARALLEL_POLICY_ALLOCATOR	SCHEDULER_EXECUTOR_DEFAULT_SCHEDULER_EXECUTOR_ALLOCATOR
Stream Benchmark - Add	(=)	--	++
Stream Benchmark - Scale	(=)	-	(=)
Stream Benchmark - Triad	(=)	--	++
Stream Benchmark - Copy	+	-	-

Info

Property	Before	After
HPX Datetime	2023-01-12T23:07:58+00:00	2023-01-13T13:36:25+00:00
HPX Commit	eb604d5bfa8744d3c9cb3af402809c54e3d8f4ee	564d7e553ddfffc1955bd129b30338667a8be15f
Compiler	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1	/opt/apps/llvm/13.0.1/bin/clang++ 13.0.1
Datetime	2023-01-13T04:10:46.398919-06:00	2023-01-13T08:02:31.629690-06:00
Clustername	rostam	rostam
Envfile
Hostname	medusa08.rostam.cct.lsu.edu	medusa08.rostam.cct.lsu.edu

Explanation of Symbols

Symbol	MEANING
=	No performance change (confidence interval within ±1%)
(=)	Probably no performance change (confidence interval within ±2%)
(+)/(-)	Very small performance improvement/degradation (≤1%)
+/-	Small performance improvement/degradation (≤5%)
++/--	Large performance improvement/degradation (≤10%)
+++/---	Very large performance improvement/degradation (>10%)
?	Probably no change, but quite large uncertainty (confidence interval with ±5%)
??	Unclear result, very large uncertainty (±10%)
???	Something unexpected…

Jan 13 '23 14:01 StellarBot

Let's merge this now. It might need more work, however.

Jan 13 '23 20:01 hkaiser

bors merge

Jan 13 '23 20:01 hkaiser

Build succeeded:

Bors

Jan 13 '23 20:01 bors[bot]

hpx hpx copied to clipboard

Adding performance test Jenkins builder at LSU

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

Info

Explanation of Symbols

HPX Performance

Comparison

Info

Comparison

Info

Comparison

hpx
hpx copied to clipboard