sel4bench icon indicating copy to clipboard operation
sel4bench copied to clipboard

The results are not stable when using sel4bench.

Open zqyzsj opened this issue 1 year ago • 2 comments

I currently use the seL4bench to test some benchmarks. I use a for loop to evaluate the performance of my benchmark, and the results show that the performance of the first loop is 20 times slower than the next loops, and the next loops are steady. The following are the APIs I used in my experiment.

seL4_BenchmarkResetThreadUtilisation(simple_get_tcb(&env.simple)); 
 seL4_BenchmarkResetLog();
 test_suits();
 seL4_BenchmarkFinalizeLog();
 seL4_BenchmarkGetThreadUtilisation(simple_get_tcb(&env.simple))

And the following are the evaluation results. image

zqyzsj avatar Apr 16 '23 07:04 zqyzsj

Might be due to cold caches in the first run?

axel-h avatar Apr 16 '23 16:04 axel-h

@axel-h Hi axel-h, Thanks for your reply. At first I thought I was caused by cache misses or TLB misses in the first run. To check whether it is the case, I first run the test_suit(), and then run the test_suit in a for loop, and I found that the evaluation result is also high in the first loop than the following loops. I will check my test_suit(), thanks. BTW, I run my experiments on Raspberry Pi 4B.

zqyzsj avatar Apr 18 '23 09:04 zqyzsj