swift-benchmark
swift-benchmark copied to clipboard
google
A swift library to benchmark code snippets.
Given the recent news about S4TF being archived, I wonder if anybody will continue working on this. Would it perhaps be a good idea to seek out a new home...
This PR does 2 things: 1. Splits warmup reporting, if warmup iterations are specified: ``` karl@Karls-MBP Benchmarks % ./.build/release/WebURLBenchmark --filter "Foundation" --warmup-iterations 20000 Warming up... Running FoundationCompat.ToWeb: AverageURLs... Done! (3944.60...
What are the defaults? - explain how # iterations and # warmup iterations are chosen. - explain how max-iterations is chosen by default - explain what the legal column names...
So that other processes don't interfere with benchmark results, it's important to do things like nice, caffeinate on Mac, etc,
Because humans brains are what they are, I think relative performance of benchmarked items may be more important than the absolute time for a lot of situations. "X is 3x...
I'm running into a specific problem that would be fixed by release tags: https://github.com/tensorflow/swift-models/pull/640 causes error "swift-benchmark is required using two different revision-based requirements, which is not supported" if we...
Currently we only include benchmark results in the json output. We should add a summary of the detected hardware alongside it. Especially summary of the CPU capabilities, and any of...
The library should provide a way to ensure that code under test isn't optimized away. The only reliable way I know of to do this that doesn't cost more than...
```swift /// Returns `x`, preventing its value from being statically known by the optimizer. @inline(__always) fileprivate func hideValue(_ x: T) -> T { @_optimize(none) func assumePointeeIsWritten(_ x: UnsafeMutablePointer) {} var...
Then we can paste it into github comments and it will format nicely, and more compactly, without triple-backquoting it.