facebook
Batch benchmark replications
Summary: Currently, benchmark methods have an attribute distribute_replications that indicates whether replications should be run fully in parallel or serially. This diff allows for batching the replications by replacing the Benchmarkmethod attribute distribute_replications with repications_per_batch.
Differential Revision: D49893686
Codecov Report
All modified lines are covered by tests :white_check_mark:
Comparison is base (
bfa8738) 94.58% compared to head (012b0b1) 94.58%.
:exclamation: Current head 012b0b1 differs from pull request most recent head 3f3d620. Consider uploading reports for the commit 3f3d620 to get more accurate results
Additional details and impacted files
@@ Coverage Diff @@
## main #1907 +/- ##
=======================================
Coverage 94.58% 94.58%
=======================================
Files 459 459
Lines 43426 43427 +1
=======================================
+ Hits 41076 41077 +1
Misses 2350 2350
| Files | Coverage Δ | |
|---|---|---|
| ax/benchmark/benchmark_method.py | 100.00% <100.00%> (ø) |
|
| ax/benchmark/methods/modular_botorch.py | 100.00% <ø> (ø) |
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
