DESC icon indicating copy to clipboard operation
DESC copied to clipboard

Add JAX implementation of `REGCOIL` algorithm and Add Ability to Discretize Current Potentials into Coilsets

Open dpanici opened this issue 2 years ago • 65 comments

  • Adds function run_regcoil to _current_potential.py that implements the REGCOIL algorithm (Landreman, (2017)) for surface current normal field optimization
    • Can specify current_helicity to determine if resulting contours correspond to helical topology (current_helicity not equal to 0) or modular (current_helicityequal to 0)
    • if multiple values of the regularization parameter are input, will return a family of surface current fields (as a list) corresponding to the solution at each regularization value
    • Can also specify regularization_type which can be simple or regcoil, the difference explained here, tldr is simple is not guaranteed to monotonically decrease $\chi^2_K$ as regularization increases, but gives the same qualitative behavior and is less expensive to run.
  • Adds method To_CoilSet to FourierCurrentPotentialField which implements a coil cutting algorithm to discretize the surface current into coils
    • works for both modular and helical coils
    • uses skimage.measure.find_contours instead of matplotlib's deprecated contour finding algorithm, so this PR adds a new dependency in skimage.
  • Adds a new objective SurfaceCurrentRegularization (which minimizes w*|K|^2, the regularization term from surface current in the REGCOIL algorithm, with w being the objective weight which act as the regularization parameter)
    • use of both this and the QuadraticFlux objective allows for REGCOIL solutions to be obtained through the optimization framework, and combined with other objectives as well.
  • Adds a tutorial showing these features

Resolves #578

Remaining TODO (Or for future PRs):

  • [ ] debug result when M=0, N=0 mode is in FourierCurrentPotentialField basis
  • [ ] add options to scan over external_TF fraction and over helicity_ratio (that way only need to find Jacobian of Bn_SV(phi_mn) once) (maybe just add option to return Jacobian? then can make function way simpler, and have an example of how to use to do a scan...) -> removed this as it was a bit specific to NT-TAO and made the code a bit messy, though I think it could be a reasonable thing to have as once you have the jacobian, it is free to change the external field... maybe adding a kwarg that uses a passed-in jacobian could be a workaround that keeps this feature
  • [ ] easier way to set current potential helicity when not doing the run_regcoil method - maybe a flag like (set_G_automatically which sets it based off of the integrated B_zeta from the eq and the external field, if provided)
  • [ ] Maybe attempt to speedup by not using JAX for jacobian but instead constructing manually, compare speeds (maybe an improvement for later...)
  • [ ] use plot_2d inside plot_regcoil_outputs for Phi and K (but not Bn, as it would be expensive to recompute Bplasma every time we call plot_2d)
  • [x] implement checks for coil cutting stell symmetry for modular coils (a bit more annoying as the resulting coilset will not be good if there is a coil that crosses the zeta=0 plane... could just check if any contours cross zeta=0 or zeta=pi/nfp and throw an error if so)
  • [x] add area element to run_regcoil
  • [ ] change run_regcoil name
  • [x] change heliicty to p/q to match my paper
  • [ ] use cholesky if single alpha is passed instead of SVD
  • [ ] use ax instead of plt in plotting util
  • [x] address notebook comments

Old TODO

TODO list:

  • [x] make more efficient by only evaluating Bn on one field period

  • [x] address aliasing issues (need large grids for both eval and source to accurately describe Bn for even a simple surface current density - This is mainly solved by increasing source_grid_N, which must be sufficiently large (something like NFP * basis_N * 2 or *3 at least, while source_grid_M can be 1.5 or 2 times basis_M. eval_grids can be 1.5 or 2 times basis_M and basis_N)

  • [x] simplify function

  • [x] rename helicity_ratio to something more clear, possibly re-define current potential G sign so that a positive helicity ratio corresponds to a positive slope of the contours of constant current potential? or at least explain better what it is, maybe just name it "coil helicity"

  • [x] replace biot function with one present in DESC already, or add it to a util function

  • [x] add tests

  • [x] add MagneticField class for CurrentPotentialField (so can use in finding Bnorm, field line tracing, etc) #592 -> merge this and things will be way more efficient

  • [x] add util function for finding Bnorm from a coilset on a surface possibly? could be a function of the MagneticField class which takes in the Surface object (tho maybe need to specify which surface since need to compute n_rho for toroidal surface, but probabnly not important to be compatible with Poincare surfaces right now)

  • [x] Add tests for coil finding with helicity ratio positive

  • [x] add tests for coil finding with |helicity ratio| >1

  • [x] in coil finding, check which direction the contour is heading, and ensure that sign of current is correct (can get K direction from n x grad(phi), dot with first contour pt - last contour point , use sign of that as indication of if current should be flipped or not)

  • [x] objective to do this (one for quad flux and one for regularizaiton)

  • [x] method of surfac current field to cut coils

  • [x] make sure source grid is sym=False

  • [x] find helical coils in smarter way, not using full 0->2pi in NFP

  • [x] finite beta (just need to include the plasma contribution) - might wait on #725 for this just to use the singular integral stuff, should add warnings for now about if used on a non-vacuum equilibrium

  • [x] replace contour finding matplotlib call with scikit contour finding function (to avoid having to make a figure when creating coils)

  • [x] Add tutorial for using these functions for coil optimization (Once #627 is implemented, use that algorithm in the tutorial)

  • [x] change field trace in tutorial to trace at multiple zeta, not just zeta=0

  • [x] fix tutorial regcoil calls to use new functions

  • [x] Use precise QA for regcoil test, as it does not take that long at lowres and is a better test than the barely nonaxisymmetric ellipse I am using currently

  • [x] impement coil cutting field period symmetry for modular coils

CLEANUP TODO FOR WORKFLOW:

  • [x] clean up field line tracing from current potential script (once #592 is in, dont need a separate script)
  • [x] clean up field line tracing from Coilset (again the necessity of a script is questionable)
  • [x] clean up coilset BNORM script (necessity of a separate script is questionable, can put in one script with calculate_Bnorm method of MagneticField, possibly with a plot option)
  • [x] separate functions for run regcoil and coil cutting into private functions that return coilset or families of surface current fields
  • [x] remove plotting from the run regcoil and coil cutting
  • [x] add plot util for the regcoil plots
  • [x] add compute function for min dist between coils in a coilset
  • [x] check if order of things matters for quad flux objective (or remove in favor of the one in master)
  • [x] weight Bn by area (surf jacobian)

dpanici avatar Jul 13 '23 22:07 dpanici

Ah this actually is branched off of #494 , should I point this PR towards there, or just wait to merge until that one is ready and merged in?

dpanici avatar Jul 13 '23 22:07 dpanici

Codecov Report

Attention: Patch coverage is 98.72123% with 5 lines in your changes missing coverage. Please review.

Project coverage is 95.56%. Comparing base (0cc9c65) to head (322434b). Report is 2225 commits behind head on master.

Files with missing lines Patch % Lines
desc/magnetic_fields/_current_potential.py 99.37% 2 Missing :warning:
desc/objectives/_coils.py 96.15% 2 Missing :warning:
desc/plotting.py 87.50% 1 Missing :warning:
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #579      +/-   ##
==========================================
+ Coverage   95.50%   95.56%   +0.06%     
==========================================
  Files          96       96              
  Lines       24027    24405     +378     
==========================================
+ Hits        22947    23323     +376     
- Misses       1080     1082       +2     
Files with missing lines Coverage Δ
desc/compute/_surface.py 100.00% <100.00%> (ø)
desc/magnetic_fields/__init__.py 100.00% <100.00%> (ø)
desc/magnetic_fields/_core.py 96.61% <ø> (ø)
desc/objectives/__init__.py 100.00% <ø> (ø)
desc/plotting.py 96.00% <87.50%> (-0.07%) :arrow_down:
desc/magnetic_fields/_current_potential.py 99.39% <99.37%> (-0.06%) :arrow_down:
desc/objectives/_coils.py 99.15% <96.15%> (-0.38%) :arrow_down:

... and 5 files with indirect coverage changes

codecov[bot] avatar Jul 14 '23 03:07 codecov[bot]

closing until files are cleaned up

dpanici avatar Jul 31 '23 05:07 dpanici

reopening so tests will run

dpanici avatar Aug 20 '23 22:08 dpanici

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -0.81 +/- 1.41     | -1.54e-04 +/- 2.68e-04 |  1.88e-02 +/- 2.0e-04  |  1.90e-02 +/- 1.8e-04  |
 test_build_transform_fft_midres         |     +0.92 +/- 1.23     | +1.02e-03 +/- 1.37e-03 |  1.12e-01 +/- 9.9e-04  |  1.11e-01 +/- 9.5e-04  |
 test_build_transform_fft_highres        |     +0.51 +/- 0.80     | +2.65e-03 +/- 4.14e-03 |  5.18e-01 +/- 1.8e-03  |  5.15e-01 +/- 3.7e-03  |
 test_equilibrium_init_lowres            |     -0.56 +/- 1.71     | -2.45e-03 +/- 7.52e-03 |  4.36e-01 +/- 6.4e-03  |  4.39e-01 +/- 4.0e-03  |
 test_equilibrium_init_medres            |     -0.60 +/- 1.81     | -3.39e-03 +/- 1.02e-02 |  5.60e-01 +/- 4.6e-03  |  5.64e-01 +/- 9.1e-03  |
 test_equilibrium_init_highres           |     -0.60 +/- 1.14     | -5.94e-03 +/- 1.13e-02 |  9.86e-01 +/- 7.6e-03  |  9.92e-01 +/- 8.4e-03  |
 test_objective_compile_dshape_current   |     -1.65 +/- 7.48     | -8.70e-02 +/- 3.95e-01 |  5.19e+00 +/- 2.6e-01  |  5.28e+00 +/- 2.9e-01  |
 test_objective_compile_atf              |     +0.62 +/- 5.38     | +1.01e-01 +/- 8.71e-01 |  1.63e+01 +/- 7.0e-01  |  1.62e+01 +/- 5.1e-01  |
 test_objective_compute_dshape_current   |     -0.68 +/- 2.09     | -2.25e-05 +/- 6.96e-05 |  3.31e-03 +/- 6.7e-05  |  3.33e-03 +/- 1.9e-05  |
 test_objective_compute_atf              |     -1.96 +/- 0.90     | -2.22e-04 +/- 1.02e-04 |  1.11e-02 +/- 6.6e-05  |  1.13e-02 +/- 7.8e-05  |
 test_objective_jac_dshape_current       |     +2.19 +/- 13.98    | +2.81e-03 +/- 1.79e-02 |  1.31e-01 +/- 1.6e-02  |  1.28e-01 +/- 7.4e-03  |
 test_objective_jac_atf                  |     +2.01 +/- 3.54     | +1.52e-01 +/- 2.68e-01 |  7.71e+00 +/- 1.4e-01  |  7.56e+00 +/- 2.3e-01  |
 test_perturb_1                          |     -1.07 +/- 16.01    | -9.26e-02 +/- 1.39e+00 |  8.58e+00 +/- 9.9e-01  |  8.68e+00 +/- 9.8e-01  |
 test_perturb_2                          |     -0.35 +/- 5.53     | -5.78e-02 +/- 9.05e-01 |  1.63e+01 +/- 6.1e-01  |  1.64e+01 +/- 6.7e-01  |

github-actions[bot] avatar Oct 13 '23 02:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -2.29 +/- 2.38     | -4.39e-04 +/- 4.56e-04 |  1.87e-02 +/- 3.9e-04  |  1.92e-02 +/- 2.4e-04  |
 test_build_transform_fft_midres         |     -2.31 +/- 0.89     | -2.60e-03 +/- 1.00e-03 |  1.10e-01 +/- 7.5e-04  |  1.13e-01 +/- 6.6e-04  |
 test_build_transform_fft_highres        |     +0.05 +/- 0.70     | +2.37e-04 +/- 3.58e-03 |  5.13e-01 +/- 3.1e-03  |  5.13e-01 +/- 1.8e-03  |
 test_equilibrium_init_lowres            |     -0.74 +/- 1.74     | -3.18e-03 +/- 7.50e-03 |  4.29e-01 +/- 6.5e-03  |  4.32e-01 +/- 3.7e-03  |
 test_equilibrium_init_medres            |     -1.19 +/- 1.34     | -6.62e-03 +/- 7.45e-03 |  5.50e-01 +/- 5.3e-03  |  5.57e-01 +/- 5.2e-03  |
 test_equilibrium_init_highres           |     -1.05 +/- 1.08     | -1.04e-02 +/- 1.07e-02 |  9.83e-01 +/- 8.8e-03  |  9.93e-01 +/- 6.2e-03  |
 test_objective_compile_dshape_current   |     -0.92 +/- 6.44     | -4.85e-02 +/- 3.38e-01 |  5.20e+00 +/- 2.3e-01  |  5.25e+00 +/- 2.5e-01  |
 test_objective_compile_atf              |     +0.78 +/- 5.24     | +1.16e-01 +/- 7.84e-01 |  1.51e+01 +/- 6.7e-01  |  1.50e+01 +/- 4.1e-01  |
 test_objective_compute_dshape_current   |     -3.93 +/- 3.47     | -1.37e-04 +/- 1.21e-04 |  3.35e-03 +/- 8.0e-05  |  3.48e-03 +/- 9.1e-05  |
 test_objective_compute_atf              |     +0.76 +/- 1.24     | +8.54e-05 +/- 1.40e-04 |  1.13e-02 +/- 1.0e-04  |  1.13e-02 +/- 9.7e-05  |
 test_objective_jac_dshape_current       |     -1.82 +/- 9.71     | -2.37e-03 +/- 1.26e-02 |  1.27e-01 +/- 9.8e-03  |  1.30e-01 +/- 7.9e-03  |
 test_objective_jac_atf                  |     +1.21 +/- 2.58     | +7.67e-02 +/- 1.64e-01 |  6.42e+00 +/- 1.2e-01  |  6.35e+00 +/- 1.1e-01  |
 test_perturb_1                          |     -0.35 +/- 15.08    | -2.98e-02 +/- 1.30e+00 |  8.59e+00 +/- 7.3e-01  |  8.62e+00 +/- 1.1e+00  |
 test_perturb_2                          |     -1.01 +/- 4.92     | -1.66e-01 +/- 8.08e-01 |  1.62e+01 +/- 5.4e-01  |  1.64e+01 +/- 6.0e-01  |

github-actions[bot] avatar Oct 22 '23 00:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +0.99 +/- 6.45     | +2.80e-04 +/- 1.83e-03 |  2.86e-02 +/- 7.6e-04  |  2.83e-02 +/- 1.7e-03  |
 test_build_transform_fft_midres         |     +1.04 +/- 6.75     | +1.57e-03 +/- 1.02e-02 |  1.53e-01 +/- 6.4e-03  |  1.51e-01 +/- 7.9e-03  |
 test_build_transform_fft_highres        |     +7.32 +/- 3.84     | +4.88e-02 +/- 2.56e-02 |  7.15e-01 +/- 1.7e-02  |  6.67e-01 +/- 1.9e-02  |
 test_equilibrium_init_lowres            |     +0.78 +/- 4.62     | +4.68e-03 +/- 2.77e-02 |  6.04e-01 +/- 1.4e-02  |  6.00e-01 +/- 2.4e-02  |
 test_equilibrium_init_medres            |     -2.43 +/- 4.19     | -1.90e-02 +/- 3.27e-02 |  7.62e-01 +/- 1.8e-02  |  7.81e-01 +/- 2.8e-02  |
 test_equilibrium_init_highres           |     -1.11 +/- 5.15     | -1.42e-02 +/- 6.62e-02 |  1.27e+00 +/- 2.4e-02  |  1.28e+00 +/- 6.2e-02  |
 test_objective_compile_dshape_current   |     -0.63 +/- 8.67     | -4.60e-02 +/- 6.29e-01 |  7.21e+00 +/- 3.5e-01  |  7.26e+00 +/- 5.2e-01  |
 test_objective_compile_atf              |     +4.10 +/- 5.60     | +8.11e-01 +/- 1.11e+00 |  2.06e+01 +/- 6.7e-01  |  1.98e+01 +/- 8.8e-01  |
 test_objective_compute_dshape_current   |     -0.58 +/- 9.61     | -2.26e-05 +/- 3.74e-04 |  3.87e-03 +/- 2.4e-04  |  3.89e-03 +/- 2.9e-04  |
 test_objective_compute_atf              |     +3.15 +/- 10.62    | +4.27e-04 +/- 1.44e-03 |  1.40e-02 +/- 1.1e-03  |  1.36e-02 +/- 9.5e-04  |
 test_objective_jac_dshape_current       |     +5.08 +/- 13.81    | +5.85e-03 +/- 1.59e-02 |  1.21e-01 +/- 1.2e-02  |  1.15e-01 +/- 1.0e-02  |
 test_objective_jac_atf                  |     +1.58 +/- 2.12     | +1.28e-01 +/- 1.71e-01 |  8.18e+00 +/- 9.8e-02  |  8.05e+00 +/- 1.4e-01  |
 test_perturb_1                          |     -2.54 +/- 13.71    | -3.13e-01 +/- 1.69e+00 |  1.20e+01 +/- 1.1e+00  |  1.23e+01 +/- 1.3e+00  |
 test_perturb_2                          |     -4.98 +/- 6.82     | -1.16e+00 +/- 1.58e+00 |  2.20e+01 +/- 1.3e+00  |  2.32e+01 +/- 9.4e-01  |

github-actions[bot] avatar Oct 23 '23 03:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -2.29 +/- 9.97     | -5.20e-04 +/- 2.27e-03 |  2.22e-02 +/- 1.7e-03  |  2.27e-02 +/- 1.5e-03  |
 test_build_transform_fft_midres         |     +4.97 +/- 4.68     | +6.13e-03 +/- 5.78e-03 |  1.30e-01 +/- 3.7e-03  |  1.23e-01 +/- 4.4e-03  |
 test_build_transform_fft_highres        |     +1.23 +/- 6.84     | +6.98e-03 +/- 3.88e-02 |  5.74e-01 +/- 3.2e-02  |  5.67e-01 +/- 2.2e-02  |
 test_equilibrium_init_lowres            |     +1.14 +/- 9.19     | +5.93e-03 +/- 4.79e-02 |  5.28e-01 +/- 3.6e-02  |  5.22e-01 +/- 3.1e-02  |
 test_equilibrium_init_medres            |     -0.24 +/- 7.77     | -1.57e-03 +/- 5.15e-02 |  6.62e-01 +/- 3.3e-02  |  6.63e-01 +/- 4.0e-02  |
 test_equilibrium_init_highres           |     +0.20 +/- 7.23     | +2.39e-03 +/- 8.46e-02 |  1.17e+00 +/- 6.1e-02  |  1.17e+00 +/- 5.8e-02  |
 test_objective_compile_dshape_current   |     -3.89 +/- 11.22    | -2.42e-01 +/- 6.97e-01 |  5.97e+00 +/- 4.5e-01  |  6.21e+00 +/- 5.3e-01  |
 test_objective_compile_atf              |     +2.90 +/- 8.35     | +4.97e-01 +/- 1.43e+00 |  1.76e+01 +/- 1.4e+00  |  1.71e+01 +/- 4.6e-01  |
 test_objective_compute_dshape_current   |    -13.39 +/- 14.24    | -5.40e-04 +/- 5.74e-04 |  3.49e-03 +/- 3.9e-04  |  4.03e-03 +/- 4.2e-04  |
 test_objective_compute_atf              |     +0.57 +/- 7.79     | +7.34e-05 +/- 1.01e-03 |  1.30e-02 +/- 5.1e-04  |  1.29e-02 +/- 8.7e-04  |
 test_objective_jac_dshape_current       |     -5.22 +/- 14.07    | -8.11e-03 +/- 2.19e-02 |  1.47e-01 +/- 1.7e-02  |  1.55e-01 +/- 1.4e-02  |
 test_objective_jac_atf                  |     +0.53 +/- 4.70     | +3.97e-02 +/- 3.53e-01 |  7.55e+00 +/- 2.7e-01  |  7.51e+00 +/- 2.2e-01  |
 test_perturb_1                          |     -0.66 +/- 11.90    | -6.76e-02 +/- 1.22e+00 |  1.02e+01 +/- 7.2e-01  |  1.02e+01 +/- 9.8e-01  |
 test_perturb_2                          |     +2.36 +/- 5.83     | +4.53e-01 +/- 1.12e+00 |  1.97e+01 +/- 8.5e-01  |  1.92e+01 +/- 7.3e-01  |

github-actions[bot] avatar Oct 23 '23 20:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +0.15 +/- 6.40     | +3.51e-05 +/- 1.49e-03 |  2.32e-02 +/- 1.4e-03  |  2.32e-02 +/- 5.9e-04  |
 test_build_transform_fft_midres         |     +2.04 +/- 3.57     | +2.74e-03 +/- 4.80e-03 |  1.37e-01 +/- 3.5e-03  |  1.34e-01 +/- 3.3e-03  |
 test_build_transform_fft_highres        |     -2.91 +/- 6.78     | -1.84e-02 +/- 4.29e-02 |  6.14e-01 +/- 3.5e-02  |  6.33e-01 +/- 2.5e-02  |
 test_equilibrium_init_lowres            |     -0.94 +/- 4.10     | -5.13e-03 +/- 2.23e-02 |  5.40e-01 +/- 1.3e-02  |  5.45e-01 +/- 1.8e-02  |
 test_equilibrium_init_medres            |     -1.18 +/- 3.75     | -8.10e-03 +/- 2.57e-02 |  6.77e-01 +/- 2.0e-02  |  6.85e-01 +/- 1.6e-02  |
 test_equilibrium_init_highres           |     -0.34 +/- 3.65     | -4.12e-03 +/- 4.44e-02 |  1.21e+00 +/- 2.6e-02  |  1.22e+00 +/- 3.6e-02  |
 test_objective_compile_dshape_current   |     +1.66 +/- 4.18     | +1.02e-01 +/- 2.59e-01 |  6.28e+00 +/- 1.9e-01  |  6.18e+00 +/- 1.7e-01  |
 test_objective_compile_atf              |     +1.25 +/- 4.86     | +2.18e-01 +/- 8.48e-01 |  1.77e+01 +/- 6.5e-01  |  1.74e+01 +/- 5.4e-01  |
 test_objective_compute_dshape_current   |     +1.28 +/- 9.21     | +5.11e-05 +/- 3.68e-04 |  4.04e-03 +/- 3.0e-04  |  3.99e-03 +/- 2.1e-04  |
 test_objective_compute_atf              |     +0.99 +/- 2.64     | +1.33e-04 +/- 3.53e-04 |  1.35e-02 +/- 3.2e-04  |  1.34e-02 +/- 1.5e-04  |
 test_objective_jac_dshape_current       |     +2.46 +/- 7.59     | +3.82e-03 +/- 1.18e-02 |  1.59e-01 +/- 8.2e-03  |  1.55e-01 +/- 8.5e-03  |
 test_objective_jac_atf                  |     +2.53 +/- 2.23     | +1.86e-01 +/- 1.64e-01 |  7.55e+00 +/- 8.4e-02  |  7.36e+00 +/- 1.4e-01  |
 test_perturb_1                          |     -2.03 +/- 10.77    | -2.15e-01 +/- 1.14e+00 |  1.04e+01 +/- 9.2e-01  |  1.06e+01 +/- 6.7e-01  |
 test_perturb_2                          |     -0.48 +/- 5.30     | -9.53e-02 +/- 1.05e+00 |  1.98e+01 +/- 7.1e-01  |  1.98e+01 +/- 7.7e-01  |

github-actions[bot] avatar Oct 23 '23 22:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -3.52 +/- 2.85     | -7.19e-04 +/- 5.83e-04 |  1.97e-02 +/- 2.8e-04  |  2.04e-02 +/- 5.1e-04  |
 test_build_transform_fft_midres         |     +0.41 +/- 0.85     | +4.78e-04 +/- 9.83e-04 |  1.16e-01 +/- 6.6e-04  |  1.15e-01 +/- 7.3e-04  |
 test_build_transform_fft_highres        |     +1.81 +/- 0.78     | +9.48e-03 +/- 4.10e-03 |  5.33e-01 +/- 3.0e-03  |  5.23e-01 +/- 2.8e-03  |
 test_equilibrium_init_lowres            |     -1.28 +/- 2.46     | -5.84e-03 +/- 1.12e-02 |  4.49e-01 +/- 9.2e-03  |  4.55e-01 +/- 6.5e-03  |
 test_equilibrium_init_medres            |     -1.44 +/- 1.54     | -8.34e-03 +/- 8.89e-03 |  5.70e-01 +/- 6.8e-03  |  5.79e-01 +/- 5.8e-03  |
 test_equilibrium_init_highres           |     -1.23 +/- 1.55     | -1.25e-02 +/- 1.57e-02 |  9.99e-01 +/- 9.7e-03  |  1.01e+00 +/- 1.2e-02  |
 test_objective_compile_dshape_current   |     -2.18 +/- 6.07     | -1.20e-01 +/- 3.35e-01 |  5.39e+00 +/- 2.7e-01  |  5.51e+00 +/- 2.0e-01  |
 test_objective_compile_atf              |     -1.99 +/- 3.56     | -3.39e-01 +/- 6.06e-01 |  1.67e+01 +/- 4.8e-01  |  1.70e+01 +/- 3.7e-01  |
 test_objective_compute_dshape_current   |     +6.37 +/- 5.83     | +2.20e-04 +/- 2.01e-04 |  3.67e-03 +/- 1.7e-04  |  3.45e-03 +/- 1.1e-04  |
 test_objective_compute_atf              |     -8.99 +/- 3.07     | -1.11e-03 +/- 3.80e-04 |  1.13e-02 +/- 2.0e-04  |  1.24e-02 +/- 3.2e-04  |
 test_objective_jac_dshape_current       |     -0.29 +/- 13.95    | -3.96e-04 +/- 1.93e-02 |  1.38e-01 +/- 1.4e-02  |  1.38e-01 +/- 1.3e-02  |
 test_objective_jac_atf                  |     +0.57 +/- 2.27     | +4.36e-02 +/- 1.75e-01 |  7.75e+00 +/- 1.5e-01  |  7.70e+00 +/- 9.2e-02  |
 test_perturb_1                          |     -1.73 +/- 15.58    | -1.55e-01 +/- 1.39e+00 |  8.78e+00 +/- 1.0e+00  |  8.94e+00 +/- 9.5e-01  |
 test_perturb_2                          |     -0.16 +/- 4.59     | -2.72e-02 +/- 7.86e-01 |  1.71e+01 +/- 3.8e-01  |  1.71e+01 +/- 6.9e-01  |

github-actions[bot] avatar Oct 24 '23 16:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +1.42 +/- 4.80     | +2.84e-04 +/- 9.58e-04 |  2.02e-02 +/- 9.1e-04  |  1.99e-02 +/- 3.1e-04  |
 test_build_transform_fft_midres         |     -1.97 +/- 1.21     | -2.36e-03 +/- 1.45e-03 |  1.17e-01 +/- 1.2e-03  |  1.20e-01 +/- 8.2e-04  |
 test_build_transform_fft_highres        |     -0.82 +/- 1.06     | -4.40e-03 +/- 5.70e-03 |  5.35e-01 +/- 5.2e-03  |  5.39e-01 +/- 2.4e-03  |
+test_equilibrium_init_lowres            |    -46.49 +/- 3.64     | -4.22e-01 +/- 3.30e-02 |  4.86e-01 +/- 1.2e-02  |  9.09e-01 +/- 3.1e-02  |
+test_equilibrium_init_medres            |    -54.11 +/- 1.53     | -7.21e-01 +/- 2.04e-02 |  6.11e-01 +/- 1.7e-02  |  1.33e+00 +/- 1.1e-02  |
+test_equilibrium_init_highres           |    -66.54 +/- 0.91     | -2.10e+00 +/- 2.87e-02 |  1.06e+00 +/- 1.2e-02  |  3.16e+00 +/- 2.6e-02  |
 test_objective_compile_dshape_current   |     +4.15 +/- 8.46     | +2.40e-01 +/- 4.89e-01 |  6.02e+00 +/- 2.2e-01  |  5.78e+00 +/- 4.4e-01  |
 test_objective_compile_atf              |     +8.70 +/- 6.56     | +1.64e+00 +/- 1.24e+00 |  2.05e+01 +/- 9.2e-01  |  1.88e+01 +/- 8.2e-01  |
 test_objective_compute_dshape_current   |     +3.92 +/- 14.27    | +1.35e-04 +/- 4.91e-04 |  3.57e-03 +/- 4.7e-04  |  3.44e-03 +/- 1.4e-04  |
 test_objective_compute_atf              |     +4.72 +/- 7.30     | +5.39e-04 +/- 8.33e-04 |  1.19e-02 +/- 8.1e-04  |  1.14e-02 +/- 1.7e-04  |
 test_objective_jac_dshape_current       |     +6.86 +/- 9.45     | +1.03e-02 +/- 1.42e-02 |  1.61e-01 +/- 1.1e-02  |  1.51e-01 +/- 9.2e-03  |
 test_objective_jac_atf                  |     +4.81 +/- 1.81     | +4.62e-01 +/- 1.74e-01 |  1.01e+01 +/- 1.4e-01  |  9.61e+00 +/- 1.1e-01  |
 test_perturb_1                          |     +1.03 +/- 20.90    | +9.46e-02 +/- 1.93e+00 |  9.32e+00 +/- 1.4e+00  |  9.22e+00 +/- 1.3e+00  |
 test_perturb_2                          |     +2.63 +/- 5.54     | +4.63e-01 +/- 9.75e-01 |  1.81e+01 +/- 8.1e-01  |  1.76e+01 +/- 5.4e-01  |

github-actions[bot] avatar Oct 26 '23 05:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -0.11 +/- 1.88     | -2.41e-05 +/- 4.26e-04 |  2.27e-02 +/- 3.9e-04  |  2.27e-02 +/- 1.7e-04  |
 test_build_transform_fft_midres         |     +1.29 +/- 1.16     | +1.71e-03 +/- 1.53e-03 |  1.34e-01 +/- 1.3e-03  |  1.32e-01 +/- 8.0e-04  |
 test_build_transform_fft_highres        |     -0.13 +/- 1.20     | -7.72e-04 +/- 7.29e-03 |  6.09e-01 +/- 4.3e-03  |  6.10e-01 +/- 5.9e-03  |
 test_equilibrium_init_lowres            |     -1.83 +/- 6.50     | -1.84e-02 +/- 6.56e-02 |  9.91e-01 +/- 5.3e-02  |  1.01e+00 +/- 3.9e-02  |
 test_equilibrium_init_medres            |     -0.97 +/- 5.49     | -1.45e-02 +/- 8.22e-02 |  1.48e+00 +/- 3.7e-02  |  1.50e+00 +/- 7.4e-02  |
 test_equilibrium_init_highres           |     -0.37 +/- 4.82     | -1.34e-02 +/- 1.73e-01 |  3.57e+00 +/- 4.7e-02  |  3.59e+00 +/- 1.7e-01  |
 test_objective_compile_dshape_current   |     -2.33 +/- 5.46     | -1.47e-01 +/- 3.45e-01 |  6.18e+00 +/- 2.4e-01  |  6.33e+00 +/- 2.5e-01  |
 test_objective_compile_atf              |     +2.36 +/- 3.92     | +4.16e-01 +/- 6.92e-01 |  1.80e+01 +/- 4.0e-01  |  1.76e+01 +/- 5.6e-01  |
 test_objective_compute_dshape_current   |     +9.05 +/- 8.95     | +3.62e-04 +/- 3.57e-04 |  4.36e-03 +/- 3.4e-04  |  3.99e-03 +/- 1.0e-04  |
 test_objective_compute_atf              |     -1.96 +/- 2.23     | -2.69e-04 +/- 3.06e-04 |  1.34e-02 +/- 1.2e-04  |  1.37e-02 +/- 2.8e-04  |
 test_objective_jac_dshape_current       |     -0.43 +/- 10.05    | -6.82e-04 +/- 1.58e-02 |  1.57e-01 +/- 1.4e-02  |  1.57e-01 +/- 7.5e-03  |
 test_objective_jac_atf                  |     -1.61 +/- 1.88     | -1.22e-01 +/- 1.42e-01 |  7.42e+00 +/- 1.0e-01  |  7.54e+00 +/- 1.0e-01  |
 test_perturb_1                          |     -1.27 +/- 12.89    | -1.33e-01 +/- 1.34e+00 |  1.03e+01 +/- 9.5e-01  |  1.04e+01 +/- 9.5e-01  |
 test_perturb_2                          |     -0.64 +/- 7.26     | -1.26e-01 +/- 1.44e+00 |  1.96e+01 +/- 9.9e-01  |  1.98e+01 +/- 1.0e+00  |

github-actions[bot] avatar Oct 26 '23 22:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -5.79 +/- 11.22    | -1.66e-03 +/- 3.21e-03 |  2.70e-02 +/- 1.6e-03  |  2.86e-02 +/- 2.8e-03  |
 test_build_transform_fft_midres         |     -2.19 +/- 6.52     | -3.34e-03 +/- 9.95e-03 |  1.49e-01 +/- 7.9e-03  |  1.53e-01 +/- 6.1e-03  |
 test_build_transform_fft_highres        |     -0.01 +/- 4.76     | -7.25e-05 +/- 3.27e-02 |  6.86e-01 +/- 2.7e-02  |  6.87e-01 +/- 1.9e-02  |
 test_equilibrium_init_lowres            |     -2.72 +/- 3.63     | -3.36e-02 +/- 4.48e-02 |  1.20e+00 +/- 2.3e-02  |  1.23e+00 +/- 3.9e-02  |
 test_equilibrium_init_medres            |     -3.19 +/- 3.18     | -5.73e-02 +/- 5.70e-02 |  1.74e+00 +/- 3.9e-02  |  1.80e+00 +/- 4.1e-02  |
 test_equilibrium_init_highres           |     -0.71 +/- 3.27     | -2.89e-02 +/- 1.34e-01 |  4.07e+00 +/- 7.1e-02  |  4.10e+00 +/- 1.1e-01  |
 test_objective_compile_dshape_current   |     -3.74 +/- 7.56     | -2.72e-01 +/- 5.49e-01 |  6.99e+00 +/- 2.7e-01  |  7.26e+00 +/- 4.8e-01  |
 test_objective_compile_atf              |     -0.15 +/- 4.57     | -2.97e-02 +/- 9.32e-01 |  2.04e+01 +/- 8.1e-01  |  2.04e+01 +/- 4.6e-01  |
 test_objective_compute_dshape_current   |     +5.22 +/- 19.93    | +2.00e-04 +/- 7.62e-04 |  4.03e-03 +/- 5.7e-04  |  3.83e-03 +/- 5.0e-04  |
 test_objective_compute_atf              |     -3.02 +/- 15.23    | -4.22e-04 +/- 2.13e-03 |  1.35e-02 +/- 1.8e-03  |  1.40e-02 +/- 1.1e-03  |
 test_objective_jac_dshape_current       |     +6.28 +/- 17.77    | +7.54e-03 +/- 2.13e-02 |  1.28e-01 +/- 1.5e-02  |  1.20e-01 +/- 1.6e-02  |
 test_objective_jac_atf                  |     -0.19 +/- 3.22     | -1.60e-02 +/- 2.66e-01 |  8.25e+00 +/- 2.3e-01  |  8.26e+00 +/- 1.3e-01  |
 test_perturb_1                          |     -0.26 +/- 12.16    | -3.15e-02 +/- 1.47e+00 |  1.20e+01 +/- 1.1e+00  |  1.21e+01 +/- 9.6e-01  |
 test_perturb_2                          |     -2.43 +/- 8.06     | -5.67e-01 +/- 1.88e+00 |  2.28e+01 +/- 1.3e+00  |  2.33e+01 +/- 1.4e+00  |

github-actions[bot] avatar Oct 27 '23 04:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -3.81 +/- 1.94     | -7.54e-04 +/- 3.84e-04 |  1.90e-02 +/- 2.6e-04  |  1.98e-02 +/- 2.8e-04  |
 test_build_transform_fft_midres         |     -1.54 +/- 0.83     | -1.75e-03 +/- 9.42e-04 |  1.12e-01 +/- 6.3e-04  |  1.14e-01 +/- 7.0e-04  |
 test_build_transform_fft_highres        |     -1.83 +/- 0.70     | -9.61e-03 +/- 3.65e-03 |  5.14e-01 +/- 2.3e-03  |  5.24e-01 +/- 2.9e-03  |
 test_equilibrium_init_lowres            |     -2.03 +/- 2.06     | -1.80e-02 +/- 1.82e-02 |  8.69e-01 +/- 1.6e-02  |  8.87e-01 +/- 9.0e-03  |
 test_equilibrium_init_medres            |     -0.32 +/- 0.96     | -4.21e-03 +/- 1.24e-02 |  1.30e+00 +/- 5.5e-03  |  1.30e+00 +/- 1.1e-02  |
 test_equilibrium_init_highres           |     -0.15 +/- 0.68     | -4.67e-03 +/- 2.08e-02 |  3.06e+00 +/- 1.5e-02  |  3.07e+00 +/- 1.4e-02  |
 test_objective_compile_dshape_current   |     +2.25 +/- 9.11     | +1.27e-01 +/- 5.15e-01 |  5.78e+00 +/- 3.9e-01  |  5.66e+00 +/- 3.3e-01  |
 test_objective_compile_atf              |    -10.09 +/- 4.17     | -1.94e+00 +/- 8.02e-01 |  1.73e+01 +/- 7.4e-01  |  1.93e+01 +/- 3.1e-01  |
 test_objective_compute_dshape_current   |     -8.73 +/- 8.50     | -3.20e-04 +/- 3.12e-04 |  3.35e-03 +/- 4.7e-05  |  3.67e-03 +/- 3.1e-04  |
 test_objective_compute_atf              |     -4.98 +/- 2.52     | -5.91e-04 +/- 2.99e-04 |  1.13e-02 +/- 1.5e-04  |  1.19e-02 +/- 2.6e-04  |
 test_objective_jac_dshape_current       |    -16.98 +/- 7.11     | -2.79e-02 +/- 1.17e-02 |  1.37e-01 +/- 7.3e-03  |  1.65e-01 +/- 9.2e-03  |
+test_objective_jac_atf                  |    -18.58 +/- 3.10     | -1.81e+00 +/- 3.01e-01 |  7.92e+00 +/- 9.8e-02  |  9.72e+00 +/- 2.8e-01  |
 test_perturb_1                          |    -21.78 +/- 16.59    | -2.52e+00 +/- 1.92e+00 |  9.06e+00 +/- 1.4e+00  |  1.16e+01 +/- 1.3e+00  |
 test_perturb_2                          |    -13.95 +/- 7.00     | -2.84e+00 +/- 1.43e+00 |  1.75e+01 +/- 1.3e+00  |  2.04e+01 +/- 6.2e-01  |

github-actions[bot] avatar Oct 29 '23 06:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +1.72 +/- 2.25     | +3.33e-04 +/- 4.34e-04 |  1.97e-02 +/- 2.9e-04  |  1.93e-02 +/- 3.2e-04  |
-test_build_transform_fft_midres         |     +6.70 +/- 1.05     | +7.52e-03 +/- 1.18e-03 |  1.20e-01 +/- 9.6e-04  |  1.12e-01 +/- 6.8e-04  |
-test_build_transform_fft_highres        |     +7.42 +/- 0.64     | +3.81e-02 +/- 3.29e-03 |  5.51e-01 +/- 2.5e-03  |  5.13e-01 +/- 2.1e-03  |
 test_equilibrium_init_lowres            |     -0.57 +/- 1.41     | -4.94e-03 +/- 1.21e-02 |  8.54e-01 +/- 6.2e-03  |  8.59e-01 +/- 1.0e-02  |
 test_equilibrium_init_medres            |     +1.21 +/- 0.72     | +1.55e-02 +/- 9.23e-03 |  1.29e+00 +/- 6.4e-03  |  1.28e+00 +/- 6.6e-03  |
-test_equilibrium_init_highres           |     +3.87 +/- 0.56     | +1.17e-01 +/- 1.69e-02 |  3.14e+00 +/- 1.4e-02  |  3.02e+00 +/- 9.3e-03  |
 test_objective_compile_dshape_current   |     -0.89 +/- 8.33     | -4.86e-02 +/- 4.55e-01 |  5.42e+00 +/- 3.3e-01  |  5.46e+00 +/- 3.2e-01  |
 test_objective_compile_atf              |     +1.19 +/- 5.21     | +2.03e-01 +/- 8.90e-01 |  1.73e+01 +/- 7.8e-01  |  1.71e+01 +/- 4.3e-01  |
 test_objective_compute_dshape_current   |     +6.56 +/- 4.68     | +2.20e-04 +/- 1.57e-04 |  3.57e-03 +/- 1.6e-04  |  3.35e-03 +/- 2.2e-05  |
 test_objective_compute_atf              |     +5.11 +/- 3.04     | +5.66e-04 +/- 3.37e-04 |  1.16e-02 +/- 2.6e-04  |  1.11e-02 +/- 2.1e-04  |
 test_objective_jac_dshape_current       |     -2.70 +/- 19.59    | -3.90e-03 +/- 2.84e-02 |  1.41e-01 +/- 2.4e-02  |  1.45e-01 +/- 1.6e-02  |
 test_objective_jac_atf                  |     -6.64 +/- 4.51     | -5.60e-01 +/- 3.81e-01 |  7.88e+00 +/- 3.1e-01  |  8.44e+00 +/- 2.2e-01  |
 test_perturb_1                          |    -20.87 +/- 13.13    | -2.31e+00 +/- 1.45e+00 |  8.74e+00 +/- 1.0e+00  |  1.10e+01 +/- 1.1e+00  |
+test_perturb_2                          |    -13.71 +/- 4.07     | -2.63e+00 +/- 7.82e-01 |  1.66e+01 +/- 4.1e-01  |  1.92e+01 +/- 6.7e-01  |

github-actions[bot] avatar Oct 29 '23 07:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -0.42 +/- 2.86     | -9.72e-05 +/- 6.67e-04 |  2.32e-02 +/- 5.3e-04  |  2.33e-02 +/- 4.1e-04  |
 test_build_transform_fft_midres         |     +1.40 +/- 0.74     | +1.88e-03 +/- 9.89e-04 |  1.36e-01 +/- 7.8e-04  |  1.34e-01 +/- 6.1e-04  |
-test_build_transform_fft_highres        |     +2.22 +/- 0.70     | +1.37e-02 +/- 4.30e-03 |  6.29e-01 +/- 2.8e-03  |  6.15e-01 +/- 3.2e-03  |
 test_equilibrium_init_lowres            |     -0.69 +/- 6.30     | -7.07e-03 +/- 6.47e-02 |  1.02e+00 +/- 4.8e-02  |  1.03e+00 +/- 4.3e-02  |
 test_equilibrium_init_medres            |     -2.00 +/- 5.45     | -3.08e-02 +/- 8.41e-02 |  1.51e+00 +/- 3.0e-02  |  1.54e+00 +/- 7.8e-02  |
 test_equilibrium_init_highres           |     +0.99 +/- 1.42     | +3.57e-02 +/- 5.13e-02 |  3.65e+00 +/- 3.9e-02  |  3.62e+00 +/- 3.4e-02  |
 test_objective_compile_dshape_current   |     -1.35 +/- 5.45     | -8.75e-02 +/- 3.53e-01 |  6.40e+00 +/- 2.8e-01  |  6.49e+00 +/- 2.1e-01  |
 test_objective_compile_atf              |     -1.55 +/- 4.27     | -2.92e-01 +/- 8.03e-01 |  1.85e+01 +/- 3.9e-01  |  1.88e+01 +/- 7.0e-01  |
 test_objective_compute_dshape_current   |    +10.71 +/- 29.88    | +4.28e-04 +/- 1.19e-03 |  4.43e-03 +/- 1.2e-03  |  4.00e-03 +/- 9.7e-05  |
 test_objective_compute_atf              |     +0.34 +/- 3.63     | +4.65e-05 +/- 4.99e-04 |  1.38e-02 +/- 3.8e-04  |  1.37e-02 +/- 3.3e-04  |
 test_objective_jac_dshape_current       |     -9.64 +/- 10.07    | -1.67e-02 +/- 1.74e-02 |  1.56e-01 +/- 1.2e-02  |  1.73e-01 +/- 1.2e-02  |
+test_objective_jac_atf                  |    -11.25 +/- 3.53     | -9.63e-01 +/- 3.02e-01 |  7.59e+00 +/- 2.6e-01  |  8.55e+00 +/- 1.5e-01  |
 test_perturb_1                          |    -21.80 +/- 10.91    | -2.92e+00 +/- 1.46e+00 |  1.05e+01 +/- 1.2e+00  |  1.34e+01 +/- 8.7e-01  |
+test_perturb_2                          |    -14.18 +/- 2.90     | -3.30e+00 +/- 6.76e-01 |  2.00e+01 +/- 3.1e-01  |  2.33e+01 +/- 6.0e-01  |

github-actions[bot] avatar Oct 30 '23 04:10 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -0.30 +/- 1.33     | -5.45e-05 +/- 2.43e-04 |  1.82e-02 +/- 1.2e-04  |  1.82e-02 +/- 2.1e-04  |
 test_build_transform_fft_midres         |     -0.22 +/- 0.90     | -2.43e-04 +/- 1.01e-03 |  1.11e-01 +/- 7.6e-04  |  1.12e-01 +/- 6.6e-04  |
 test_build_transform_fft_highres        |     +1.11 +/- 0.72     | +5.81e-03 +/- 3.78e-03 |  5.30e-01 +/- 3.1e-03  |  5.24e-01 +/- 2.2e-03  |
 test_equilibrium_init_lowres            |     -0.90 +/- 0.75     | -7.01e-03 +/- 5.82e-03 |  7.74e-01 +/- 3.4e-03  |  7.81e-01 +/- 4.7e-03  |
 test_equilibrium_init_medres            |     -0.38 +/- 0.73     | -4.50e-03 +/- 8.63e-03 |  1.18e+00 +/- 6.4e-03  |  1.19e+00 +/- 5.7e-03  |
 test_equilibrium_init_highres           |     -0.12 +/- 0.62     | -3.55e-03 +/- 1.85e-02 |  2.97e+00 +/- 1.1e-02  |  2.97e+00 +/- 1.5e-02  |
 test_objective_compile_dshape_current   |     -1.19 +/- 5.92     | -6.02e-02 +/- 2.99e-01 |  4.99e+00 +/- 2.0e-01  |  5.05e+00 +/- 2.2e-01  |
 test_objective_compile_atf              |     -2.79 +/- 4.21     | -3.92e-01 +/- 5.92e-01 |  1.37e+01 +/- 3.8e-01  |  1.41e+01 +/- 4.6e-01  |
 test_objective_compute_dshape_current   |     +0.24 +/- 2.20     | +7.65e-06 +/- 6.87e-05 |  3.13e-03 +/- 5.0e-05  |  3.13e-03 +/- 4.8e-05  |
 test_objective_compute_atf              |     -1.99 +/- 1.22     | -2.16e-04 +/- 1.33e-04 |  1.06e-02 +/- 4.7e-05  |  1.08e-02 +/- 1.2e-04  |
 test_objective_jac_dshape_current       |     -8.08 +/- 12.92    | -1.09e-02 +/- 1.74e-02 |  1.24e-01 +/- 1.3e-02  |  1.35e-01 +/- 1.2e-02  |
 test_objective_jac_atf                  |     -7.08 +/- 3.52     | -4.18e-01 +/- 2.08e-01 |  5.49e+00 +/- 1.5e-01  |  5.90e+00 +/- 1.5e-01  |
 test_perturb_1                          |    -20.68 +/- 10.32    | -2.13e+00 +/- 1.06e+00 |  8.17e+00 +/- 7.2e-01  |  1.03e+01 +/- 7.8e-01  |
 test_perturb_2                          |    -10.98 +/- 3.73     | -1.91e+00 +/- 6.47e-01 |  1.55e+01 +/- 5.2e-01  |  1.74e+01 +/- 3.8e-01  |

github-actions[bot] avatar Nov 06 '23 03:11 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +0.16 +/- 1.12     | +2.92e-05 +/- 2.03e-04 |  1.82e-02 +/- 8.3e-05  |  1.81e-02 +/- 1.9e-04  |
 test_build_transform_fft_midres         |     -0.23 +/- 0.85     | -2.60e-04 +/- 9.56e-04 |  1.12e-01 +/- 6.0e-04  |  1.12e-01 +/- 7.4e-04  |
 test_build_transform_fft_highres        |     -0.14 +/- 0.70     | -7.17e-04 +/- 3.67e-03 |  5.25e-01 +/- 2.2e-03  |  5.26e-01 +/- 2.9e-03  |
 test_equilibrium_init_lowres            |     -0.50 +/- 0.94     | -3.88e-03 +/- 7.27e-03 |  7.71e-01 +/- 5.9e-03  |  7.75e-01 +/- 4.2e-03  |
 test_equilibrium_init_medres            |     +0.21 +/- 0.94     | +2.49e-03 +/- 1.11e-02 |  1.18e+00 +/- 6.9e-03  |  1.18e+00 +/- 8.6e-03  |
 test_equilibrium_init_highres           |     +0.70 +/- 0.61     | +2.08e-02 +/- 1.81e-02 |  2.98e+00 +/- 1.2e-02  |  2.96e+00 +/- 1.4e-02  |
 test_objective_compile_dshape_current   |     -1.21 +/- 5.55     | -6.03e-02 +/- 2.77e-01 |  4.92e+00 +/- 2.0e-01  |  4.98e+00 +/- 1.9e-01  |
 test_objective_compile_atf              |     -2.67 +/- 3.70     | -3.72e-01 +/- 5.16e-01 |  1.36e+01 +/- 3.4e-01  |  1.39e+01 +/- 3.9e-01  |
 test_objective_compute_dshape_current   |     -0.29 +/- 1.87     | -8.93e-06 +/- 5.84e-05 |  3.11e-03 +/- 3.4e-05  |  3.12e-03 +/- 4.7e-05  |
 test_objective_compute_atf              |     +0.15 +/- 0.44     | +1.62e-05 +/- 4.66e-05 |  1.06e-02 +/- 3.2e-05  |  1.06e-02 +/- 3.4e-05  |
 test_objective_jac_dshape_current       |     -8.52 +/- 8.12     | -1.16e-02 +/- 1.11e-02 |  1.25e-01 +/- 9.3e-03  |  1.36e-01 +/- 5.9e-03  |
 test_objective_jac_atf                  |     -6.18 +/- 2.69     | -3.64e-01 +/- 1.59e-01 |  5.53e+00 +/- 1.2e-01  |  5.89e+00 +/- 1.0e-01  |
 test_perturb_1                          |    -20.20 +/- 9.60     | -2.05e+00 +/- 9.75e-01 |  8.10e+00 +/- 7.0e-01  |  1.01e+01 +/- 6.8e-01  |
+test_perturb_2                          |    -12.48 +/- 4.06     | -2.14e+00 +/- 6.97e-01 |  1.50e+01 +/- 4.9e-01  |  1.72e+01 +/- 4.9e-01  |

github-actions[bot] avatar Nov 06 '23 05:11 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +1.81 +/- 2.26     | +4.15e-04 +/- 5.17e-04 |  2.33e-02 +/- 4.5e-04  |  2.29e-02 +/- 2.5e-04  |
 test_build_transform_fft_midres         |     -0.59 +/- 0.67     | -8.01e-04 +/- 9.12e-04 |  1.36e-01 +/- 7.1e-04  |  1.36e-01 +/- 5.8e-04  |
 test_build_transform_fft_highres        |     -1.44 +/- 0.84     | -9.09e-03 +/- 5.29e-03 |  6.20e-01 +/- 2.9e-03  |  6.29e-01 +/- 4.4e-03  |
 test_equilibrium_init_lowres            |     -0.54 +/- 1.79     | -5.41e-03 +/- 1.79e-02 |  9.96e-01 +/- 9.9e-03  |  1.00e+00 +/- 1.5e-02  |
 test_equilibrium_init_medres            |     -1.15 +/- 1.45     | -1.73e-02 +/- 2.19e-02 |  1.49e+00 +/- 1.4e-02  |  1.51e+00 +/- 1.7e-02  |
 test_equilibrium_init_highres           |     -1.69 +/- 1.04     | -6.17e-02 +/- 3.81e-02 |  3.60e+00 +/- 3.1e-02  |  3.66e+00 +/- 2.2e-02  |
 test_objective_compile_dshape_current   |     -2.17 +/- 5.47     | -1.39e-01 +/- 3.50e-01 |  6.26e+00 +/- 2.3e-01  |  6.40e+00 +/- 2.7e-01  |
 test_objective_compile_atf              |     +2.45 +/- 3.41     | +4.54e-01 +/- 6.30e-01 |  1.90e+01 +/- 4.6e-01  |  1.85e+01 +/- 4.3e-01  |
 test_objective_compute_dshape_current   |     -2.56 +/- 3.17     | -1.04e-04 +/- 1.29e-04 |  3.96e-03 +/- 1.0e-04  |  4.06e-03 +/- 7.6e-05  |
 test_objective_compute_atf              |     -3.28 +/- 2.90     | -4.50e-04 +/- 3.97e-04 |  1.32e-02 +/- 1.8e-04  |  1.37e-02 +/- 3.5e-04  |
 test_objective_jac_dshape_current       |     -4.15 +/- 7.89     | -7.11e-03 +/- 1.35e-02 |  1.64e-01 +/- 5.1e-03  |  1.71e-01 +/- 1.3e-02  |
 test_objective_jac_atf                  |     -0.27 +/- 2.29     | -2.19e-02 +/- 1.89e-01 |  8.23e+00 +/- 1.2e-01  |  8.25e+00 +/- 1.5e-01  |
 test_perturb_1                          |     -5.98 +/- 9.08     | -8.03e-01 +/- 1.22e+00 |  1.26e+01 +/- 9.2e-01  |  1.34e+01 +/- 8.0e-01  |
 test_perturb_2                          |     -0.98 +/- 7.58     | -2.20e-01 +/- 1.70e+00 |  2.22e+01 +/- 8.0e-01  |  2.24e+01 +/- 1.5e+00  |

github-actions[bot] avatar Nov 07 '23 00:11 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -2.22 +/- 2.62     | -3.54e-04 +/- 4.16e-04 |  1.56e-02 +/- 2.6e-04  |  1.59e-02 +/- 3.2e-04  |
 test_build_transform_fft_midres         |     -2.03 +/- 1.53     | -1.96e-03 +/- 1.47e-03 |  9.46e-02 +/- 1.3e-03  |  9.65e-02 +/- 6.5e-04  |
 test_build_transform_fft_highres        |     -1.23 +/- 1.77     | -5.77e-03 +/- 8.30e-03 |  4.64e-01 +/- 7.2e-03  |  4.70e-01 +/- 4.1e-03  |
 test_equilibrium_init_lowres            |     -5.34 +/- 2.71     | -3.61e-02 +/- 1.83e-02 |  6.39e-01 +/- 1.7e-02  |  6.75e-01 +/- 6.7e-03  |
 test_equilibrium_init_medres            |     -5.59 +/- 5.37     | -5.69e-02 +/- 5.47e-02 |  9.61e-01 +/- 4.9e-02  |  1.02e+00 +/- 2.4e-02  |
 test_equilibrium_init_highres           |     -1.49 +/- 2.05     | -3.81e-02 +/- 5.25e-02 |  2.52e+00 +/- 4.2e-02  |  2.55e+00 +/- 3.1e-02  |
 test_objective_compile_dshape_current   |     -4.63 +/- 8.28     | -1.96e-01 +/- 3.51e-01 |  4.04e+00 +/- 2.2e-01  |  4.24e+00 +/- 2.7e-01  |
 test_objective_compile_atf              |     +0.12 +/- 7.49     | +1.10e-02 +/- 6.83e-01 |  9.13e+00 +/- 3.3e-01  |  9.12e+00 +/- 6.0e-01  |
 test_objective_compute_dshape_current   |     +6.76 +/- 4.87     | +1.38e-04 +/- 9.94e-05 |  2.18e-03 +/- 3.5e-05  |  2.04e-03 +/- 9.3e-05  |
 test_objective_compute_atf              |     +3.05 +/- 6.82     | +2.26e-04 +/- 5.05e-04 |  7.63e-03 +/- 4.8e-05  |  7.41e-03 +/- 5.0e-04  |
 test_objective_jac_dshape_current       |     +6.58 +/- 7.96     | +2.80e-03 +/- 3.39e-03 |  4.54e-02 +/- 2.9e-03  |  4.26e-02 +/- 1.8e-03  |
 test_objective_jac_atf                  |     +1.41 +/- 7.28     | +3.18e-02 +/- 1.65e-01 |  2.29e+00 +/- 9.6e-02  |  2.26e+00 +/- 1.3e-01  |
 test_perturb_1                          |     +3.75 +/- 11.44    | +3.19e-01 +/- 9.73e-01 |  8.82e+00 +/- 7.0e-01  |  8.50e+00 +/- 6.8e-01  |
 test_perturb_2                          |     +4.13 +/- 3.75     | +5.85e-01 +/- 5.31e-01 |  1.48e+01 +/- 4.5e-01  |  1.42e+01 +/- 2.8e-01  |

github-actions[bot] avatar Nov 07 '23 15:11 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -1.36 +/- 1.94     | -3.05e-04 +/- 4.36e-04 |  2.22e-02 +/- 2.2e-04  |  2.25e-02 +/- 3.8e-04  |
 test_build_transform_fft_midres         |     +1.88 +/- 0.99     | +2.51e-03 +/- 1.31e-03 |  1.36e-01 +/- 9.8e-04  |  1.33e-01 +/- 8.8e-04  |
 test_build_transform_fft_highres        |     +0.70 +/- 0.73     | +4.35e-03 +/- 4.54e-03 |  6.22e-01 +/- 2.7e-03  |  6.18e-01 +/- 3.7e-03  |
 test_equilibrium_init_lowres            |     -1.24 +/- 1.51     | -1.24e-02 +/- 1.51e-02 |  9.88e-01 +/- 1.0e-02  |  1.00e+00 +/- 1.1e-02  |
 test_equilibrium_init_medres            |     -0.70 +/- 1.63     | -1.05e-02 +/- 2.44e-02 |  1.49e+00 +/- 1.9e-02  |  1.50e+00 +/- 1.6e-02  |
 test_equilibrium_init_highres           |     +0.44 +/- 0.77     | +1.58e-02 +/- 2.75e-02 |  3.59e+00 +/- 2.0e-02  |  3.58e+00 +/- 1.8e-02  |
 test_objective_compile_dshape_current   |     -1.41 +/- 5.34     | -8.89e-02 +/- 3.36e-01 |  6.20e+00 +/- 2.1e-01  |  6.29e+00 +/- 2.6e-01  |
 test_objective_compile_atf              |     +2.02 +/- 4.38     | +3.71e-01 +/- 8.04e-01 |  1.87e+01 +/- 5.0e-01  |  1.84e+01 +/- 6.3e-01  |
 test_objective_compute_dshape_current   |     +0.18 +/- 9.82     | +7.11e-06 +/- 3.87e-04 |  3.95e-03 +/- 3.4e-04  |  3.94e-03 +/- 1.9e-04  |
 test_objective_compute_atf              |     -2.34 +/- 1.44     | -3.15e-04 +/- 1.93e-04 |  1.31e-02 +/- 1.1e-04  |  1.34e-02 +/- 1.6e-04  |
 test_objective_jac_dshape_current       |     +2.67 +/- 11.25    | +4.39e-03 +/- 1.85e-02 |  1.69e-01 +/- 1.3e-02  |  1.64e-01 +/- 1.4e-02  |
 test_objective_jac_atf                  |     +0.62 +/- 3.59     | +5.07e-02 +/- 2.93e-01 |  8.22e+00 +/- 1.9e-01  |  8.17e+00 +/- 2.2e-01  |
 test_perturb_1                          |     -0.60 +/- 10.36    | -7.68e-02 +/- 1.34e+00 |  1.28e+01 +/- 1.0e+00  |  1.29e+01 +/- 8.4e-01  |
 test_perturb_2                          |     -1.75 +/- 4.05     | -3.95e-01 +/- 9.12e-01 |  2.21e+01 +/- 6.6e-01  |  2.25e+01 +/- 6.3e-01  |

github-actions[bot] avatar Nov 07 '23 20:11 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +0.10 +/- 1.35     | +1.91e-05 +/- 2.48e-04 |  1.84e-02 +/- 1.4e-04  |  1.83e-02 +/- 2.1e-04  |
 test_build_transform_fft_midres         |     +0.03 +/- 0.95     | +3.19e-05 +/- 1.07e-03 |  1.12e-01 +/- 7.5e-04  |  1.12e-01 +/- 7.5e-04  |
 test_build_transform_fft_highres        |     +0.97 +/- 0.56     | +5.09e-03 +/- 2.94e-03 |  5.31e-01 +/- 2.3e-03  |  5.26e-01 +/- 1.8e-03  |
 test_equilibrium_init_lowres            |     -0.21 +/- 0.96     | -1.62e-03 +/- 7.57e-03 |  7.83e-01 +/- 4.3e-03  |  7.85e-01 +/- 6.3e-03  |
 test_equilibrium_init_medres            |     +0.13 +/- 0.82     | +1.60e-03 +/- 9.75e-03 |  1.19e+00 +/- 7.4e-03  |  1.19e+00 +/- 6.3e-03  |
 test_equilibrium_init_highres           |     +0.72 +/- 0.92     | +2.16e-02 +/- 2.76e-02 |  3.00e+00 +/- 2.1e-02  |  2.98e+00 +/- 1.8e-02  |
 test_objective_compile_dshape_current   |     -0.33 +/- 5.36     | -1.68e-02 +/- 2.70e-01 |  5.02e+00 +/- 2.1e-01  |  5.04e+00 +/- 1.7e-01  |
 test_objective_compile_atf              |     +2.10 +/- 3.92     | +2.94e-01 +/- 5.50e-01 |  1.43e+01 +/- 4.2e-01  |  1.40e+01 +/- 3.5e-01  |
 test_objective_compute_dshape_current   |     -0.45 +/- 1.21     | -1.42e-05 +/- 3.80e-05 |  3.13e-03 +/- 2.4e-05  |  3.15e-03 +/- 2.9e-05  |
 test_objective_compute_atf              |     +1.88 +/- 1.43     | +2.04e-04 +/- 1.55e-04 |  1.10e-02 +/- 1.2e-04  |  1.08e-02 +/- 1.0e-04  |
 test_objective_jac_dshape_current       |     +0.15 +/- 6.97     | +1.98e-04 +/- 9.29e-03 |  1.33e-01 +/- 5.1e-03  |  1.33e-01 +/- 7.8e-03  |
 test_objective_jac_atf                  |     +3.08 +/- 3.25     | +1.84e-01 +/- 1.94e-01 |  6.13e+00 +/- 1.3e-01  |  5.95e+00 +/- 1.4e-01  |
 test_perturb_1                          |     -0.64 +/- 10.94    | -6.54e-02 +/- 1.12e+00 |  1.02e+01 +/- 7.9e-01  |  1.03e+01 +/- 8.0e-01  |
 test_perturb_2                          |     -0.13 +/- 4.41     | -2.32e-02 +/- 7.65e-01 |  1.73e+01 +/- 5.4e-01  |  1.73e+01 +/- 5.5e-01  |

github-actions[bot] avatar Nov 12 '23 22:11 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
-test_build_transform_fft_lowres         |    +23.49 +/- 1.18     | +2.92e-03 +/- 1.46e-04 |  1.53e-02 +/- 1.2e-04  |  1.24e-02 +/- 7.8e-05  |
-test_build_transform_fft_midres         |     +3.55 +/- 0.97     | +3.22e-03 +/- 8.83e-04 |  9.39e-02 +/- 5.4e-04  |  9.07e-02 +/- 7.0e-04  |
 test_build_transform_fft_highres        |     +1.93 +/- 0.88     | +8.83e-03 +/- 4.03e-03 |  4.67e-01 +/- 3.3e-03  |  4.58e-01 +/- 2.3e-03  |
+test_equilibrium_init_lowres            |    -17.75 +/- 1.05     | -1.40e-01 +/- 8.27e-03 |  6.49e-01 +/- 5.3e-03  |  7.89e-01 +/- 6.4e-03  |
+test_equilibrium_init_medres            |    -29.91 +/- 0.64     | -4.20e-01 +/- 8.95e-03 |  9.84e-01 +/- 5.4e-03  |  1.40e+00 +/- 7.1e-03  |
+test_equilibrium_init_highres           |    -38.97 +/- 0.72     | -1.62e+00 +/- 3.00e-02 |  2.54e+00 +/- 2.0e-02  |  4.16e+00 +/- 2.2e-02  |
 test_objective_compile_dshape_current   |     -0.79 +/- 7.19     | -3.24e-02 +/- 2.94e-01 |  4.06e+00 +/- 1.9e-01  |  4.09e+00 +/- 2.3e-01  |
 test_objective_compile_atf              |     +0.47 +/- 6.60     | +4.29e-02 +/- 6.02e-01 |  9.16e+00 +/- 3.8e-01  |  9.12e+00 +/- 4.7e-01  |
 test_objective_compute_dshape_current   |     -0.07 +/- 3.21     | -1.50e-06 +/- 7.04e-05 |  2.19e-03 +/- 5.6e-05  |  2.20e-03 +/- 4.3e-05  |
 test_objective_compute_atf              |     +1.91 +/- 1.75     | +1.44e-04 +/- 1.32e-04 |  7.68e-03 +/- 8.4e-05  |  7.54e-03 +/- 1.0e-04  |
 test_objective_jac_dshape_current       |     -3.27 +/- 8.49     | -1.51e-03 +/- 3.92e-03 |  4.46e-02 +/- 2.9e-03  |  4.61e-02 +/- 2.7e-03  |
 test_objective_jac_atf                  |     -4.50 +/- 6.16     | -1.01e-01 +/- 1.38e-01 |  2.14e+00 +/- 1.1e-01  |  2.24e+00 +/- 8.5e-02  |
 test_perturb_1                          |     -1.92 +/- 11.36    | -1.66e-01 +/- 9.85e-01 |  8.50e+00 +/- 6.4e-01  |  8.67e+00 +/- 7.5e-01  |
 test_perturb_2                          |     -0.56 +/- 3.69     | -8.10e-02 +/- 5.30e-01 |  1.43e+01 +/- 2.5e-01  |  1.43e+01 +/- 4.7e-01  |

github-actions[bot] avatar Nov 18 '23 19:11 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +2.17 +/- 2.56     | +2.68e-04 +/- 3.16e-04 |  1.26e-02 +/- 3.0e-04  |  1.24e-02 +/- 1.0e-04  |
 test_build_transform_fft_midres         |     +1.91 +/- 1.31     | +1.74e-03 +/- 1.20e-03 |  9.28e-02 +/- 8.0e-04  |  9.10e-02 +/- 8.9e-04  |
 test_build_transform_fft_highres        |     +0.16 +/- 0.87     | +7.42e-04 +/- 3.99e-03 |  4.61e-01 +/- 3.2e-03  |  4.61e-01 +/- 2.3e-03  |
 test_equilibrium_init_lowres            |     +2.99 +/- 1.45     | +2.36e-02 +/- 1.15e-02 |  8.14e-01 +/- 8.3e-03  |  7.90e-01 +/- 7.9e-03  |
 test_equilibrium_init_medres            |     +0.83 +/- 1.18     | +1.18e-02 +/- 1.67e-02 |  1.42e+00 +/- 1.3e-02  |  1.41e+00 +/- 1.1e-02  |
 test_equilibrium_init_highres           |     +0.07 +/- 0.77     | +2.93e-03 +/- 3.20e-02 |  4.18e+00 +/- 2.7e-02  |  4.18e+00 +/- 1.7e-02  |
 test_objective_compile_dshape_current   |     +1.88 +/- 8.64     | +7.78e-02 +/- 3.58e-01 |  4.22e+00 +/- 2.4e-01  |  4.14e+00 +/- 2.6e-01  |
 test_objective_compile_atf              |     +2.60 +/- 6.61     | +2.36e-01 +/- 6.00e-01 |  9.31e+00 +/- 5.1e-01  |  9.08e+00 +/- 3.2e-01  |
 test_objective_compute_dshape_current   |     -1.04 +/- 2.76     | -2.23e-05 +/- 5.90e-05 |  2.12e-03 +/- 4.2e-05  |  2.14e-03 +/- 4.2e-05  |
 test_objective_compute_atf              |     +5.35 +/- 2.38     | +4.02e-04 +/- 1.79e-04 |  7.92e-03 +/- 1.6e-04  |  7.52e-03 +/- 7.4e-05  |
 test_objective_jac_dshape_current       |     +2.84 +/- 9.33     | +1.26e-03 +/- 4.14e-03 |  4.57e-02 +/- 2.7e-03  |  4.44e-02 +/- 3.1e-03  |
 test_objective_jac_atf                  |     +2.17 +/- 5.30     | +4.80e-02 +/- 1.17e-01 |  2.26e+00 +/- 7.6e-02  |  2.21e+00 +/- 8.9e-02  |
 test_perturb_1                          |     -1.88 +/- 12.81    | -1.63e-01 +/- 1.11e+00 |  8.48e+00 +/- 7.1e-01  |  8.64e+00 +/- 8.5e-01  |
 test_perturb_2                          |     -2.09 +/- 4.54     | -3.06e-01 +/- 6.62e-01 |  1.43e+01 +/- 4.8e-01  |  1.46e+01 +/- 4.6e-01  |

github-actions[bot] avatar Dec 02 '23 01:12 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +0.23 +/- 1.48     | +2.83e-05 +/- 1.86e-04 |  1.26e-02 +/- 1.3e-04  |  1.26e-02 +/- 1.3e-04  |
 test_build_transform_fft_midres         |     -0.18 +/- 0.67     | -1.63e-04 +/- 6.21e-04 |  9.28e-02 +/- 4.3e-04  |  9.29e-02 +/- 4.5e-04  |
 test_build_transform_fft_highres        |     +1.02 +/- 0.74     | +4.76e-03 +/- 3.45e-03 |  4.70e-01 +/- 2.6e-03  |  4.65e-01 +/- 2.2e-03  |
 test_equilibrium_init_lowres            |     -0.16 +/- 1.17     | -1.33e-03 +/- 9.46e-03 |  8.09e-01 +/- 5.8e-03  |  8.10e-01 +/- 7.5e-03  |
 test_equilibrium_init_medres            |     -0.17 +/- 1.29     | -2.36e-03 +/- 1.85e-02 |  1.43e+00 +/- 1.3e-02  |  1.43e+00 +/- 1.3e-02  |
 test_equilibrium_init_highres           |     +0.27 +/- 0.76     | +1.16e-02 +/- 3.18e-02 |  4.22e+00 +/- 1.8e-02  |  4.21e+00 +/- 2.6e-02  |
 test_objective_compile_dshape_current   |     -0.85 +/- 7.74     | -3.60e-02 +/- 3.28e-01 |  4.20e+00 +/- 2.5e-01  |  4.24e+00 +/- 2.2e-01  |
 test_objective_compile_atf              |     +0.42 +/- 6.80     | +3.88e-02 +/- 6.30e-01 |  9.29e+00 +/- 3.5e-01  |  9.25e+00 +/- 5.3e-01  |
 test_objective_compute_dshape_current   |     +0.57 +/- 3.73     | +1.22e-05 +/- 7.96e-05 |  2.15e-03 +/- 3.9e-05  |  2.14e-03 +/- 7.0e-05  |
 test_objective_compute_atf              |     +1.88 +/- 2.08     | +1.40e-04 +/- 1.55e-04 |  7.59e-03 +/- 9.3e-05  |  7.45e-03 +/- 1.2e-04  |
 test_objective_jac_dshape_current       |     +1.11 +/- 5.80     | +5.02e-04 +/- 2.62e-03 |  4.57e-02 +/- 1.8e-03  |  4.52e-02 +/- 1.9e-03  |
 test_objective_jac_atf                  |     +4.06 +/- 5.09     | +9.19e-02 +/- 1.15e-01 |  2.35e+00 +/- 7.1e-02  |  2.26e+00 +/- 9.0e-02  |
 test_perturb_1                          |     -0.11 +/- 13.79    | -9.62e-03 +/- 1.18e+00 |  8.56e+00 +/- 8.0e-01  |  8.57e+00 +/- 8.7e-01  |
 test_perturb_2                          |     +0.34 +/- 4.79     | +5.00e-02 +/- 6.95e-01 |  1.46e+01 +/- 4.4e-01  |  1.45e+01 +/- 5.4e-01  |

github-actions[bot] avatar Dec 03 '23 04:12 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +0.98 +/- 2.39     | +1.23e-04 +/- 2.99e-04 |  1.26e-02 +/- 2.9e-04  |  1.25e-02 +/- 8.9e-05  |
 test_build_transform_fft_midres         |     +1.40 +/- 1.81     | +1.29e-03 +/- 1.67e-03 |  9.33e-02 +/- 1.4e-03  |  9.21e-02 +/- 9.4e-04  |
 test_build_transform_fft_highres        |     +0.57 +/- 1.11     | +2.62e-03 +/- 5.15e-03 |  4.65e-01 +/- 4.0e-03  |  4.62e-01 +/- 3.2e-03  |
 test_equilibrium_init_lowres            |     -0.93 +/- 1.21     | -7.35e-03 +/- 9.58e-03 |  7.87e-01 +/- 7.8e-03  |  7.94e-01 +/- 5.6e-03  |
 test_equilibrium_init_medres            |     +0.78 +/- 1.39     | +1.11e-02 +/- 1.97e-02 |  1.42e+00 +/- 1.7e-02  |  1.41e+00 +/- 1.0e-02  |
 test_equilibrium_init_highres           |     +0.54 +/- 0.75     | +2.27e-02 +/- 3.14e-02 |  4.20e+00 +/- 2.5e-02  |  4.18e+00 +/- 1.8e-02  |
 test_objective_compile_dshape_current   |     -0.02 +/- 7.89     | -8.96e-04 +/- 3.27e-01 |  4.15e+00 +/- 2.5e-01  |  4.15e+00 +/- 2.1e-01  |
 test_objective_compile_atf              |     -1.04 +/- 6.01     | -9.59e-02 +/- 5.55e-01 |  9.14e+00 +/- 3.8e-01  |  9.23e+00 +/- 4.1e-01  |
 test_objective_compute_dshape_current   |     +0.36 +/- 4.27     | +7.71e-06 +/- 9.09e-05 |  2.14e-03 +/- 7.0e-05  |  2.13e-03 +/- 5.8e-05  |
 test_objective_compute_atf              |     -1.63 +/- 1.98     | -1.23e-04 +/- 1.49e-04 |  7.41e-03 +/- 9.1e-05  |  7.53e-03 +/- 1.2e-04  |
 test_objective_jac_dshape_current       |     +3.31 +/- 9.69     | +1.49e-03 +/- 4.35e-03 |  4.64e-02 +/- 2.8e-03  |  4.49e-02 +/- 3.3e-03  |
 test_objective_jac_atf                  |     -4.66 +/- 4.32     | -1.07e-01 +/- 9.93e-02 |  2.19e+00 +/- 6.6e-02  |  2.30e+00 +/- 7.4e-02  |
 test_perturb_1                          |     -0.64 +/- 12.29    | -5.46e-02 +/- 1.04e+00 |  8.43e+00 +/- 7.4e-01  |  8.48e+00 +/- 7.3e-01  |
 test_perturb_2                          |     -0.10 +/- 3.70     | -1.43e-02 +/- 5.27e-01 |  1.42e+01 +/- 4.1e-01  |  1.42e+01 +/- 3.3e-01  |

github-actions[bot] avatar Dec 03 '23 10:12 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -1.46 +/- 1.51     | -1.82e-04 +/- 1.88e-04 |  1.23e-02 +/- 1.2e-04  |  1.25e-02 +/- 1.5e-04  |
 test_build_transform_fft_midres         |     +0.09 +/- 3.59     | +8.31e-05 +/- 3.24e-03 |  9.03e-02 +/- 3.2e-03  |  9.02e-02 +/- 5.1e-04  |
 test_build_transform_fft_highres        |     -0.07 +/- 0.80     | -3.12e-04 +/- 3.66e-03 |  4.57e-01 +/- 2.2e-03  |  4.57e-01 +/- 3.0e-03  |
 test_equilibrium_init_lowres            |     +0.38 +/- 0.84     | +2.98e-03 +/- 6.63e-03 |  7.94e-01 +/- 4.0e-03  |  7.91e-01 +/- 5.3e-03  |
 test_equilibrium_init_medres            |     -0.57 +/- 0.95     | -8.04e-03 +/- 1.34e-02 |  1.40e+00 +/- 9.7e-03  |  1.41e+00 +/- 9.2e-03  |
 test_equilibrium_init_highres           |     -0.19 +/- 0.66     | -7.91e-03 +/- 2.76e-02 |  4.15e+00 +/- 2.4e-02  |  4.16e+00 +/- 1.3e-02  |
 test_objective_compile_dshape_current   |     +0.65 +/- 9.00     | +2.68e-02 +/- 3.71e-01 |  4.15e+00 +/- 2.7e-01  |  4.12e+00 +/- 2.5e-01  |
 test_objective_compile_atf              |     +1.82 +/- 7.23     | +1.67e-01 +/- 6.64e-01 |  9.35e+00 +/- 4.7e-01  |  9.18e+00 +/- 4.7e-01  |
 test_objective_compute_dshape_current   |     +1.20 +/- 3.19     | +2.50e-05 +/- 6.66e-05 |  2.11e-03 +/- 5.1e-05  |  2.09e-03 +/- 4.3e-05  |
 test_objective_compute_atf              |     +0.51 +/- 2.43     | +3.91e-05 +/- 1.85e-04 |  7.66e-03 +/- 1.5e-04  |  7.62e-03 +/- 1.1e-04  |
 test_objective_jac_dshape_current       |     +2.16 +/- 12.52    | +1.01e-03 +/- 5.87e-03 |  4.79e-02 +/- 4.4e-03  |  4.69e-02 +/- 3.9e-03  |
 test_objective_jac_atf                  |     +2.45 +/- 4.49     | +5.83e-02 +/- 1.07e-01 |  2.44e+00 +/- 5.3e-02  |  2.38e+00 +/- 9.3e-02  |
 test_perturb_1                          |     +0.39 +/- 13.96    | +3.23e-02 +/- 1.17e+00 |  8.40e+00 +/- 8.0e-01  |  8.36e+00 +/- 8.5e-01  |
 test_perturb_2                          |     +0.65 +/- 4.84     | +9.23e-02 +/- 6.85e-01 |  1.42e+01 +/- 5.1e-01  |  1.41e+01 +/- 4.6e-01  |

github-actions[bot] avatar Dec 03 '23 21:12 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -1.07 +/- 1.79     | -1.35e-04 +/- 2.25e-04 |  1.24e-02 +/- 1.6e-04  |  1.26e-02 +/- 1.6e-04  |
 test_build_transform_fft_midres         |     +1.01 +/- 1.78     | +9.38e-04 +/- 1.66e-03 |  9.39e-02 +/- 1.1e-03  |  9.30e-02 +/- 1.2e-03  |
 test_build_transform_fft_highres        |     -0.31 +/- 1.15     | -1.45e-03 +/- 5.37e-03 |  4.63e-01 +/- 3.4e-03  |  4.65e-01 +/- 4.1e-03  |
 test_equilibrium_init_lowres            |     +0.46 +/- 1.95     | +3.72e-03 +/- 1.58e-02 |  8.13e-01 +/- 1.2e-02  |  8.09e-01 +/- 1.1e-02  |
 test_equilibrium_init_medres            |     +0.57 +/- 1.40     | +8.23e-03 +/- 2.02e-02 |  1.45e+00 +/- 1.3e-02  |  1.44e+00 +/- 1.5e-02  |
 test_equilibrium_init_highres           |     +0.30 +/- 1.04     | +1.27e-02 +/- 4.38e-02 |  4.24e+00 +/- 3.3e-02  |  4.22e+00 +/- 2.9e-02  |
 test_objective_compile_dshape_current   |     -2.79 +/- 9.18     | -1.20e-01 +/- 3.96e-01 |  4.19e+00 +/- 2.4e-01  |  4.32e+00 +/- 3.1e-01  |
 test_objective_compile_atf              |     -0.57 +/- 8.57     | -5.54e-02 +/- 8.27e-01 |  9.60e+00 +/- 5.2e-01  |  9.66e+00 +/- 6.5e-01  |
 test_objective_compute_dshape_current   |     -0.03 +/- 3.18     | -6.87e-07 +/- 6.73e-05 |  2.12e-03 +/- 3.4e-05  |  2.12e-03 +/- 5.8e-05  |
 test_objective_compute_atf              |     +0.98 +/- 4.10     | +7.41e-05 +/- 3.09e-04 |  7.62e-03 +/- 3.0e-04  |  7.55e-03 +/- 8.5e-05  |
 test_objective_jac_dshape_current       |     +1.94 +/- 12.28    | +9.00e-04 +/- 5.69e-03 |  4.72e-02 +/- 3.3e-03  |  4.63e-02 +/- 4.6e-03  |
 test_objective_jac_atf                  |     -0.12 +/- 10.85    | -2.87e-03 +/- 2.62e-01 |  2.41e+00 +/- 1.1e-01  |  2.42e+00 +/- 2.4e-01  |
 test_perturb_1                          |     +0.51 +/- 15.09    | +4.41e-02 +/- 1.31e+00 |  8.69e+00 +/- 9.4e-01  |  8.65e+00 +/- 9.0e-01  |
 test_perturb_2                          |     +1.16 +/- 5.13     | +1.70e-01 +/- 7.52e-01 |  1.48e+01 +/- 6.9e-01  |  1.47e+01 +/- 3.1e-01  |

github-actions[bot] avatar Dec 04 '23 12:12 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     +0.79 +/- 0.98     | +9.74e-05 +/- 1.21e-04 |  1.24e-02 +/- 8.8e-05  |  1.23e-02 +/- 8.4e-05  |
 test_build_transform_fft_midres         |     +1.36 +/- 1.10     | +1.23e-03 +/- 9.99e-04 |  9.17e-02 +/- 7.9e-04  |  9.05e-02 +/- 6.2e-04  |
 test_build_transform_fft_highres        |     +1.13 +/- 1.23     | +5.22e-03 +/- 5.66e-03 |  4.66e-01 +/- 4.7e-03  |  4.61e-01 +/- 3.2e-03  |
 test_equilibrium_init_lowres            |     +1.17 +/- 2.01     | +9.13e-03 +/- 1.57e-02 |  7.90e-01 +/- 1.4e-02  |  7.81e-01 +/- 6.9e-03  |
 test_equilibrium_init_medres            |     +0.40 +/- 0.87     | +5.64e-03 +/- 1.21e-02 |  1.40e+00 +/- 8.9e-03  |  1.40e+00 +/- 8.2e-03  |
 test_equilibrium_init_highres           |     +0.26 +/- 1.06     | +1.09e-02 +/- 4.40e-02 |  4.18e+00 +/- 2.6e-02  |  4.16e+00 +/- 3.6e-02  |
 test_objective_compile_dshape_current   |     -0.32 +/- 7.55     | -1.32e-02 +/- 3.10e-01 |  4.09e+00 +/- 2.2e-01  |  4.11e+00 +/- 2.2e-01  |
 test_objective_compile_atf              |     +0.46 +/- 7.21     | +4.13e-02 +/- 6.50e-01 |  9.06e+00 +/- 4.8e-01  |  9.02e+00 +/- 4.4e-01  |
 test_objective_compute_dshape_current   |     +1.28 +/- 1.79     | +2.68e-05 +/- 3.76e-05 |  2.12e-03 +/- 3.2e-05  |  2.09e-03 +/- 1.9e-05  |
 test_objective_compute_atf              |     -0.12 +/- 1.40     | -8.75e-06 +/- 1.05e-04 |  7.50e-03 +/- 3.7e-05  |  7.51e-03 +/- 9.9e-05  |
 test_objective_jac_dshape_current       |     +0.45 +/- 8.45     | +2.01e-04 +/- 3.81e-03 |  4.53e-02 +/- 3.4e-03  |  4.51e-02 +/- 1.6e-03  |
 test_objective_jac_atf                  |     -1.89 +/- 7.60     | -4.42e-02 +/- 1.77e-01 |  2.29e+00 +/- 1.3e-01  |  2.33e+00 +/- 1.2e-01  |
 test_perturb_1                          |     +0.67 +/- 12.67    | +5.60e-02 +/- 1.06e+00 |  8.45e+00 +/- 7.3e-01  |  8.39e+00 +/- 7.8e-01  |
 test_perturb_2                          |     +0.53 +/- 4.78     | +7.45e-02 +/- 6.70e-01 |  1.41e+01 +/- 4.2e-01  |  1.40e+01 +/- 5.2e-01  |

github-actions[bot] avatar Dec 05 '23 10:12 github-actions[bot]

|             benchmark_name             |         dt(%)          |         dt(s)          |        t_new(s)        |        t_old(s)        | 
| -------------------------------------- | ---------------------- | ---------------------- | ---------------------- | ---------------------- |
 test_build_transform_fft_lowres         |     -0.43 +/- 1.43     | -5.45e-05 +/- 1.80e-04 |  1.25e-02 +/- 1.1e-04  |  1.25e-02 +/- 1.4e-04  |
 test_build_transform_fft_midres         |     -0.29 +/- 1.07     | -2.63e-04 +/- 9.82e-04 |  9.18e-02 +/- 8.2e-04  |  9.21e-02 +/- 5.5e-04  |
 test_build_transform_fft_highres        |     -0.94 +/- 0.76     | -4.34e-03 +/- 3.54e-03 |  4.59e-01 +/- 2.9e-03  |  4.63e-01 +/- 2.0e-03  |
 test_equilibrium_init_lowres            |     +0.22 +/- 1.16     | +1.80e-03 +/- 9.35e-03 |  8.06e-01 +/- 6.7e-03  |  8.04e-01 +/- 6.5e-03  |
 test_equilibrium_init_medres            |     -0.91 +/- 0.91     | -1.29e-02 +/- 1.29e-02 |  1.41e+00 +/- 8.4e-03  |  1.42e+00 +/- 9.8e-03  |
 test_equilibrium_init_highres           |     -0.52 +/- 0.78     | -2.18e-02 +/- 3.27e-02 |  4.17e+00 +/- 2.4e-02  |  4.19e+00 +/- 2.3e-02  |
 test_objective_compile_dshape_current   |     -5.17 +/- 8.46     | -2.26e-01 +/- 3.70e-01 |  4.14e+00 +/- 2.4e-01  |  4.37e+00 +/- 2.8e-01  |
 test_objective_compile_atf              |     +0.01 +/- 7.18     | +4.91e-04 +/- 6.64e-01 |  9.24e+00 +/- 5.7e-01  |  9.24e+00 +/- 3.5e-01  |
 test_objective_compute_dshape_current   |     -0.07 +/- 2.49     | -1.51e-06 +/- 5.34e-05 |  2.14e-03 +/- 4.8e-05  |  2.14e-03 +/- 2.3e-05  |
 test_objective_compute_atf              |     -3.29 +/- 1.21     | -2.55e-04 +/- 9.37e-05 |  7.51e-03 +/- 4.2e-05  |  7.76e-03 +/- 8.4e-05  |
 test_objective_jac_dshape_current       |     -0.77 +/- 10.29    | -3.60e-04 +/- 4.79e-03 |  4.62e-02 +/- 3.0e-03  |  4.66e-02 +/- 3.7e-03  |
 test_objective_jac_atf                  |     +3.02 +/- 6.79     | +6.56e-02 +/- 1.47e-01 |  2.24e+00 +/- 1.0e-01  |  2.17e+00 +/- 1.1e-01  |
 test_perturb_1                          |     -2.94 +/- 13.54    | -2.54e-01 +/- 1.17e+00 |  8.40e+00 +/- 7.7e-01  |  8.65e+00 +/- 8.8e-01  |
 test_perturb_2                          |     -3.37 +/- 4.61     | -4.95e-01 +/- 6.76e-01 |  1.42e+01 +/- 4.7e-01  |  1.47e+01 +/- 4.9e-01  |

github-actions[bot] avatar Dec 07 '23 11:12 github-actions[bot]