pints icon indicating copy to clipboard operation
pints copied to clipboard

Create a functional testing module with tests for all methods

Open DavAug opened this issue 4 years ago • 5 comments
trafficstars

The module will contain the functional tests in pints, e.g. one file for each sampler and each optimiser. We start with the HarrioBardenerACMC.

DavAug avatar Feb 16 '21 10:02 DavAug

A class should contain a method that returns the results in dict format. Until the new diagnostics module is implemented, we could start with

  • Gaussian shape kld
  • mean ESS

DavAug avatar Feb 16 '21 10:02 DavAug

@MichaelClerx @ben18785 does this look about right? https://github.com/pints-team/pints/commit/122590599936a2325fafedd09b46639c6e4240e8

fcooper8472 avatar Mar 16 '21 10:03 fcooper8472

It does! Thanks Ferguz

On Tue, Mar 16, 2021 at 10:11 AM Fergus Cooper @.***> wrote:

@MichaelClerx https://github.com/MichaelClerx @ben18785 https://github.com/ben18785 does this look about right? 1225905 https://github.com/pints-team/pints/commit/122590599936a2325fafedd09b46639c6e4240e8

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/pints-team/pints/issues/1294#issuecomment-800127872, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABCILKCBMG3YXJTKKKXKEBLTD4VEHANCNFSM4XWFMMGQ .

ben18785 avatar Mar 16 '21 10:03 ben18785

Perfect! I'm thinking method_hyper_parameters could eventually be a dict rather than an array, but that's a separate issue

MichaelClerx avatar Mar 16 '21 10:03 MichaelClerx

Related, for optimisers:

  • https://www.sciencedirect.com/science/article/abs/pii/S156849462030675X
  • https://numbbo.github.io/coco/

MichaelClerx avatar Jun 08 '22 10:06 MichaelClerx