pints icon indicating copy to clipboard operation
pints copied to clipboard

Create a functional testing module with tests for all methods

Open DavAug opened this issue 4 years ago • 5 comments

The module will contain the functional tests in pints, e.g. one file for each sampler and each optimiser. We start with the HarrioBardenerACMC.

DavAug avatar Feb 16 '21 10:02 DavAug

A class should contain a method that returns the results in dict format. Until the new diagnostics module is implemented, we could start with

  • Gaussian shape kld
  • mean ESS

DavAug avatar Feb 16 '21 10:02 DavAug

@MichaelClerx @ben18785 does this look about right? https://github.com/pints-team/pints/commit/122590599936a2325fafedd09b46639c6e4240e8

fcooper8472 avatar Mar 16 '21 10:03 fcooper8472

It does! Thanks Ferguz

On Tue, Mar 16, 2021 at 10:11 AM Fergus Cooper @.***> wrote:

@MichaelClerx https://github.com/MichaelClerx @ben18785 https://github.com/ben18785 does this look about right? 1225905 https://github.com/pints-team/pints/commit/122590599936a2325fafedd09b46639c6e4240e8

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/pints-team/pints/issues/1294#issuecomment-800127872, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABCILKCBMG3YXJTKKKXKEBLTD4VEHANCNFSM4XWFMMGQ .

ben18785 avatar Mar 16 '21 10:03 ben18785

Perfect! I'm thinking method_hyper_parameters could eventually be a dict rather than an array, but that's a separate issue

MichaelClerx avatar Mar 16 '21 10:03 MichaelClerx

Related, for optimisers:

  • https://www.sciencedirect.com/science/article/abs/pii/S156849462030675X
  • https://numbbo.github.io/coco/

MichaelClerx avatar Jun 08 '22 10:06 MichaelClerx