ben18785

As part of this, I'm thinking that people need to specify hyperparameters for their method (in a file on PINTS somewhere) that are hand-picked for each of the problems we...

We're thinking it should have: - optimal hyperparameters for each functional test - average (I think mean) score across each of the functional tests

Sounds good. One thing I wonder is whether these sorts of diagnostics might actually be best handled by using an existing package. Ths Arviz package is quite well established and...

Yeah might be easier. Shall we discuss on Tuesday? On Sun, Jan 31, 2021 at 3:04 PM David Augustin wrote: > Ahh cool stuff! In that case, we might as...

@MichaelClerx would you be able to take a look here if you get a moment?

Thanks! @martinjrobins -- if you had a spare few mins, it would be good to see what you thought about this.

Ok but can we point to an example of this within PINTS? I agree solving ODEs is outside of scope but given that increasing numbers of people solve ODEs within...

Hmm. Well, as it stands the diagnostics are only for MCMC methods but, in the future, I'd envision having other diagnostics in there. But they could always be housed in...

Haha. Not point 4?

Yep, that's fine with me. Shall we amend the current PINTS project then?