transformer-physx icon indicating copy to clipboard operation
transformer-physx copied to clipboard

Relative MSE

Open gduthe opened this issue 6 months ago • 0 comments

Hi @NickGeneva! Thanks for the nice work!

I'm working on re-implementing the relative mean-squared error (MSE) metric as described in your paper. However, I'm having difficulty finding a clear, universally accepted definition of relative MSE in this context. Could you please provide the exact formula you used to calculate these values?

Specifically, is the relative MSE calculated as:

  • MSE(y_pred, y_true) / MSE of y_true against a baseline (like mean pred, last pred or zeros)
  • MSE(y_pred, y_true) / Variance(y_true)
  • MSE(y_pred, y_true) / ||y_true||₂
  • ||y_true - y_pred||₂ / ||y_true||₂
  • Something else?

Thanks!

gduthe avatar Aug 20 '24 20:08 gduthe