Issues with rounding and numbers less than 0.0005

[awsharif]

trafficstars

Hi thanks for the development of numerals.

I just want to flag an issue - it appears you are unable to get accuracy more than 3 decimal places. This does not impact calculations but when the result is less than 0.0005 it will render as 0. Additionally round() function did not seem to help. Rounding greater than 3 decimal places does not register. Is this a known bug? Screenshot below. Issue persists across math, math-tex and math-plain.

Thanks!

[publicvirtualvoid]

Having the same problem, is there any way to address this?

[gtg922r]

@publicvirtualvoid can you provide some example math blocks where you were seeing this to help me debug

[over2sd]

I'm experiencing the same problem. See the lines where m,p,d, and e are defined for the start of the problem, and lines for k and l for the resulting 0 delta.

[gtg922r]

I believe this is a result of using default System Formatting. If you change the "Rendered Number Format" option you can force it to show results in engineering or scientific notation:

Does this solve your need? Is there a different solution you want to see?

[over2sd]

No. I tried each of the format options. None of them result in anything over three digits of precision.