statix icon indicating copy to clipboard operation
statix copied to clipboard

Sample rates precision problem

Open shouya opened this issue 5 years ago • 0 comments

Hi I found this issue where having a sample rate of 0.001 will turns out equivalent to sending sample rate as 0.0. It was caused by the following segment of code:

https://github.com/lexmag/statix/blob/00c9d690f41847cab8ad5e70f28e501f98035797/lib/statix/packet.ex#L53

There is no way to circumvent this limit from the user side. Should we perhaps raise the number of digits preserved?

shouya avatar May 27 '20 11:05 shouya