phoenix
phoenix copied to clipboard
Timestamp normalization - time can be parsed incorrectly if formatted as an `int`
Cases where we hit problems:
Time is stored as milliseconds
and we (currently) parse it as seconds
. This is not clear (no documentation)
Proposed solutions
Solution 1
Sample a few rows and determine if the units are ms
or seconds
pseudo-code
if 1970EpochMs < timestamp < 1970EpochS
units = "ms"
else
units = "s"