json2parquet icon indicating copy to clipboard operation
json2parquet copied to clipboard

Conversion of timestamp from epoch format to datetime

Open gautamvij opened this issue 5 years ago • 1 comments

Requirement

Support to read data from nginx logs which has timestamp in format 1564388230.097.

Approach

We can include unit param to read epoch time here as defined here

Can you help me with any other approach if this is not suitable ? or else will give the PR.

gautamvij avatar Aug 02 '19 11:08 gautamvij

Sounds great, I think it would be reasonable add a date_unit kwarg. Should we use it only if date_format is empty? Or are there occasions where pd.to_datetime would want unit and format?

andrewgross avatar Aug 13 '19 01:08 andrewgross