extensions icon indicating copy to clipboard operation
extensions copied to clipboard

[firestore-bigquery-export] Support partitioned table base on Timestamp field

Open alfred-risb opened this issue 4 years ago • 3 comments

Firestore have extension to export data into bigquery, the table is partitioned base on when the record success push to server (_partitiontime).

My project require to partition table base on specific field (Timestamp or int type) in document, it will be amazing if such feature available in "export to Bigquery" extension

alfred-risb avatar Oct 12 '21 08:10 alfred-risb

Thanks @alfred-risb.

This should be something that can be added. Moved to under-consideration.

dackers86 avatar Oct 12 '21 16:10 dackers86

@i14h Can we also add support for the partition value to be derived from a ISO8601 datetime string and make the field a configurable parameter in the extension setup?

jasonberryman avatar Dec 22 '21 16:12 jasonberryman

another vote for ISO8601 formatted strings, if possible.

darnmason avatar May 13 '22 01:05 darnmason

For the issue of partitioning based on the timestamp, this should be currently working as expected.

The issue can re-opened if it is still as an issue.

For the ISO8601 formatted strings please track https://github.com/firebase/extensions/issues/1483

dackers86 avatar Mar 01 '23 13:03 dackers86