DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard
verified publisher icon GoogleCloudPlatform

Mongo to BQ - advanced filters

Open stankiewicz opened this issue 1 year ago • 0 comments

Mongo to BQ has poor support for filters - they are on dataflow side with help of UDFs. This makes it expensive to run for Mongo Database and is expensive to filter on dataflow side.

BSON filters are pushed to MongoDB which allows easy filtering, especially for daily ETLs.

stankiewicz avatar Jun 27 '24 08:06 stankiewicz