velox icon indicating copy to clipboard operation
velox copied to clipboard

Make dwio::common::WriterOptions polymorphic

Open pedroerp opened this issue 8 months ago • 2 comments

Summary: Making writer options a virtual class that could be specialized for different file formats to enable Velox users to provided them as part of a query plan.

Today, there are a few different ways to pass writer parameters (serdeParams and hive config). They end up being serialized to strings, so can't be used with non-serializable configs. Moreover, file format specific configurations and code end-up in generic parts of the code, like HiveConnector.

This will allow us to better organize file format specific options; for now only creating the framework to contain the changes.

Differential Revision: D59302873

pedroerp avatar Jul 02 '24 23:07 pedroerp