databricks-sql-go icon indicating copy to clipboard operation
databricks-sql-go copied to clipboard
verified publisher icon databricks

Allow users to modify ArrowConfig when creating databricks connector

Open Arpitpandey992 opened this issue 9 months ago • 1 comments

Currently, it seems impossible to modify ArrowConfig, specifically UseArrowNativeDecimal because this configuration is not exposed to users. This causes DECIMAL column data to be always read as String instead of casting to arrowType.decimal128 or something equivalent. Is there any workaround for setting this property while creating the connection?

Arpitpandey992 avatar Jun 04 '25 09:06 Arpitpandey992

I am also facing the same issue, databricks decimal type is getting converted to string which is affecting all of my downstream operations.

nikhilmehta16 avatar Jun 18 '25 10:06 nikhilmehta16