run_query doesn't support array inside named_struct

[ashwintastic]

trafficstars

Describe the bug

A clear and concise description of what the bug is. What command did you run? What happened? Array inside struct not working throught DBT

Steps To Reproduce

In as much detail as possible, please provide steps to reproduce the issue. Sample data that triggers the issue, example model code, etc is all very helpful here.

This query works fine when in directly run it into databricks but not from dbt macro run_query

select col1, col2, col3, named_struct( 'K1',col3, 'K2', col2 ) map from table --col2 is an Array , col3 is string

It throws this error Object of type ndarray is not JSON serializable> in macro run_query (macros\etc\statement.sql)

Expected behavior

A clear and concise description of what you expected to happen.

If this query runs well in databricks why it is not working throught DBT

Screenshots and log output

If applicable, add screenshots or log output to help explain your problem.

System information

The output of dbt --version:

Core:
  - installed: 1.6.6

  The latest version of dbt-core could not be determined!
  Make sure that the following URL is accessible:
  https://pypi.org/pypi/dbt-core/json

Plugins:
  - databricks: 1.6.6 - Update available!
  - spark:      1.6.1 - Update available!

The operating system you're using:

Windows 11

The output of python --version: Python 3.10.6

Additional context

Add any other context about the problem here.

I downgraded from 1.7 to 1.6 because slowness issue in 1.7