Takuya UESHIN comments

Results 51 comments of


                                            Takuya UESHIN

to_parquet() generating a big number of files

Glad to hear it worked fine. Also thanks for the suggestion! Do you want to submit a PR to support it? I guess we should add it to `to_orc` as...

Setup integration tests on GitHub Actions.

I'll also update this once #58 is merged.

Persist docs fails if Delta Column Mapping is enabled and column name contains spaces

You need to define the schema with `quote: true` to use special characters in column names: - schema.yml ```yml version: 2 models: - name: customers columns: - name: 'first name'...

Can't generate dbt docs

@mcfuhrt Could you also try with dbt-databricks 1.0.1? @jtcohen6 Could you help to take a look at this? Seems like the error came from dbt-spark or dbt-core.

Feature/python model beta

This is now based on #148. Please take a look at it first.

> it seems that python model cann't work with `view` materialization Yes, so far it's a limitation of python model. https://docs.getdbt.com/docs/building-a-dbt-project/building-models/python-models#materializations

Feature/python model beta

Thanks! merging.

Cannot run dbt docs generate with JSON logs

@jtcohen6 Could you help take a look at this issue? Seems like `SparkRelation` or even `BaseRelation` are not serializable. ```py >>> json.dumps(SparkRelation.create(schema='a', identifier='b')) ... TypeError: Object of type SparkRelation is...

Cannot run dbt docs generate with JSON logs

Seems like it tries to show more logs in `1.1` than `1.0`, that is breaking the command.

Can't get Python models running on `1.3.0b0`

Right, so far Python model only works on all-purpose clusters. The discussion to provide a way to have a separate config to run on the all-purpose clusters even when the...