dbt-fal icon indicating copy to clipboard operation
dbt-fal copied to clipboard

Support trino in dbt-fal

Open turbo1912 opened this issue 2 years ago • 4 comments

Context As a dbt-fal user, I would like to be able to run python models with fal while using the trino db

Describe the solution you'd like This is already supported with fal CLI, so a similar approach would be suitable.

https://github.com/fal-ai/fal/commit/d08d2242732a3000f8b4b18c7643f58884a0acea

Is there an existing feature request for this?

  • [ x] I have searched the existing issues

turbo1912 avatar Nov 14 '22 19:11 turbo1912

Please do add support for trino db in dbt-fal.

curiosityCursed avatar Dec 23 '22 05:12 curiosityCursed

Hey there @curiosityCursed! You can make dbt-fal work with trino if you install the dbt-trino adapter from their github repo: pip install git+https://github.com/starburstdata/dbt-trino dbt-fal[trino]. Here's what an example profiles.yml should look like:

fal_test:
  target: staging
  outputs:
    staging:
      type: fal
      db_profile: db
    db:
      type: trino
      user: user
      host: localhost
      port: 8080
      database: postgresql
      schema: dbt_fal
      threads: 8
      http_scheme: http
      session_properties:
        query_max_run_time: 5d
        exchange_compression: True

Let us know if you run into any issues!

As soon as a new version of dbt-trino is released, dbt-fal with work with PyPI version of dbt-trino.

mederka avatar Dec 23 '22 10:12 mederka

dbt-trino 1.3.2 has been just released.

hovaesco avatar Dec 23 '22 16:12 hovaesco

Awesome, @hovaesco! We will update our dependencies.

mederka avatar Dec 23 '22 17:12 mederka