elementary icon indicating copy to clipboard operation
elementary copied to clipboard

Mysql support

Open lukmat86 opened this issue 1 year ago • 3 comments

Hi

Is MySQL supported?

I was trying instruction from quick start section https://docs.elementary-data.com/oss/quickstart/quickstart-cli-package I couldn't find anything related to MySQL in documentation.

I'm working with MySQL 8.0.35

When I'm running dbt run --select elementary I got errors:

08:08:37    Database Error in model data_monitoring_metrics (models/edr/data_monitoring/data_monitoring/data_monitoring_metrics.sql)
  1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'varchar(4096)) as id
  
  ,
                  
          cast('dummy_string' as varchar(' at line 25
  compiled Code at target/run/elementary/models/edr/data_monitoring/data_monitoring/data_monitoring_metrics.sql
08:08:37  
08:08:37    Database Error in model dbt_columns (models/edr/dbt_artifacts/dbt_columns.sql)
  1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'varchar(4096)) as unique_id
  
  ,
```<!-- pylon-ticket-id: d28fe394-227f-471d-ab2a-f5e34054b32d -->

lukmat86 avatar Jul 30 '24 08:07 lukmat86

Hi @lukmat86 , MySQL is currently not supported

ellakz avatar Jul 30 '24 08:07 ellakz

@ellakz As a point of clarity - is it possible to configure Elementary to use Redshift or BigQuery for its tables/data and continue using MySQL as the dataware house that DBT is transforming data within?

drafie avatar Sep 18 '24 04:09 drafie

Hey @drafie , as elementary is a dbt package, it is limited by the fact that dbt itself does not support connecting to multiple warehouses in the same run, so that is not possible sadly

ofek1weiss avatar Sep 23 '24 12:09 ofek1weiss