sqlmesh
sqlmesh copied to clipboard
TobikoData
Efficient data transformation and modeling framework that is backwards compatible with dbt.
Sometimes a directly modified model may be associated with 100s indirectly modified downstream models. When this happens the output becomes cumbersome and overwhelming to a user. We need to revisit...
Currently SQLMesh always sets the `type` value to None when creating a relation instance returned by the `adapter.get_relation` and similar methods.
Support for AWS Athena as adapter. Happy to propose a PR - given some guidelines.
Conceptually the goal is to allow users to defined Python, Scala, or Java UDFs and SQLMesh would take care of making sure those functions are compiled and defined on the...
Some console log messages appear on the CLI but aren't making it through to the notebook output. - ["All model batches have been executed successfully"](https://github.com/TobikoData/sqlmesh/blob/409e0dea31406e3d08cb880c99e75c225bd127ad/sqlmesh/core/console.py#L195) - ["The target environment has...
If a model has data loaded in it that is less than the model start date then we get an error like this: ``` ValueError: `end` (2023-10-04 00:00:00+00:00) must be...
Currently if a snapshot is unpaused (applied to prod) then existing environments will continue to point to the temp table despite the fact that the change is now live in...
With `dbt` it is possible to run pyspark jobs using Google Dataproc, both in "cluster" and "serverless" mode (see the "BigQuery" section in https://docs.getdbt.com/docs/build/python-models#specific-data-platforms). Is this something that is supported...
`sqlmesh run` is executing an environment from the state db and doesn't need the local models loaded. By removing the dependency, remote CI setups can run omit steps like `dbt...
if `config` or in case `sushi example` -> `helper.py` is broken it prevents from loading files and that is making it impossible to fix the `config` file from UI 
Metadata
Owner
Metadata
Efficient data transformation and modeling framework that is backwards compatible with dbt.