Zach

Results 62 issues of Zach

**Is your feature request related to a problem? Please describe.** SDLB creates stable and maintainable production data pipelines. But development in Notebook is not supported very well yet. Its possible...

enhancement

**Is your feature request related to a problem? Please describe.** Snowflake tables dont support partitioning as DeltaLakeTableDataObject or IcebergTableDataObject. There are other DataObject with this limitation like JdbcTableDataObject. There we...

enhancement

**Is your feature request related to a problem? Please describe.** Currently when writing to a DataObject it might collect metrics saying that there was no data to process. This is...

enhancement

**Is your feature request related to a problem? Please describe.** Sometimes it would be interesting to access partition values, metrics and options of actions in subsequent actions of a DAG...

enhancement

**Is your feature request related to a problem? Please describe.** To synchronize database tables incrementally to an analytics platform, we can use DataFrameIncrementalMode, which needs a strictly increasing column as...

enhancement

**Is your feature request related to a problem? Please describe.** Many Database Systems (incl. Snowflake and recently also Databricks) support creating views and materialized views for transforming data and serving...

enhancement

**Is your feature request related to a problem? Please describe.** When Actions fail, it is sometimes helpful to know the number of records read from every input DataObject. **Describe the...

enhancement

**Describe the bug** With Iceberg 1.4 a merge statement with previous schema change / or included schema evolution fails with the following error message: ``` [UNRESOLVED_COLUMN.WITH_SUGGESTION] A column or function...

bug

**Is your feature request related to a problem? Please describe.** When upgrading Spark minor versions we often face 1) connectors not yet supporting the new version (delta, iceberg, snowflake) 2)...

enhancement
discussion