cccs-jc

date object not supported (not JSON serializable)

3

**Describe the bug** ipydatagrid does not support date object **To Reproduce** ``` import pandas as pd import numpy as np import datetime from ipydatagrid import DataGrid df = pd.DataFrame({ 'Date':...

[SIP-77] Proposal for Links

2

## [SIP-77] Proposal for Links ### Motivation Links, enable users to easily navigate to related content directly from Superset. This content can be an Explore, a Chart, a Dashboard or...

currently caching of the dataframe created by sparksql magic uses df.cache() This api does not let us name the cached data. Using the SQL version of this api it is...

spark-utils has table maintenance macros for DeltaLake tables. For example these macros list the tables in a schema and perform vacuum. https://github.com/dbt-labs/spark-utils/blob/b41aab4e63acb205d11bf80e2a7bbe0dd63a3c6f/macros/maintenance_operation.sql In the same manner, it would be great...

Iceberg Spark streaming skips rows of data

6

### Apache Iceberg version 1.5.0 (latest release) ### Query engine Spark ### Please describe the bug 🐞 When using spark readStream the option `stream-from-timestamp` is used to position the read...

zorder does not work with sub fields

3

### Apache Iceberg version 1.4.2 ### Query engine Spark ### Please describe the bug 🐞 The `rewrite_data_files` with zorder does not work on sub-fields. ```sql CALL users.system.rewrite_data_files( table => 'users.jcc.flow',...

location parameter of remove_orphan_files procedure relative to table location

2

### Feature Request / Improvement I'm writing to an Iceberg table using spark structured streaming. I chose to put my checkpoint dir inside my target table /iceberg/my_schema/data /iceberg/my_schema/metadata /iceberg/my_schema/checkpoint When...

DBT Power User Replaces the PYTHONPATH environment variable when calling the node_python_bridge.py

2

### Describe the feature We install pyspark using the manual download as specified here https://spark.apache.org/docs/latest/api/python/getting_started/install.html#manually-downloading In a nutshell pyspark is distributed with the spark tarbal and you point the PYTHONPATH...

I'm interested in the frequent items (heavy hitters) sketch. I would like to build such a sketch on say a month of data. I would then use this sketch on...