ckayay

Delta lakes in Azure containers configured with SoftDelete is not supported

1

For delta lake tables stored in azure blob configured with "Soft Delete" enabled, the delta sharing server is giving error as shown below. We need this setting enabled for the...

Data API adaptor

1

Especially, to serve the data as a performant API with the ability to query the data efficiently is quite a use-case and everyone has to develop their own solutions around...

Performance improvement

1

Currently 200 K rows, 100 columns can be fully loaded in 20-40 minutes using load_as_pandas python package. Besides, Filtering is not working properly (predicate hints, etc) with this option. Improving...

Data sharing based on data access policies (Ranger, etc)

4

Ability to configure data sharing based on policies rather than Delta Sharing based configuration would be helpful.

Connection broken: Incomplete Read error for large datasets

2

If the data volumes grow, the load_as_pandas gives the following error:  client = delta_sharing.SharingClient(path) df = delta_sharing.load_as_pandas(table_url) The delta lake data volumes: - 175 columns - 330 K rows

Load_as_Pandas gives defragmented frame as warning

3

2022-03-28T10:28:56 Welcome, you are now connected to log-streaming service.Starting Log Tail -n 10 of existing logs ----/appsvctmp/volatile/logs/runtime/f63aaea16e4517972f71ef9508dc154bdf3b8368adf4071191264aa28859fc79.log 2022-03-28T10:28:54.930985032Z: [INFO] } 2022-03-28T10:28:54.930990432Z: [INFO] } 2022-03-28T10:28:56.077294348Z: [INFO] warn: Host.Function.Console[0] 2022-03-28T10:28:56.077456950Z: [INFO] /home/site/wwwroot/.python_packages/lib/site-packages/delta_sharing/reader.py:125:...

Presto connector

1

If the are several data sources in the organization (such as SQL Server, DWH, etc), the data needs to be accessed to be shared without copying it firstly into a...