delta-sharing icon indicating copy to clipboard operation
delta-sharing copied to clipboard

Reference Sharing Server does not work with DataBricks as client (Invalid UUID)

Open rustyconover opened this issue 2 years ago • 3 comments

When I've added the example reference server's token:

{
  "shareCredentialsVersion": 1,
  "endpoint": "https://sharing.delta.io/delta-sharing/",
  "bearerToken": "faaie590d541265bcab1f2de9813274bf233"
}

To my DataBricks' Unity Catalog with:

databricks unity-catalog providers create --name db-test-1 --recipient-profile-json-file db-profile.json

To my DataBricks workspace, I am unable to create the catalog since DataBricks says an invalid UUID is presented by the reference server.

Please advise how to proceed as I'm interested if this reference sharing server is supported and tested or merely a prototype implementation.

rustyconover avatar Feb 12 '23 22:02 rustyconover

Hi @rustyconover , https://github.com/delta-io/delta-sharing/pull/262 is merged to make the reference server returns table UUID to be compatible with Databricks's implementation. At the same time, I'll be making changes to Databricks client to remove the requirement of Share UUID.

Generally speaking, the reference server is mostly a prototype and it is encouraged to deploy it with custom extensions to make it work with different requirements and sharing scenarios.

zhuansunxt avatar Feb 13 '23 20:02 zhuansunxt

Are all of the custom extensions open source?

rustyconover avatar Feb 13 '23 20:02 rustyconover

@rustyconover it will be up to each server starter to plugin the needed extensions or codings themselves.

linzhou-db avatar Feb 15 '23 00:02 linzhou-db