delta-sharing
delta-sharing copied to clipboard
Reference Sharing Server does not work with DataBricks as client (Invalid UUID)
When I've added the example reference server's token:
{
"shareCredentialsVersion": 1,
"endpoint": "https://sharing.delta.io/delta-sharing/",
"bearerToken": "faaie590d541265bcab1f2de9813274bf233"
}
To my DataBricks' Unity Catalog with:
databricks unity-catalog providers create --name db-test-1 --recipient-profile-json-file db-profile.json
To my DataBricks workspace, I am unable to create the catalog since DataBricks says an invalid UUID is presented by the reference server.
Please advise how to proceed as I'm interested if this reference sharing server is supported and tested or merely a prototype implementation.
Hi @rustyconover , https://github.com/delta-io/delta-sharing/pull/262 is merged to make the reference server returns table UUID to be compatible with Databricks's implementation. At the same time, I'll be making changes to Databricks client to remove the requirement of Share UUID.
Generally speaking, the reference server is mostly a prototype and it is encouraged to deploy it with custom extensions to make it work with different requirements and sharing scenarios.
Are all of the custom extensions open source?
@rustyconover it will be up to each server starter to plugin the needed extensions or codings themselves.