delta-sharing icon indicating copy to clipboard operation
delta-sharing copied to clipboard

access views in delta share

Open lramkris1204 opened this issue 1 year ago • 5 comments

I created a view in the delta share and tried to access but I get a response from server stating 'INVALID_PARAMETER_VALUE, 'message ': could not retrieve from share because table with type VIEW is currently unsupported in Delta Sharing protocol. Could you please let me know if there are any alternate ways in which the underlying query of the view itself can be embedded in the url that is being sent to the delta share. Appreciate your help and support on this context with an example code.

lramkris1204 avatar Jan 23 '24 21:01 lramkris1204

I created a view in the delta share and tried to access but I get a response from server stating 'INVALID_PARAMETER_VALUE, 'message ': could not retrieve from share because table with type VIEW is currently unsupported in Delta Sharing protocol. Could you please let me know if there are any alternate ways in which the underlying query of the view itself can be embedded in the url that is being sent to the delta share. Appreciate your help and support on this context with an example code.

Hi, I had the same issue. Apparently, the VIEW only works with Databricks to Databricks but if you want to access view from different environment then it is not supported right now with Delta Sharing Protocol. You can only access table from non Databricks environment.

mk-hasan avatar Feb 23 '24 17:02 mk-hasan

cc @andyl-db @chakankardb

linzhou-db avatar Mar 07 '24 18:03 linzhou-db

Curious, did you try materialized views or just plain vanilla views? We were considering a solution with views.

john-grassroots avatar May 21 '24 21:05 john-grassroots

To answer my own question...

You're not yet currently able to add Materialized Views to a share (Receive error "Sharing materialized views is not supported yet" in AWS Databricks).

When attempting to read a normal view which you are able to add to a share in the current version of Databricks you receive the error below indicating Views are unsupported.

I'm running the following...

AWS Databricks where the share originated from

and Python program on local machine as client with the following...

Name: delta-sharing Version: 1.0.5 (latest)

Name: databricks-spark Version: 3.2.0 (latest)

Name: databricks-connect Version: 14.3.2 (latest)

400 Client Error: Bad Request 
 { 'details': [ { '@type': 'type.googleapis.com/google.rpc.ErrorInfo',
                 'domain': 'data-sharing.databricks.com',
                 'metadata': { 'dsError': 'DS_UNSUPPORTED_TABLE_TYPE',
                               'schema': 'data_tst,
                               'share': 'delta-sharing-poc',
                               'table': 'product_vw',
                               'tableType': 'VIEW'},
                 'reason': 'DS_UNSUPPORTED_TABLE_TYPE'},
               { '@type': 'type.googleapis.com/google.rpc.RequestInfo',
                 'request_id': '911440fa-50c8-4284-991e-917fb45c5ba5',
                 'serving_data': ''}],
  'error_code': 'INVALID_PARAMETER_VALUE',
  'message': 'DS_UNSUPPORTED_TABLE_TYPE: Could not retrieve '
             'because '
             'table with type [VIEW] is currently unsupported in Delta Sharing '
             'protocol.'}

john-grassroots avatar May 22 '24 02:05 john-grassroots

by any chance, does anyone know if it this is on the roadmap?

tblatrille avatar Sep 19 '24 13:09 tblatrille