Lin Zhou

icon company DataBricks

Results 61 comments of Lin Zhou

Short Term Bearer Tokens

@davidgreenfield A couple questions to better understand your request: 1. Are you starting your own delta sharing server? Since if you use databricks, the token lifetime is limited, and provider...

While accessing the data on recipient side using delta_sharing.load_table_changes_as_spark(), it shows data of all versions.

Sorry for the delay. My local tests work well. Which version are you using? Could you update to the latest version and try again? Could you paste the commands and...

While accessing the data on recipient side using delta_sharing.load_table_changes_as_spark(), it shows data of all versions.

@linzhou-db Thanks! My local testing works well. So I wonder if you copied the syntax of `load_table_changes_as_spark` from README directly, where there's a typo. `start__version` should be `start_version`. I'll fix...

While accessing the data on recipient side using delta_sharing.load_table_changes_as_spark(), it shows data of all versions.

Interesting... Where's your server? Do you have your local delta sharing server?

While accessing the data on recipient side using delta_sharing.load_table_changes_as_spark(), it shows data of all versions.

This is super weird as my local testing all worked. Do you have a screenshot?

While accessing the data on recipient side using delta_sharing.load_table_changes_as_spark(), it shows data of all versions.

@MaheshChahare123 I feel it's possible that your delta sharing package didn't upgrade to the latest version, could you try: `pyspark --packages io.delta:delta-sharing-spark_2.12:0.6.2`

While accessing the data on recipient side using delta_sharing.load_table_changes_as_spark(), it shows data of all versions.

@ParulPaul @MaheshChahare123 I think the reason is that you need to update to the latest version of delta-sharing-spark.

delta-sharing package issue in pyspark

@param422 Sorry for the delay, taking a look.

Protocol spec - Read table data can have large responses for tables with many files.

Hi @rustyconover , yes pagination is in our roadmap. Feel free to make changes to the open source server if you are interested. Where is the "6mb" from though? It's...

share based access token

Thanks! So the oss server is a reference server, feel free send out PRs or update locally to add those features.