[Question]Packages and libraries

[aimtsou]

There is some inconsistency between the docs and the packages:

For the Delta Sharing Server:

• In the GitHub release page we have the delta-sharing server as of version 1.0.4
• The docker image in the official repository is not in version 1.0.4, so it needs an update.

For being able to read the delta tables with the Delta Sharing Server we need, Apache connector

• Delta Sharing Java Library, which in the docs appears as io.delta:delta-sharing-spark_2.12:0.6.4, although in maven latest vetsion 3.1.0, which is bigger in size and released after 1.0.4. What are their differences?

If we user the python connector, delta-sharing it is being in version 1.0.3, is that correct or it should align with the versioning of delta sharing server?

[linzhou-db]

Hi, thanks for your questions! The versions for delta-sharing-server, delta-sharing python connector and delta-sharing-spark are independent with each other.

• It is true that the latest delta-sharing-spark is 3.1.0, which is able to read shared DV tables.
• The latest delta-sharing python connector is 1.0.3, but it uses the latest delta-sharing-spark installed on your machine when calling load_as_spark, not restricted to the python connector version. 

We'll update our doc to make it more clear.

[aimtsou]

Hi @linzhou-db,

Thanks for the clarification, more or less what I understood from my research but now it is confirmed. I can help you with the docs if needed.

It would be nice if we could get the newest docker image for delta sharing server.