delta-sharing delta-sharing package issue in pyspark

delta-sharing package issue in pyspark

Open param422 opened this issue 1 year ago • 4 comments

Hi Team,

Requirement: Install delta_sharing package in one of our EMR server.

We have installed the package in python using the below command and we are able to se and access the package.

pip install delta-sharing

Now, the issue is when we try to import this package from pyspark (jupyter notebook) it is giiving No Module error.

Below is the screenshot of the error.

Can you please assit on this as this is critical to our project.

Jun 11 '23 03:06 param422

Could you please help us on this issue.

Jun 12 '23 17:06 param422

hi team, could you please help me on this issue.

Jun 13 '23 20:06 param422

@param422 Sorry for the delay, taking a look.

Jun 21 '23 18:06 linzhou-db

@param422 Could you try some other python library? I feel it's likely you are using the right way to install python libraries for jupyter notebook.

I found this post from EMR: https://aws.amazon.com/cn/blogs/big-data/install-python-libraries-on-a-running-cluster-with-emr-notebooks/

Could you try above and see if it works?

Jun 21 '23 18:06 zsxwing