Aimilios Tsouvelekakis

Results 22 comments of Aimilios Tsouvelekakis

@gibbscullen: I confirm after retrying that the documentation works. My mistake because I did not check if the process was running before trying the curl but for some reason the...

@stevenayers-bge: Would you be satisfied with building the json object while bringing the secrets from key vault and any other configuration from application resource configuration or even from the keyvault?

@stevenayers, Now i get your point. Yes the load_as_spark function does not support SharingClient, so you are proposing something different from me, to pass the whole JSON stored in secure...

For me yes and as you said yes there is only a `df.load(url)` in `load_as_spark` so indeed it needs to be done on the scala side.

This can be achieved, I need to think how it can be given from the user that we use postgres in the conn variable. After that we need some OS...

Good morning, Apparently, the problem is that the delta-core library does not exist. I need to have it inside the the sparks/jars folder and have the JAVA_HOME set. I also...

@zsxwing: I can understand that but there is a problem. I have a python project which uses spark and delta tables. I want to run it in a docker image...

Good morning @zsxwing, I checked my docker image and there is nowhere another version of delta. The only version is the one I download. If I remove the jar file...

Hi @zsxwing, I do not run any pyspark command I wait for it to be invoked from python when the unit tests are called. What i only do is to...

The solution for this is the following. Since we are using Databricks dbfs to store the profile file, we need to do: ```python test_data = profile_file.replace("/dbfs", "dbfs:") + "#{Share}.{Database}.{table}" delta_sharing.load_as_spark(url=test_data)...