Charl P. Botha
Charl P. Botha
We are seeing similar behaviour. With our Python implementation using the azure event hubs SDK we can read 10 times faster from the exact same hub as our stripped down...
In my case (ubuntu 22.04), the symlink `/etc/resolve.conf -> /run/systemd/resolve/resolv.conf` was there, but there was no `127.0.0.53` entry, only my actual upstream DNS servers. tailscale would report direct dns mode,...
I ran into this today (2024-09-07) via `Find`. After closing the `Find` window, now with my cursor on the line I wished to find, if I press esc, ctrl-c or...
Continuing the digging, I executed `ipython` in my Python environment, which revealed that the underlying problem was the missing `msal` package. Please see output below. It would of course be...
After the `msal` dependency issue was addressed, I could not understand why the `spark` global setup by the 00-databricks-init script was being clobbered back to None. Some debug print statements...
Doh! You're completely right, `msal` was due to `session_management.py` which is also part of the fabric setup, which I did not realise at that point. Indeed, having the verify command...
it's pulling exactly the same image, please see the linked reproducer project. what's interesting, is that that exact same config is giving pretty good perf on apple silicon where the...
I am seeing exactly this error, with a similarly minimal example. docker-compose.yml (only change: port 7077 exposed from spark master) + images from bitnami, and in my case connecting to...
Looks like this could be because `getSubject()` was deprecated for removal in JDK 17, but the hadoop packaged with spark still makes use of this API. See https://issues.apache.org/jira/browse/HADOOP-19212 and https://issues.apache.org/jira/browse/CALCITE-6590...
The problems was the JDK on my client. When I downgraded from 23 to 21, the security manager issue turned into a warning and not an exception, as expected.