Barthelemy Dagenais

Hi, can you provide more information about the plugin system you are using? Is this an Eclipse application? One reason the python may not be able to find the interface...

Hi, Thanks for reporting this issue: you are right that parallel testing would reduce the execution time and be generally beneficial. The tests currently clean themselves and do not impact...

Sorry for the long long long delay. Can you post some code snippets (Java and Python) to make it easier to reproduce the problem. Py4J tries to be smart when...

Hi, which version of Py4J are you using? The current version has this check, which should catch the error you are referring to: ```python def _garbage_collect_object(gateway_client, target_id): try: try: ThreadSafeFinalizer.remove_finalizer(...

@jonahkichwacoders how do you serialize ndarray to IDataset (and conversely)?

From what I see in the code, if Py4J gives you on the Java side (1) a ByteBuffer or a Channel, (2) the size of the payload, and (3) some...

Note: 100 million datapoints with double precision would be around 763 megabytes (100000000*8/1024/1024) which still fits in a byte array on the Java side.

@JoshRosen @davies @kaytwo If you are still using Py4J and could comment on this issue, that would be great. Thanks!

Hi, I have only a very limited knowledge of the inner working of PySpark and this looks like a question for them. It is possible to call a static method...

Looking at the code, I suspect that ssl.PROTOCOL_TLSv1 may be the culprit. It is deprecated by many libraries and servers and either the JDK, the python version or a dependency...