confluent-kafka-python icon indicating copy to clipboard operation
confluent-kafka-python copied to clipboard

Enable pickling of schema registry client by updating `_SchemaCache`

Open jkleung11 opened this issue 4 years ago • 1 comments

  • Mirrors PR 56 in python-schema-registry-client
  • Attempted to use AvroSerialzer and AvroDeserializer within pyspark udfs to (un)serialize contents of a dataframe but ran into TypeError: cannot pickle '_thread.lock' object
  • The serializers are dependent on SchemaRegistryClient, which in turn uses _SchemaCache
  • Added __setstate__ and __getstate__ methods to process the .lock attribute of _SchemaCache

jkleung11 avatar Oct 27 '21 18:10 jkleung11

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 2 committers have signed the CLA.

:x: Jonathan Leung
:x: jkleung11


Jonathan Leung seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Apr 12 '22 13:04 CLAassistant