Jelmer van Amen

Results 4 comments of Jelmer van Amen

There is some incompatibility on spark 3.5. It seems some constructors have changed, giving Abris problems. ``` Caused by: java.lang.NoSuchMethodException: org.apache.spark.sql.avro.AvroDeserializer.(org.apache.avro.Schema, org.apache.spark.sql.types.DataType, java.lang.String) at java.lang.Class.getConstructor0(Class.java:3082) at java.lang.Class.getConstructor(Class.java:1825) at org.apache.spark.sql.avro.AbrisAvroDeserializer$$anonfun$1.applyOrElse(AbrisAvroDeserializer.scala:38) at...

Hi @kevinwallimann This is using databricks runtime 14.2 https://docs.databricks.com/en/release-notes/runtime/14.2.html. They might have backported something from master? Kind regards, Jelmer Edit, Okay, yup. They included it. ![image](https://github.com/AbsaOSS/ABRiS/assets/11734407/59de6d56-a271-4833-839d-72c58d932a5e)

We are testing.

I agree on that. Databricks 13.3 works fine, but 14.3 lts had the above problem once again