delta-go icon indicating copy to clipboard operation
delta-go copied to clipboard

json: cannot unmarshal bool into Go struct field CommitInfo.commitInfo.operationParameters of type string

Open maxrem opened this issue 1 year ago • 4 comments

Hello!

I'm getting this error:

delta.ForTable: fail to get protocol and metadata when initializing snapshots: : json: cannot unmarshal bool into Go struct field CommitInfo.commitInfo.operationParameters of type string

In the _delta_log json:

{"operationParameters":{"mode":"Overwrite","statsOnLoad":false,"partitionBy":"[]"}}

Looks like statsOnLoad can't be unmarshalled.

maxrem avatar May 17 '24 12:05 maxrem

Which version of the delta are you using ? I suspect the table is a newer version that this library does not support.

csimplestring avatar May 18 '24 08:05 csimplestring

I'm not sure which version we're using. I have to ask my team, but I think it's a recent one.

It looks like the operation parameters is a Map[String, Any] in the current Delta Lake code. Can I make a PR to change it to that in this library too?

Thanks!

maxrem avatar May 21 '24 10:05 maxrem

We're using Delta Lake v2.4.0

maxrem avatar May 21 '24 11:05 maxrem

I'm not sure which version we're using. I have to ask my team, but I think it's a recent one.

It looks like the operation parameters is a Map[String, Any] in the current Delta Lake code. Can I make a PR to change it to that in this library too?

Thanks!

sure, waiting for your contribution.

csimplestring avatar May 22 '24 07:05 csimplestring