Scott Sandre

Makes sense. Thanks

I fixed this issue in my own repo here: https://github.com/delta-io/connectors/commit/9a0b8648e38fca1eeaf7ec87d9781dccef2b02c6 `Compile / doc / javacOptions := (JavaUnidoc / unidoc / javacOptions).value,`

Hi @SteNicholas, this looks like a useful enhancement. Would you be interested in contributing this? Also - what are "metadata" columns?

@SteNicholas - is this only useful using SQL/Table API? Is this useful using the currently-supported DataStream API?

Also - it's not exactly clear to me how these "metadata" columns should be persisted to the _delta_log.

> this is indeed useful for the Table/SQL API, because these interfaces are based on Table API. Can you make this clearer in the issue description? Glad you want to...

@MrPowers - do you know the latest status of this? I recall you saying you knew a member of the community that was interested in working on this? Can you...

@gbrueckl can you take a look?

> I've got a suspicion that the VACUUM cleaned up the files no longer referenced in the latest table and also removed the relevant data in the _change_data folder but...

Wouldn't this PR https://github.com/delta-io/delta/pull/1262 help with this?