Fokko Driesprong
Fokko Driesprong
> Hi, @Fokko About the read projection part, currently we can convert parquet files into arrow streams, but there are some limitations: it only support primitive types, and schema evolution...
@Xuanwo Thanks for driving this. It would be good to get everything that we have on main out to the users 👍
Sorry for the late reply as I was touching grass. We're trying to solve two problems: - Don't produce `-1` since it is erroneous unless there is a snapshot with...
Thanks @tustvold for raising this and please don't hesitate to open an issue or PR. > For example Spark has had a very hard time getting a performant S3 integration,...
Thanks for working on this @c-thiel. Out of curiosity, and probably this is a broader discussion, but currently, the view spec is around [SQL representation](https://iceberg.apache.org/view-spec/#representations). This might not be the...
> The idealist in me would like to eventually see something like substrait beeing used. There is an open discussion on evolving the spec into something like that. I think...
Let's close this one since 0.2.0 has been out for a while :)
@marvinlanhenke Sorry for being late to the party here. Appending a file is rather straightforward, but all the conditions must be met. This is the high-level way of appending a...
> Sometimes it's self contained, for simple types such as int, date, string. > Sometimes it's not self contained, for example decimal. What do you mean by self-contained? For example,...
First of all, thanks for the explanation of the Literal. > This sounds a good idea to me, which doesn't introduce extra maintain effort. The only concern is that it...