Fokko Driesprong

Results 396 comments of Fokko Driesprong

> Hi, @Fokko About the read projection part, currently we can convert parquet files into arrow streams, but there are some limitations: it only support primitive types, and schema evolution...

@Xuanwo Thanks for driving this. It would be good to get everything that we have on main out to the users 👍

Sorry for the late reply as I was touching grass. We're trying to solve two problems: - Don't produce `-1` since it is erroneous unless there is a snapshot with...

Thanks @tustvold for raising this and please don't hesitate to open an issue or PR. > For example Spark has had a very hard time getting a performant S3 integration,...

Thanks for working on this @c-thiel. Out of curiosity, and probably this is a broader discussion, but currently, the view spec is around [SQL representation](https://iceberg.apache.org/view-spec/#representations). This might not be the...

> The idealist in me would like to eventually see something like substrait beeing used. There is an open discussion on evolving the spec into something like that. I think...

Let's close this one since 0.2.0 has been out for a while :)

@marvinlanhenke Sorry for being late to the party here. Appending a file is rather straightforward, but all the conditions must be met. This is the high-level way of appending a...

> Sometimes it's self contained, for simple types such as int, date, string. > Sometimes it's not self contained, for example decimal. What do you mean by self-contained? For example,...

First of all, thanks for the explanation of the Literal. > This sounds a good idea to me, which doesn't introduce extra maintain effort. The only concern is that it...