Dan Harris

Results 47 comments of Dan Harris

cc @mingmwang @yahoNanJing

> @thinkharderdev this seems related: [apache/arrow-datafusion#3311](https://github.com/apache/arrow-datafusion/pull/3311) Thanks! I think that could potentially support this use case. Either `TableProviderFactory` or `TableProvider` would need to expose a way to get an `AyncFileReader`.

@mingmwang I'm pretty swamped this week so won't have time to review this until this weekend.

> Hmmmm...I have some problems about this pr. If we treat UDTF as an expression, does it mean that it can only produce one column? As I mentioned before ([#2177...

> what about `Result`. I already almost implemented it this way:) > > > > It seems like a table function should produce RecordBatchs and effectively compile down to an...

> > A single session could have multiple statements run concurrently. And a statement_id is not enough to differ metrics either. > > That is a good point. I still...

Makes sense, I guess this would just be something you can register in the `SessionContext`?

Would like to add that supporting serialization of user-defined functions would be quite nice. The current approach to serialization is to basically just use a string and so if you...

> > Would like to add that supporting serialization of user-defined functions would be quite nice. > > I don't understand this question @thinkharderdev 🤔 > > The current approach...

Started working on this and it's in some ways more straightforward than I had thought (you can see a working, but hacky since it avoids refactoring as much as possible...