Andrew Lamb

Results 1970 comments of Andrew Lamb

Thanks @notfilippo -- I will try and get the other projects I have under way to a better state so I can more fully help plan / communicate / coordinate...

Thanks @ctsk -- this idea sounds good -- I think we should run the benchmarks to make sure they don't cause issues. I'll do so shortly

@ctsk thank you so much for this PR (and others) can you share more about what you are doing with DataFusion? If you would like to have a brief introduction...

Hi @ctsk -- is this PR ready for running some benchmarks?

I am firing up the benchmarks

I tried to run the clickbench queries using bench.sh and I got an error like this: ``` Q1: SELECT COUNT(DISTINCT "HitColor"), COUNT(DISTINCT "BrowserCountry"), COUNT(DISTINCT "BrowserLanguage") FROM hits; Query 1 iteration...

> Just want to add a test for this then plan to merge it I am making great progress on the example - https://github.com/apache/datafusion/pull/13424 I als plan to yoink this...

> @alamb do you envision having the dedicated executor eventually live in the main datafusion repo? If not (or even as an interim solution while its iterated on) I could...

> I would strongly encourage implementing the IO dispatch at an application boundary that makes, e.g. AsyncFileReader, the ObjectStore trait is not designed to allow it to be shimmed in...

> Ultimately DF needs to separate IO based activities from CPU-based activities, and overloading this onto the ObjectStore interface won't work reliably. Thank you -- I have some ideas about...