Matthew Rocklin

Results 1038 comments of Matthew Rocklin

Are you familiar with https://docs.dask.org/en/stable/10-minutes-to-dask.html ?

> Yes, but that's was too much (and unnecessary) information for someone who wants to start playing around with. It's not really a quick start, more a resource for things...

> but serving 5 different use-cases at the same time is one of the issues with the other page I agree that this is a challenge. > intro that holds...

Just thinking out loud here, but another solution would be to have a dataframes-specific quickstart in the dataframes section. Then different external resources could link to that page, rather than...

> We (with @ian-r-rose ) try to annotate the tasks in read_bytes where we do have storage options and a file system, but the annotations where lost along the way....

Great. Can I ask that we surface that as an issue for future tracking? I wouldn't want the only record of that to be on this PR. Alternatively, perhaps we...

> Using fs.open_input_file does cut my wall time by ~50% for this simple example I'll be dumb for a moment. If there aren't any backend options specified, and if arrow...

If storage_options was empty could we safely do this? On Thu, Nov 3, 2022 at 4:28 PM Richard (Rick) Zamora < ***@***.***> wrote: > If there aren't any backend options...

Totally agreed that folks shouldn't jump to conclusions. @martindurant have you had a chance to look at [this video](https://www.loom.com/share/4c8ad1c5251a4e658c1c47ee2113f34a). I would be curious about your opinion on what is going...

If I had to guess (and I only have like 20% confidence here) it would be that while fsspec is good on its own and dask is good on its...