Christopher J. 'CJ' Wright

Right, the questions I'm interested in are: 1. Has this catalog changed since my last access? (With a follow up of, can I have the old catalog please? Or maybe...

ping @martindurant @mariusvniekerk

@martindurant ok, what do you see as the path forward here? Do you want me to open a PR into fsspec?

Hmm, I'm not certain if the caching is fixable without a bunch of work, since we'd need to destroy the cache or expire the url once the auth changes (or...

@martindurant one thing I don't grok yet is: from my reading of the source the `action == 'open'` clause doesn't actually init the filesystem. Even `_create_open_args` doesn't know anything about...

I've added sign to the base class and GCP/AWS providers. xref: https://github.com/intake/filesystem_spec/pull/376 https://github.com/dask/gcsfs/pull/277 xref: https://github.com/dask/s3fs/pull/345

`mongoquery` might work for this, it applies `mongo` like syntax to lists of python dictionaries. This would enable more advanced queries than "is word anywhere in dict". How would you...

We used mongoquery to act like mongo in front of the portable databrokers at the NSLS-II. Would it be worthwhile to add a `key` keyword to the search method? Each...

> The callable takes entries as input, bool output Yep. You could even implement fuzzy searching with string distances.

Could we not have the intake server create a spark rdd on the spark cluster and then ship the reference back to the user?