databroker
databroker copied to clipboard
bluesky
Unified API pulling data from multiple sources
## Expected Behavior Using a search query on a catalog produces another catalog. I expect to be able to do further searches on that catalog to continuously narrow down my...
While going through databroker tests with @danielballan doing the final prep for v2 there are a number of tests that need to be re-worked or moved else where - [...
This code, in the newest bluesky environment, is producing a very noisy pandas PerformanceWarning: ``` PerformanceWarning: DataFrame is highly fragmented. This is usually the result of calling frame.insert many times,...
## Expected Behavior Our Mongo adapter should paginate to avoid making requests over the Mongo server's size limits. ## Current Behavior Reading one or more of the streams on `c["tes"]["cc75408e-f9dc-463f-bf12-c0696baa2384"]`...
As noted in https://github.com/BCDA-APS/apstools/pull/620#issuecomment-1014746302, the ` ImportError: cannot import name 'Iterable' from 'collections'` error happens with Py3.10: ```bash conda create -n py310 python=3.10 conda env update -f environment.yml -n py310...
Right now, we explain the version sentinel but we don't show a way to test. http://nsls-ii.github.io/databroker/creating.html we should add something. i suggest to add inserting and checking a resource
The documentation starts to use the term `catalog` without ever describing what such a thing is. So, it is a **BUG**. Various examples of catalogs are described but in place...
In the CI workflow for https://github.com/bluesky/hklpy, [failures began this week](https://github.com/bluesky/hklpy/issues/193#issuecomment-890039800) when testing the Python 3.6 build. These failures did not occur in the PR, but only appeared after two PRs...
This will be useful for data engineering tools, such an agent that confirms that files are present and maybe stores a checksum.
Example: ```py In [35]: nsls2['ios']['3d7f5161']['primary'].read() ``` From server logs: ``` Jul 27 14:21:47 tiled.nsls2.bnl.gov tiled[22905]: pymongo.errors.OperationFailure: BSONObj size: 48933475 (0x2EAAA63) is invalid. Size must be between 0 and 16793600(16MB), full...