Dan Allan

Results 394 issues of Dan Allan

When databroker was for both *writing* and reading it made some sense to put this here. Now it should be the job of writers (suitcase) or perhaps some separate separate,...

In [b3a1d02](https://github.com/bluesky/databroker/pull/694/commits/b3a1d029c6032a928967fb6cfd7f8102847d99d5) I removed the documentation-building and documentation-publishing GitHub workflows. The docs use `databroker-unpack` to get some example data, and it's a bit convoluted. It also breaks when run against...

## Expected Behavior Our Mongo adapter should paginate to avoid making requests over the Mongo server's size limits. ## Current Behavior Reading one or more of the streams on `c["tes"]["cc75408e-f9dc-463f-bf12-c0696baa2384"]`...

This will be useful for data engineering tools, such an agent that confirms that files are present and maybe stores a checksum.

Example: ```py In [35]: nsls2['ios']['3d7f5161']['primary'].read() ``` From server logs: ``` Jul 27 14:21:47 tiled.nsls2.bnl.gov tiled[22905]: pymongo.errors.OperationFailure: BSONObj size: 48933475 (0x2EAAA63) is invalid. Size must be between 0 and 16793600(16MB), full...

This would enable users to search like: ```py catalog.search({'plan_name': 'relative_scan'}, stop={'exit_status': 'success'}) ``` and search on descriptors as well, something that @CJ-Wright has been rightly requesting for some time.

## Summary Let's try refactoring Databroker's `Broker`, `BlueskyRun`, and `BlueskyEventStream` objects to drop the `intake.Catalog` and `intake.DataSource` base classes while remaining backward-compatible with `databroker.v2` and interoperable with intake and its...

As @untzag suggests, > You have some content in databroker-concepts that would be useful for this. https://blueskyproject.io/databroker/docs-rewrite-draft/explanations/relationship-to-intake.html#databroker-concepts

We store the times as floating point EPOCH seconds and we present them to the user this way as well. Working with Tatiana recently on data alignment, I found myself...

The scheduled run of the databroker unit tests on GitHub Actions failed these two tests across the whole matrix: ``` FAILED databroker/tests/test_broker.py::test_find_by_string_time[sqlite] - as... FAILED databroker/tests/test_broker.py::test_find_by_string_time[mongo] - ass... ``` The...