Bill Katz
Bill Katz
A lot of data engineering teams are now using gRPC for connecting parts of the data infrastructure.
DVID should either reject requests considered too large (currently, max return data size is 3 GB per HTTP request) or prevent allocation of slices beyond some reasonable size. Crash was...
Make all unversioned data instances use the root repo as UUID. Currently, this is done for keyvalue datatype but should be part of core. When we move to data instances...
Aside from dvid modifications, would also require changes to libdvid and dvid clients to use it natively.
After updating DVID code base, we'd like to upgrade a running DVID server when it's not being used. Add graceful restarts using package like this: https://github.com/rcrowley/goagain Add ability to ask...
See if we can pull into the datastore package any data instance-level locking scheme to manage datatype-specific mutations that aggregate k/v underneath. For example, if we have concurrent 3d labelblk...
When mutations occur, DVID clients could want to be informed. We have an internal pub/sub system that handles synchronization using ids for events and transmits the deltas to subscribers. This...
Example from bug report: 2016/11/14 15:37:36 INFO Found 1 scaling levels for imagetile specification. 2016/11/14 15:37:36 INFO scale 0, levelSpec {8.000000,8.000000,8.000000 (512,512,1)} 2016/11/14 15:37:36 ERROR Cannot construct tiles for data...
Extends issue #139 so webhook system sends full mutation data using cross-language serialization like protobuf3, thrift, etc.
Instead of timestamp + free-form log message, use "key=value" strings where key will give time, log level, etc.