Bill Katz

Results 34 issues of Bill Katz

A lot of data engineering teams are now using gRPC for connecting parts of the data infrastructure.

DVID should either reject requests considered too large (currently, max return data size is 3 GB per HTTP request) or prevent allocation of slices beyond some reasonable size. Crash was...

bug

Make all unversioned data instances use the root repo as UUID. Currently, this is done for keyvalue datatype but should be part of core. When we move to data instances...

enhancement

Aside from dvid modifications, would also require changes to libdvid and dvid clients to use it natively.

enhancement

After updating DVID code base, we'd like to upgrade a running DVID server when it's not being used. Add graceful restarts using package like this: https://github.com/rcrowley/goagain Add ability to ask...

enhancement

See if we can pull into the datastore package any data instance-level locking scheme to manage datatype-specific mutations that aggregate k/v underneath. For example, if we have concurrent 3d labelblk...

enhancement

When mutations occur, DVID clients could want to be informed. We have an internal pub/sub system that handles synchronization using ids for events and transmits the deltas to subscribers. This...

enhancement

Example from bug report: 2016/11/14 15:37:36 INFO Found 1 scaling levels for imagetile specification. 2016/11/14 15:37:36 INFO scale 0, levelSpec {8.000000,8.000000,8.000000 (512,512,1)} 2016/11/14 15:37:36 ERROR Cannot construct tiles for data...

testing

Extends issue #139 so webhook system sends full mutation data using cross-language serialization like protobuf3, thrift, etc.

enhancement

Instead of timestamp + free-form log message, use "key=value" strings where key will give time, log level, etc.

enhancement