dt-rush

Results 47 comments of dt-rush

Consider how the internal data structure (an RB tree of centroids) will grow with `N, M`, where `N` = number of input values `M` = range of values If you...

Any activity on this issue? It appears to affect a decent proportion of users, and the only real solution is pausing and purging the queue, with work lost/incomplete and potentially...

examples which all have infinite-respawning : - http://stackoverflow.com/questions/11507167/mapreduce-jobs-running-forever - https://code.google.com/p/googleappengine/issues/detail?id=12246 - https://groups.google.com/forum/#!searchin/google-appengine/mapreduce/google-appengine/PDnMm67BskI/5DV0lxo2_FgJ - https://groups.google.com/forum/#!searchin/google-appengine/mapreduce/google-appengine/RQaPGQ55hsY/dC5ZV_BuhMMJ - https://groups.google.com/forum/#!searchin/google-appengine/mapreduce/google-appengine/bcJut759svo/pVWv9ze1jNkJ - https://groups.google.com/forum/#!searchin/google-appengine/mapreduce/google-appengine/TUf4OvITSG4/wmftKhQIQBQJ - https://groups.google.com/forum/#!searchin/google-appengine/mapreduce/google-appengine/K8iWOwbIuHQ/CNVfuken0u0J In all of these cases, the user sees an infinite...

I believe I read somewhere that map/reduce functions should never throw exceptions or fail, since if they do, they'll retry, and unless you specify a retry limit, you'll see these...

A quick inspection of all the places that a `MapreduceState` entity is conjured, checking to see if its `active` property is modified, yields: - [mapreduce/handlers.py#L1084](https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/handlers.py#L1084) - [mapreduce/handlers.py#L1178](https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/handlers.py#L1178) - [mapreduce/handlers.py#L1391](https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/handlers.py#L1391) -...

Some analysis of each location: [mapreduce/handlers.py#L1084](https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/handlers.py#L1084) - This is the `_drop_gracefully` implementation of [`ControllerCallbackHandler`](https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/handlers.py#L1053). It will run when the super-class `base_handler.TaskQueueHandler`'s [`initialize()`](https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/base_handler.py#L90) method is called and meets certain conditions (see...