Austin Godber
Austin Godber
One problem we've often had in running lots of Teraslice jobs is keeping track of jobs that are meant to be running over longer periods of time. Sometimes jobs are...
Add the ability for an asset to state what versions of Teraslice it requires and Teraslice should use this to validate the asset against it's current version at the time...
It would be excellent if there was an `earl tjm diff file.json` command. It would show the difference between the registered job on the cluster and the file.
When trying to register the following job: ``` { "name": "ts-tmp1-test", "lifecycle": "persistent", "workers": 1, "assets": [ "standard", "elasticsearch" ], "operations": [ { "_op": "data_generator", "size": 10000 }, { "_op":...
This test was disabled as part of the ESM refactor: https://github.com/terascope/teraslice/blob/master/packages/scripts/test/images-spec.ts#L36 It should be re-enabled or re-implemented in a way that is compatible with ESM. Also, anywhere the test says...
We have this notion of "Stateful Workers" as described here: https://terascope.github.io/teraslice/docs/configuration/clustering-k8s/#stateful-workers In Teraslice jobs you can set the `"stateful": true,` property and the workers will be slightly different (see docs)....
Would it make sense to expose the `ex._status` property as `.status` or perhaps `.exStatus` on the Teraslice job API resources? I would expect this to be implemented by making a...
We have processors that sample the incoming data and keep a specified amount: https://github.com/terascope/standard-assets/tree/308f828ee2638580eecf8cda3842b50c5727fe2c/asset/src/sample_exact The problem is, the amount kept is currently specified as a percentage of the incoming records,...
The recovery process has never worked reliably in large scale production situations. WIP - We'll come back and flesh out details later. * Should be fixed to work correctly in...
We had an internal job with 16 workers that had it's execution controller restart due to the host it was on died. The execution controller restarted on another host just...