simpleflow
simpleflow copied to clipboard
botify-labs
Python library for dataflow programming.
The workflow "run()" method receives a "None" as first and only argument (+ self obviously) if no parameter is passed as input, resulting in exceptions like: ``` TypeError: run() takes...
Recently at Botify we hit situations where we would overflow our [SWF rate limits](http://docs.aws.amazon.com/amazonswf/latest/developerguide/swf-dg-limits.html), especially in `RecordActivityTaskHeartbeat` and `PollForActivityTask` operations. The main problem for me is that we hit a...
If task1 fails once, and is retried, you get two activities in the history: one scheduled at event ID "153" for instance, and the retry scheduled at event ID "159"....
Everything in the title. If SWF rate-limits us, the simplest thing we could do is retry ~forever on important actions and log (+ alert but not simpleflow responsibility as of...
It would be useful to add an option to force simpleflow to kill child processes in simpleflow.execute, on exit, eg: `python -m simpleflow.execute x.launch_process '{"args": []}' --kill-children` Somewhere in `x.py`:...
Simpleflow should be able to report workers usage to a given datastore (say Redis) so that it can be consumed by other systems (webflow, an autoscale mechanism). The idea is...
It would be useful to let the user define a timeout value when using the decorator `@execute.python()`. Eg: ```python import time def sleep_and_return(seconds): time.sleep(seconds) return seconds func = execute.python(timeout=0.5)(sleep_and_return) #
A test sometimes hangs in CI. Maybe `TestSignals.test_unrequested_signal` which just did the same on my PC? EDIT: Nope, I launched it for real (unlike Travis which use a vcr)
Maybe due to the jumbo fields? 🙂 (Not caught by the automated tests as the old results are returned by vcr)