turbinia
turbinia copied to clipboard
google
Automation and Scaling of Digital Forensics Tools
With Celery/Kombu we have the capability of prioritizing which Tasks are routed to the Worker. It'd be nice to have a way to prioritize Tasks (such as `FileSystemTimelineJob`) to run...
Now that we have a complete view of a Turbinia Request (RequestList, TaskList, and TaskDetails), create a Graph representation of the data to better visually show the lifecycle of the...
Status is being set on the worker side to either `queued` or `running` in the run_wrapper block. Then the server side uses the celery stub to check the Task status...
We've seen these before, but they are coming up again for some reason from recent load tests of latest changes from master. Need to look into what's causing them I...
Seeing a couple of StringJobs fail occasionally during high load tests. Example error: ``` Execution of [strings -a -t d -e l /dev/loop8 > /mnt/turbiniavolume/output/d9d5cd4e1c6947c1bc0ecfc612000956/1675275488-fc35e981640f4dc9bab06bff7d538a04-StringsUnicodeTask/loop8.uni] failed with status 1 ```...
Per our past chat around this creating this as reference, ideally would like the api server to log into the `LOG_DIR` directory for easier reference, currently seems to be done...
In cases where a Task failed give a user option to retry it will likely have to work with API to have the ability to do so and we have...
In #1215 fixed run_time calculation by introducing `worker_start_time` which is calculated when the Worker starts a Task. Track this field in Redis as well as add to `REQUIRED_ATTRIBUTES` Also update...
Celery has the ability to retry Tasks and only retry an X max amount times before failing. One possible place where we'd benefit from this is when there is a...
Per @aarontp mention in https://github.com/google/turbinia/issues/1198 would be nice to have to do something like option 3 where we have ability to time out tasks through UI in cases of an...