brenda-web
brenda-web copied to clipboard
Build Backend Functionality for 'Add Spot Instance Render Job:Add a Job'
The following needs to happen in the backend for the Add Job function.
- Take submitted .blend file or .zip, check to see which was submitted
- .blend: Zip the file up
- .zip, .gz: Just pass the file along
- Create a Brenda configuration file that
brenda-workwill use. - Run the
brenda-workcommand and produce a Amazon SQS Queue that contains all of the frames in project. e.g.brenda-work -T ~/Brenda/frame -s 1 -e 50 push~/Brenda/frameshould be the local copy of frame located inlib/task-scripts/frame. Support subframe at a later date. - After the frames have been processed and the queue has been established. Run the
brenda-run -N 4 -p 0.07 spotcommand and create the spot instance requests.These currently take Amazon around ~5 minutes to approve. And it's worth noting that it could fail. This may be due to price or other issues.
- Show the status of the job.
- Send an email notification when the job has been approved and has started.
- Figure out how to stop the instances after the jobs have been completed.
I'm sure there's a lot more that needs to happen here, but this is all I could think of at the moment.
Note on implementation
- It'd be nice to show the process live as it's happening via AJAX. I can visualize some kind of progress as things are processing.