funnel icon indicating copy to clipboard operation
funnel copied to clipboard

Published 20 hours ago • verified publisher icon ohsu-comp-bio

Using instances with GPUs

Open kmavrommatis opened this issue 2 years ago • 3 comments

Hi, apologies if I have missed this in the documentation. Is there aw way to make funnel start a docker container using the --gpu xx or --gpu all argument (xx=number of GPUs to use)? I am passing jobs to an AWS batch queue with gpu enabled instances, but the task jobs don't seem to get the information that the GPUs are available on the node.

Thanks in advance for your help

kmavrommatis avatar Mar 21 '22 18:03 kmavrommatis

This isn't in funnel yet. We're looking at adding backend_parameters into the TES specification ( https://github.com/ga4gh/task-execution-schemas/pull/154 ). Once this is available, we will find a way to configure mappings into Funnel.

kellrott avatar Aug 24 '22 00:08 kellrott

Quick question, is this implementated yet ?

obonyojimmy avatar Dec 20 '22 15:12 obonyojimmy

The TES 1.1 specification has been officially released. My team is working on figuring out when we can schedule some of our engineering time to work on upgrading Funnel.
So, no it is not implemented yet. But we hope to get it done soon.

kellrott avatar Dec 22 '22 19:12 kellrott