transformers-php icon indicating copy to clipboard operation
transformers-php copied to clipboard

Published 20 hours ago • verified publisher icon CodeWithKyrian

GPU Support

Open fakerybakery opened this issue 1 year ago • 1 comments

Your question

Hi, does Transformers PHP support GPUs w/ ONNX? Thanks!

Context (optional)

No response

Reference (optional)

No response

fakerybakery avatar Aug 20 '24 17:08 fakerybakery

Short answer, no.

Long answer, not yet, but it’s definitely on the roadmap, especially before we hit version 1.0. However, the current focus has been on maximizing performance on the CPU and optimizing everything on that front. SO far, I've recorded tremendous speed optimizations on the CPU compared to the first release

CodeWithKyrian avatar Aug 20 '24 18:08 CodeWithKyrian