fastertransformer_backend icon indicating copy to clipboard operation
fastertransformer_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

Is deberta supported in the fastertranformer backend?

Open sfc-gh-zhwang opened this issue 1 year ago • 0 comments

Looks like the answer is no and it will fail if we put a deberta model: https://github.com/triton-inference-server/fastertransformer_backend/blob/main/src/libfastertransformer.cc#L333.

Is there future plan to support deberta?

sfc-gh-zhwang avatar Jun 28 '23 20:06 sfc-gh-zhwang