TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

Support gelu_pytorch_tanh activation function

Open ttim opened this issue 7 months ago • 0 comments

In order to support Gemma 1.1 definition from huggingface (https://huggingface.co/google/gemma-1.1-2b-it/blob/main/config.json) gelu_pytorch_tanh activation function should be recognized.

ttim avatar Jul 04 '24 20:07 ttim