mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

adaptive_softmax, SinusoidalPositionalEmbedding ops are not supported

Open Ramees025 opened this issue 1 year ago • 1 comments
trafficstars

When I tried to add the model support for fairseq model following ops are not present,

AdaptiveSoftmax, BaseLayer, FairseqDropout, LayerDropModuleList, LayerNorm, PositionalEmbedding, SinusoidalPositionalEmbedding,

model: https://huggingface.co/spaces/OFA-Sys/OFA-vqa/tree/main/fairseq/fairseq/models/transformer

Is it possible add support for those ops?

I am following below tutorial for adding new models suppport.

(https://llm.mlc.ai/docs/compilation/define_new_models.html)

Ramees025 avatar Apr 19 '24 13:04 Ramees025

It would be nice to update define new models section as well.

MikeLP avatar Apr 22 '24 16:04 MikeLP