PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

[GPTJ] add gptj

Open gongel opened this issue 1 year ago β€’ 0 comments

PR types

New features

PR changes

Models

Description

  • Add new model GPTJ
  • Use example
import paddle
from paddlenlp.transformers import GPTJForCausalLM, GPTJTokenizer
tokenizer = GPTJTokenizer.from_pretrained('EleutherAI/gpt-j-6B')
model = GPTJForCausalLM.from_pretrained('EleutherAI/gpt-j-6B')
inputs = tokenizer("Welcome to use PaddlePaddle and PaddleNLP!", return_token_type_ids=False)
inputs = {k:paddle.to_tensor([v]) for (k, v) in inputs.items()}
outputs = model.generate(**inputs)

gongel avatar Jul 14 '22 03:07 gongel

Mv to #3017

gongel avatar Sep 03 '22 15:09 gongel