Extract last hidden state

[dathudeptrai]

Hi, is there any way to extract the last hidden state (before lm_head dense layer) of the T5, GPT model ?. There are some kind of model need to take the last hidden state of autoregressive model as input, so it is nice if you support return last hidden states of the model.