Can not reproduce the results on the paper with 65B ckpt?

[Ageliss]

When we tried to perfrom the Qs in the appendix of the llama paper, we found that it was just repeating... Anything needs to adjust? top_p? temperature?

Q1: The sun goes down, and finally Gauss and Curie find time to relax and discuss after an exhausting day of work.

Gauss: I’m so tired. I’ve been working on this problem for hours.

Curie: I know what you mean. I’ve been working on this problem for hours too.

Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too.

Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too. Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too.

Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too. Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too. Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too.

Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too. Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too. Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too. Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too.

Gauss: I’m so tired. I’ve been working on this problem for hours. Curie: I know what you mean. I’ve been working on this problem for hours too. Gauss: I’m so tired. I’ve

Q2: An hilarious scene between Jerry and George where George presents his new AI watch to Jerry.

George: I’m telling you, Jerry, this is the future.

Jerry: I don’t know, George. I’m not sure I want to be a part of the future.

George: You’re not going to be a part of the future. You’re going to be a part of the present.

Jerry: I know, but I don’t want to be a part of the present either.

George: Well, you’re not going to be a part of the past.

Jerry: I know, but I don’t want to be a part of the past.

George: Well, what do you want to be a part of?

Jerry: I want to be a part of the future.

George: You can’t be a part of the future. You just said you didn’t want to be a part of the future.

Jerry: I don’t want to be a part of the present.

George: Well, you can’t be a part of the present. You’re already a part of the present.

Jerry: I know, but I don’t want to be a part of the present.

George: Well, you can’t be a part of the past.

Jerry: I know, but I don’t want to be a part of the past.

George: Well, you can’t be a part of the future.

Jerry: I know, but I don’t want to be a part of the future.

George: Well, you can’t be a part of the present.

Jerry: I know, but I don’t want to be a part of the present.

George: Well, you can’t be a part of the past.

Jerry: I know, but I don’t want to be a part of the past.

George: Well, you can’t be a part of the future.

Jerry: I know, but I don’t want to be a part of the future.

George: Well, you can’t be a part of the present.

Jerry: I know, but I don’t want to be a part of the present.

George: Well, you can

[ShomyLiu]

It seems it is unstable since the generation contents would be quite different if running multiple times. The output here is

An hilarious scene between Jerry and George where George presents his new AI watch to Jerry.
George has an idea of an AI watch and he and Jerry decide to make one. Jerry is sceptical.
George: All right. Well, you know, I do have one more idea that might work.
Jerry: Oh really? I’m all ears.
George: Well, it’s an idea for a watch.
Jerry: Watches are in.
George: No, no, no. Not a watch that tells time.
Jerry: Oh.
George: A watch that thinks.
Jerry: A watch that thinks?
George: Yeah. You know, a computer watch. A watch that thinks.
Jerry: Computer watch.
George: Yeah. It tells you the weather and stuff.
Jerry: You mean like a calculator watch?
George: No, no, no. I mean a watch that’s got a chip in it, you know, a microchip. It’s got artificial intelligence.
Jerry: Artificial intelligence?
Jerry: You mean like a computer watch?
George: Yeah, well, not exactly. It’s a watch, but it’s not exactly a watch.
Jerry: What is it, then?
George: It’s a watch that’s got artificial intelligence in it.
Jerry: But what is it?
George: It’s a watch that tells you stuff.
Jerry: But what does it do?
George: It’s a watch that does stuff.
Jerry: Stuff?
George: Yeah. It’s a watch that can do stuff.
Jerry: It’s a watch?
George: Yeah, but it’s not exactly a watch.
Jerry: So it’s a watch.
George: It’s a watch, but it’s not exactly a watch.
Jerry: It’s a watch.
George: It’s a watch, but it’s not exactly a watch. It’s a watch that thinks.
Jerry: It’s a watch?
George: Yeah, but it’s not exactly a watch.
Jerry: All right. I’ll bite. Why is it not exactly a watch?
George: Because it’s a watch that thinks.
Jerry: It’s a watch that thinks?
Jerry: What does it do?
George: It tells you stuff.
Jerry: Like what?
George: Like sports scores, and weather, and things like that.
Jerry: And how does it do that?
George: It’s a watch that does stuff. It has a chip in it.
Jerry: A computer chip?
George: Yeah, a microchip.
Jerry: Computer chip.
George: It’s a watch that can do stuff.
Jerry: It’s a watch that can do stuff?
Jerry: It’s a watch that can do stuff, but it’s not exactly a watch?
Jerry: How does it do stuff?
George: It has a computer chip in it.
Jerry: It’s a computer watch?
George: Yeah, but it’s not exactly a computer watch.
Jerry: It’s a watch that does stuff?
George: Yeah, but it’s not exactly a computer watch. It’s a watch that can do stuff.
Jerry: So it’s a watch that can do stuff?