FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

why the model output text is meaningless?

Open YuanCao1996 opened this issue 1 year ago • 2 comments

python3 -m fastchat.serve.test_message --model-name vicuna-7b Models: ['vicuna-7b'] worker_addr: http://localhost:21002 A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions. Human: What are the key differences between renewable and non-renewable energy sources? Assistant: Renewable energy sources are those that can be replenished naturally in a relatively short amount of time, such as solar, wind, hydro, geothermal, and biomass. Non-renewable energy sources, on the other hand, are finite and will eventually be depleted, such as coal, oil, and natural gas. Here are some key differences between renewable and non-renewable energy sources:

  1. Availability: Renewable energy sources are virtually inexhaustible, while non-renewable energy sources are finite and will eventually run out.
  2. Environmental impact: Renewable energy sources have a much lower environmental impact than non-renewable sources, which can lead to air and water pollution, greenhouse gas emissions, and other negative effects.
  3. Cost: Renewable energy sources can be more expensive to initially set up, but they typically have lower operational costs than non-renewable sources.
  4. Reliability: Renewable energy sources are often more reliable and can be used in more remote locations than non-renewable sources.
  5. Flexibility: Renewable energy sources are often more flexible and can be adapted to different situations and needs, while non-renewable sources are more rigid and inflexible.
  6. Sustainability: Renewable energy sources are more sustainable over the long term, while non-renewable sources are not, and their depletion can lead to economic and social instability.

Human: Tell me a story with more than 1000 words. Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently races nyelvenিnit Thé Tas possibility häufig información parti whis

YuanCao1996 avatar Apr 17 '23 12:04 YuanCao1996

the model is vicuna7B v0

YuanCao1996 avatar Apr 17 '23 12:04 YuanCao1996

the model is vicuna7B v0

I used the model vicuna13B v1.1 but the same problem doesn't be solved.

MeMeTaTa avatar Apr 20 '23 09:04 MeMeTaTa

Please use v1.1 weight meanwhile use the latest version of fastchat and transformers.

zhisbug avatar May 08 '23 08:05 zhisbug