google
The continuity of the conversation is problematic.
Issue
The second question lost its relevance to the first question.
Deatils
For the Early Codes with fb6f266db1bfd7391e70b945dcf8b745c1ebbe09
__ _ ___ _ __ ___ _ __ ___ __ _ ___ _ __ _ __
/ _` |/ _ \ '_ ` _ \| '_ ` _ \ / _` | / __| '_ \| '_ \
| (_| | __/ | | | | | | | | | | (_| || (__| |_) | |_) |
\__, |\___|_| |_| |_|_| |_| |_|\__,_(_)___| .__/| .__/
__/ | | | | |
|___/ |_| |_|
tokenizer : /.../tokenizer.spm
compressed_weights : /.../2b-it.sbs
model : 2b-it
weights : [no path specified]
max_tokens : 3072
max_generated_tokens : 2048
*Usage*
Enter an instruction and press enter (%Q quits).
*Examples*
- Write an email to grandma thanking her for the cookies.
- What are some historical attractions to visit around Massachusetts?
- Compute the nth fibonacci number in javascript.
- Write a standup comedy bit about GPU programming.
> Write a poem with starfield theme.
[ Reading prompt ] ................
Stars ignite the velvet night,
A symphony of light and might.
Whispers of wonder, stories untold,
Echoing through the cosmic fold.
Stars ignite the velvet night,
A symphony of light and might.
Dancing in the cosmic dance,
A celestial ballet, a wondrous trance.
Stars ignite the velvet night,
A symphony of light and might.
Guiding lost souls through the starry sea,
A beacon of hope, a guiding key.
Stars ignite the velvet night,
A symphony of light and might.
A tapestry of wonder, a cosmic sight,
A symphony of light, a starry light.
> 翻译成中文。
[ Reading prompt ] .............
星辰闪烁， velvet 的夜幕，
闪烁的旋律，令人惊叹。
星光在宇宙中闪烁，
闪烁的奇迹，令人醉心。
星辰闪烁， velvet 的夜幕，
闪烁的旋律，令人惊叹。
在宇宙的舞剧中闪烁，
闪烁的奇迹，令人醉心。
星辰闪烁， velvet 的夜幕，
闪烁的旋律，令人惊叹。
引领迷失的灵魂，
在星辰的闪烁中找到希望。
For the Corrent Codes with b6aaf6bbb8a7f0b99330df8710765123ab330766
__ _ ___ _ __ ___ _ __ ___ __ _ ___ _ __ _ __
/ _` |/ _ \ '_ ` _ \| '_ ` _ \ / _` | / __| '_ \| '_ \
| (_| | __/ | | | | | | | | | | (_| || (__| |_) | |_) |
\__, |\___|_| |_| |_|_| |_| |_|\__,_(_)___| .__/| .__/
__/ | | | | |
|___/ |_| |_|
tokenizer : /.../tokenizer.spm
compressed_weights : /.../2b-it.sbs
model : 2b-it
weights : [no path specified]
max_tokens : 3072
max_generated_tokens : 2048
multiturn : 0
*Usage*
Enter an instruction and press enter (%C resets conversation, %Q quits).
Since multiturn is set to 0, conversation will automatically reset every turn.
*Examples*
- Write an email to grandma thanking her for the cookies.
- What are some historical attractions to visit around Massachusetts?
- Compute the nth fibonacci number in javascript.
- Write a standup comedy bit about GPU programming.
> Write a poem with starfield theme.
[ Reading prompt ] ................
Stars ignite the velvet night,
A symphony of light and might.
Whispers of wonder, stories untold,
Echoing through the cosmic fold.
Stars ignite the velvet night,
A symphony of light and might.
Dancing in the cosmic dance,
A celestial ballet, a wondrous trance.
Stars ignite the velvet night,
A symphony of light and might.
Guiding lost souls through the starry sea,
A beacon of hope, a guiding key.
Stars ignite the velvet night,
A symphony of light and might.
A tapestry of wonder, a cosmic sight,
A symphony of light, a starry light.
> 翻译成中文。
[ Reading prompt ] ............
我需要您提供要翻译的文本，以便我为您翻译成中文。请提供文本，我会尽力为您翻译成中文。
>
There are some issues with multiturn continuations that are being worked on but not resolved, so I made the default for it to be off for now. Turning it off resets the conversation (effectively by making the index into the KV cache 0).
You can recover the previous behavior using --multiturn 1 (see --help for all runtime options). If people prefer --multiturn 1 as default, let me know and we can change it back.
Closing for now, but if anyone prefers the default reverted please chime in here.