on windows the llama.exe quits in the middle

[hershkoy]

I am trying to debug what dalai is not working on my windows 10. After running the install and serve, I get the UI, I try to insert a phase to autocomplete, but I am getting gibberish.

Anyway, I have seen the in the background the UI is calling the dalai\alpaca>build\Release\llama.exe.

When I am trying to call that directly, I am getting some output, but right before the model is suppose to print the response it quits.

Any idea why?

[TestCamper]

Something similar happens to me, however it is ending with exit command "PS C:UsersPcdalaialpaca> exit"

[Jafa7]

Me too:

PS C:Usersjafamdalaialpaca> 2009 -> ' request' 7790 -> '.' 29876 -> 'n' 29905 -> '' 29876 -> 'n' 29937 -> '#' 2277 -> '##' 2799 -> ' Inst' 4080 -> 'ruction' 3583 -> ':' 29876 -> 'n' 29958 -> '>' 29925 -> 'P' 3491 -> 'ROM' 7982 -> 'PT' 29905 -> '' 29876 -> 'n' 29905 -> '' 29876 -> 'n' 29937 -> '#' 2277 -> '##' 13291 -> ' Response' 3583 -> ':' 29876 -> 'n'

sampling parameters: temp = 0.800000, top_k = 40, top_p = 0.900000, repeat_last_n = 64, repeat_penalty = 1.300000

PS C:Usersdaldalaialpaca> exit

[hopto-dot]

This happens to me too:

 29876 -> 'n'
 29905 -> ''
 29876 -> 'n'
 29937 -> '#'
  2277 -> '##'
  2799 -> ' Inst'
  4080 -> 'ruction'
 29901 -> ':'
  1724 -> ' What'
   338 -> ' is'
 29871 -> ' '
 29896 -> '1'
 29974 -> '+'
 29896 -> '1'
 29973 -> '?'
 29905 -> ''
 29876 -> 'n'
 29905 -> ''
 29876 -> 'n'
 29937 -> '#'
  2277 -> '##'
 13291 -> ' Response'
  3583 -> ':'
 29876 -> 'n'

sampling parameters: temp = 0.800000, top_k = 40, top_p = 0.900000, repeat_last_n = 64, repeat_penalty = 1.300000


PS C:UsersGeorgedalaialpaca> exit