l0rinc

Same on the trained LoRA model: ``` Traceback (most recent call last): File "/content/llama_lora/llama_lora/lib/streaming_generation_utils.py", line 47, in gentask ret = self.mfunc(callback=_callback, **self.kwargs) File "/content/llama_lora/llama_lora/lib/inference.py", line 59, in generate_with_callback generation_output =...

I personally just abort when I see something behaving differently - and `rm -rfd` from colab's terminal manually. Maybe a "would you like to overwrite" or "rename old one" could...

Not the browser profile, the colab account, i.e. it seems I can only use the same drive that belongs to the Colab pro account

I can't seem to run any of the docker images locally for 32a367738c6db7430780058c4a6c98b271af73b2, the errors suggest that the linker is unable to find the necessary symbols from the uWebSockets library....

Fixed in https://github.com/hoytech/strfry/pull/115

utACK 40ac07ef45f6de0ac6a13e34797387a6ee140de9

ACK c6eca6f3961d780d6a395c3346e44be1a0072f08

Thanks for the review @josibake, I've added the conclusions of the benchmarks to the commit message (but copied it to the PR description as well now), can you please check...

Moved the benchmark out to https://gist.github.com/paplorinc/812007eef71d5285be0654375ea3e03e

While I understand why @maflcko doesn't want to change twice, this seems to me like a slight improvement. utACK b7aae361b273f2f439d3b278214b7e37908c8cb0