Alex Mitchell

icon company Vivas Edge LLC icon location Columbus, Ohio icon location Really into machine learning. Currently tinkering with: Tortoise TTS Llama-gpt sdxl

Results 1 issues of Alex Mitchell

Memory Allocation Error

4 comment

Currently, I am only able to get the 7B model running, and it takes 15-20 seconds per token. Docker Desktop shows container memory usage at only 600-800mb / 1.89GB and...