alpaca-lora icon indicating copy to clipboard operation
alpaca-lora copied to clipboard

Published 20 hours ago • verified publisher icon tloen

simple playground share

Open deep-diver opened this issue 2 years ago • 3 comments
trafficstars

not sure when I am going to shutdown, but I will leave this for few hours at least (running on RTX5000). maybe I will put things up in GKE later for tester purpose

NOTE: didn't do anything about maintaining the context yet

https://notebooksa.jarvislabs.ai/P1lDk5ziArYf6hVUkcne1vVlbwica44Ux7zNWyAeq-c69p-j0D1_ktPMmBKniGk8/

스크린샷 2023-03-16 오전 9 41 13

deep-diver avatar Mar 16 '23 00:03 deep-diver

any tips to speed up the inference speed?

deep-diver avatar Mar 16 '23 00:03 deep-diver

@deep-diver which model is this playground running? also what hardware?

0xbitches avatar Mar 16 '23 01:03 0xbitches

it runs the model shared by @tloen on 7 core CPU / 32GB with a single RTX5000. I am hosting it in jarvislabs.ai

deep-diver avatar Mar 16 '23 01:03 deep-diver