iasql icon indicating copy to clipboard operation
iasql copied to clipboard

Published 20 hours ago • verified publisher icon alantech

Host gpt3/chatgpt-like on ec2

Open depombo opened this issue 2 years ago • 2 comments

depombo avatar Feb 13 '23 17:02 depombo

Just found this LLM that looks promising -- designed to run on a single GPU instead of a cluster of machines: https://github.com/Ying1123/FlexGen

dfellis avatar Feb 20 '23 19:02 dfellis

This looks as a doable one https://devforth.io/blog/gpt-j-is-a-self-hosted-open-source-analog-of-gpt-3-how-to-run-in-docker/

yrobla avatar Mar 06 '23 16:03 yrobla