Sean Moriarity

icon indicating a website link https://www.seanmoriarity.com icon indicating an email [email protected]

Results 111 issues of Sean Moriarity

Support local model repositories

2 comment

Support vision-text models

Add prefix caching

Official docker image

Support configurable generation options

Support guidance-based decoding

Add speculative decoding

Support configurable quantization schemes

Add response caching

Setup CI/CD