automaticcat comments

Results 98 comments of


                                            automaticcat

Change model license to Apache License, Version 2.0

LGTM

Suggestion: Stable Diffusion Model

hi thumb up for this

epic: Jan Studio (users can finetune)

Is OpenAI compatible is strictly needed in this usecase

bug: model can't be loaded on linux mint 20.3 (version `GLIBC_2.32' not found)

@hiento09 we might not be able to statically link glibc, we might need to support multiple version build

epic: support AMD (vulkan, rocm, etc)

https://rocm.docs.amd.com/projects/install-on-windows/en/latest/reference/system-requirements.html

epic: support AMD (vulkan, rocm, etc)

list of supported amd gpus

epic: support AMD (vulkan, rocm, etc)

hi @0xSage we have built the amd image already but have no gpu to test

feat: Threads can override and inherit default params from Assistants, Models, and Engine

@dan-jan for current release there will be no different in settings for different hardwares, mostly already automatically handled at build time

feat: Threads can override and inherit default params from Assistants, Models, and Engine

important asset reference for prompt template: https://github.com/mounta11n/plusplus-caMalL/blob/4fa32ad0e3b61a6e13cdb6261723b6fd608a0fad/examples/server/public/promptFormats.js#L15

feat: Threads can override and inherit default params from Assistants, Models, and Engine

Q:Where are these prompt template coming from? Most of community projects now using TheBloke metadata as referrence, example. https://huggingface.co/TheBloke/LLaMA2-13B-Psyfighter2-AWQ#prompt-template-alpaca-tiefighter