Gojo Satoru

[Feature]: Implementation of DRY sampler.

5

### 🚀 The feature, motivation and pitch Majority of the bots repeat sentences and due to that, it's annoying. Implementing DRY sampler for Aphrodite Engine. DRY is a sampler that...

### 🚀 The feature, motivation and pitch i've saw you have support for tpus i was happy and excited but then, came to know it does not support tpu v3-8....

[Bug]: Another Bug while starting (Global)

2

### Your current environment ```text kaggle 2 t4s ``` ### 🐛 Describe the bug `WARNING: Casting torch.bfloat16 to torch.float16. WARNING: Gemma 2 uses sliding window attention for every odd layer,...

Feature Request: RPC offloading using a local model copy

9

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...

[2025-03-03 22:24:47] [INFO] Merge configuration saved in /tmp/tmpivxx33fi/merged/config.yaml [2025-03-03 22:24:47] [INFO] Creating repo Control-Lunar-2x8B-v1 [2025-03-03 22:24:48] [INFO] Repo created: https://huggingface.co/Darkknight535/Control-Lunar-2x8B-v1 [2025-03-03 22:24:48] [INFO] Running mergekit-moe config.yaml merge --allow-crimes --lazy-unpickle --lora-merge-cache...

[Usage]: Distributed Inference Without Docker.

3

### Your current environment ```text The output of `python env.py` ``` Not needed ### How would you like to use Aphrodite? I want to run a single model on multiple...

[FEATURE_REQUEST] Support for comfyui save image Websocket

5

### Have you searched for similar requests? Yes ### Is your feature request related to a problem? If so, please describe. I use comfyui through cloud and I don't want...