ye7love7

可以使用chatglm的微调数据集吗？

3

content和summary的格式？

[Bug] 使用docker部署internlm/internlm-xcomposer-vl-7b和internlm/internlm-xcomposer2-vl-7b均报错

1

### Checklist - [X] 1. I have searched related issues but cannot get the expected help. - [X] 2. The bug has not been fixed in the latest version. ###...

Do I need to download a model and then specify environment variables? Where do I go to download the model? https://github.com/coqui-ai/TTS?

qwen1.5如何在t4卡中运行？

2

T4卡不能装cu12，无法安装torch2.1，我很好奇有人用t4启动了千问1.5的模型，是因为忽略新版transformers的torch冲突吗？

I just want to start a service that uses the openai big model interface, what should I do?

1

quick start only Provides commands to start large models at the same time, I want to simply start a service and use the openai interface provided by vllm or ollama,...

deepseek-v2-chat,236B的那个模型没有支持

3

236B的那个模型没有支持 _Originally posted by @ye7love7 in https://github.com/xorbitsai/inference/issues/1440#issuecomment-2241949040_

Manual install, and Adding Ollama as a startup service (recommended) but Error: could not connect to ollama app, is it running?

3

显卡“：单卡3090 24G，内存：250G 按照https://github.com/ollama/ollama/blob/main/docs/linux.md执行了安装，并且添加了startup service： ``` sudo nano /etc/systemd/system/ollama.service [Unit] Description=Ollama Service After=network-online.target [Service] # 设置 GPU 加载层数 # Environment="OLLAMA_GPU_LAYERS=10" # 设置 keep-alive 时间为 10 分钟 Environment="OLLAMA_KEEP_ALIVE=10m" # 设置 host 和...