Idiot

icon indicating a website link daoguiyixian.icu icon indicating an email [email protected]

icon location Beijing, China icon location Citizen of the North, a fool of the abyss, a master of swordsmanship, a transmitter of the Rodland continent, the reincarnation of Zhenwu, Wang Hui. (Insane

Results 1 issues of Idiot

The TGI loading model consumes all available gpus memory

1 comment

### System Info ## Environments ```bash >> cat docker-compose.yml version: '3.8' services: llama2_api: image: ghcr.io/huggingface/text-generation-inference:1.4 container_name: llama2_api command: --model-id /data/llama2/llama2-chat-13b-hf volumes: - /data/wanghui01/models/:/data/ ports: - "8081:80" environment: NVIDIA_VISIBLE_DEVICES: all CUDA_VISIBLE_DEVICES:...