Ma Jiayu

Error happens when running examples with multi-gpu

2

Expect to using **DataParallel** and **DistributedDataParallel** in examples/sequence_classification/LoRA.ipynb For **DP**, only add one line ``` model = torch.nn.DataParallel(model.cuda(),device_ids=[0,1], output_device=gpus[0]) ``` get error: **RuntimeError: Expected all tensors to be on the...

LLaMA-7B-q4 inference only 4 threads are used

1

**LocalAI version:** Jun 8, 2023 **Environment, CPU architecture, OS, and Version:** Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz **Describe the bug** ggml-model-q4_0.bin ``` docker-compose up -d --pull always curl http://localhost:8080/v1/completions...

To learn a latent code using your model: 1. What scale should I set my custom point cloud dataset to? [-1, 1] or [0, 1]? 2. Which axises should the...