shizhediao

Today, while processing `ultrachat` data, I encountered an error with lmflow’s `load_data` as follows: > Generating train split: 0 examples [02:27, ? examples/s] > [rank7]: Traceback (most recent call last):...

How to add a model that is not in vllm

5

Hi, I am evaluating a new model which is not in vllm. How can I generate responses with this model since I find vllm is the only way for generate()?...

Thanks for your great work! From https://github.com/huggingface/cosmopedia/tree/main/evaluation#benchmark-evaluation, is this the exact command you are using for evaluation? Because I found most of them are 0-shot which is inconsistent with the...

How to look into the processed data?

3

Hi, After running `tokenize_from_hf_to_s3.py`, I would like to inspect the resulting data. But I find that the current data is in a binary file (`.ds`). is there a way to...

Multi-node parallelism on slurm clusters

6

Hi, Let's say, I have a slurm cluster that contains 100 nodes, each node has 100 cores. Assuming I have 10000 tasks. This is my current code: ``` dist_executor =...

fatal error: cublas_v2.h: No such file or directory

6

gcc -pthread -B /home/sdiaoaa/.conda/envs/domains/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/sdiaoaa/.conda/ envs/domains/lib/python3.7/site-packages/torch/include -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/sdiaoaa/.conda/e nvs/domains/lib/python3.7/site-packages/torch/include/TH -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/THC -I/home/sdiaoaa/.conda/envs/domains/inclu de/python3.7m -c csrc/flatten_unflatten.cpp -o build/temp.linux-x86_64-3.7/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX 11_ABI=1 -std=c++11...