Arthur.Ling

[QST]Could not find compiler set in environment variable CUDACXX:

3

I can use nvcc in my environment, but when I run "cmake .. -DCUTLASS_NVCC_ARCHS=80", an error happens: -- CMake Version: 3.18.2 CMake Error at /usr/share/cmake/Modules/CMakeDetermineCUDACompiler.cmake:25 (message): Could not find compiler...

Hi, I was trying to quantize OPT-13B in 8bits(W/A), but there is an error--'run out of memory(128G)'. So I want to know do you have the same problem? Or do...

how to reproduce ppl of wikitext2?

1

Is there any demos for ppl test of wikitext2?

When I try " CUDA_VISIBLE_DEVICES=0 python run.py --arch roberta_base --task STS-B(or SST-2)", there are always "FileNotFoundError: [Errno 2] No such file or directory: 'STS-B-bin/label/dict.txt'", but the glue_dataset is downloaded. How...

" CUDA_VISIBLE_DEVICES=0 python main.py \ --model /home/Projects/model_zoo/facebook/opt-30b \ --epochs 20 --output_dir ./log/opt-30b-w6a6 \ --wbits 6 --abits 6 --lwc --let --alpha 0.75 --eval_ppl \ --net opt-30b " When I use omniquant...

AttributeError: 'Attention' object has no attribute 'reduction'

1

When I try to run the code, there is a problem in line 117 of test_quant.py "next_module = father_module.reduction". my shell is "python test_quant.py --model deit_small --dataset /root/data/Imagenet". Is there...