nimble

nimble copied to clipboard

Hi, I'm trying to reproduce nimble's experimental results. However, I found that the effect of multi-stream has little effect on the inference latency, but the paper says that it can...

aodongchen

getting the following error when building nimble in conda enviornment FAILED: caffe2/CMakeFiles/torch_cuda.dir/utils/torch_cuda_generated_math_gpu.cu.o subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '8']' returned non-zero exit status 1.

4

``` [46/402] Building NVCC (Device) object...ils/torch_cuda_generated_math_gpu.cu.o FAILED: caffe2/CMakeFiles/torch_cuda.dir/utils/torch_cuda_generated_math_gpu.cu.o cd /home/umair/Desktop/umair/nimble2/nimble/build/caffe2/CMakeFiles/torch_cuda.dir/utils && /home/umair/anaconda3/envs/nimble/bin/cmake -E make_directory /home/umair/Desktop/umair/nimble2/nimble/build/caffe2/CMakeFiles/torch_cuda.dir/utils/. && /home/umair/anaconda3/envs/nimble/bin/cmake -D verbose:BOOL=OFF -D build_configuration:STRING=Release -D generated_file:STRING=/home/umair/Desktop/umair/nimble2/nimble/build/caffe2/CMakeFiles/torch_cuda.dir/utils/./torch_cuda_generated_math_gpu.cu.o -D generated_cubin_file:STRING=/home/umair/Desktop/umair/nimble2/nimble/build/caffe2/CMakeFiles/torch_cuda.dir/utils/./torch_cuda_generated_math_gpu.cu.o.cubin.txt -P /home/umair/Desktop/umair/nimble2/nimble/build/caffe2/CMakeFiles/torch_cuda.dir/utils/torch_cuda_generated_math_gpu.cu.o.Release.cmake /home/umair/Desktop/umair/nimble2/nimble/caffe2/utils/math_gpu.cu(149): warning: the...

umairjavaid

Thank you for great work. I have a simple question, can I use a pdb in the model with nimble? When I use pdb in the model and do nimble_model.prepare...

ReaperMaKNaE

I have installed nimble using the instruction but when I'm trying to run examples (run_inference.py and run_training.py) I get the following error. `Traceback (most recent call last): File "run_training.py", line...

AmirFB

build without conda

6

## 📚 Documentation Can I have this build without conda? If yes, please specify the steps. Thank you.

ShivaKothuru

I am having trouble installing nimble torch and the torchvision. I have tried to install 0.8.0 and 0.8.2 as well 0.9.0 but everytime i get the torchvision and torch compatibility...

NaveedAI

umairjavaid

ModuleNotFoundError: No module named 'torch._C'

7

Hi, I'm writing in English in case someone else meets the same issue. I built Nimble on a docker container with the identical environment mentioned in the instruction guide except...

beomwookang

Can any deep learning model be used in nimble, such as yolov5??

3

umairjavaid

윈도우에서도 사용가능한가요?

7

윈도우에서도 사용가능한가요? Install 문서를 보니 우분투를 기준으로 작성된 것 같긴한데 윈도우에서도 환경변수 다 설정하고 설치 진행하면 사용가능할까요..? Tensorrt의 공식 문서에서 윈도우 파이썬에선 동작하지 않는다 그래서 대체제를 찾고있다 생각이나서 들렀습니다 휴

blackCmd