error while training

[Vinaygoudasp7]

Prerequisite

• [x] I have searched the existing and past issues but cannot get the expected help.
• [x] I have read the FAQ documentation but cannot get the expected help.
• [x] The bug has not been fixed in the latest version.

🐞 Describe the bug

while i train model i get error

Environment

(mmopenlab) gpu-server@gpu-server:~/mmyolo_model_training/mmyolo$ python tools/train.py configs/yolov8/yolov8_n_syncbn_fast_8*b16-500e_customdataser.py Traceback (most recent call last): File "/home/gpu-server/mmyolo_model_training/mmyolo/tools/train.py", line 13, in from mmyolo.utils import is_metainfo_lower File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/utils/init.py", line 3, in from .misc import is_metainfo_lower, switch_to_deploy File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/utils/misc.py", line 10, in from mmyolo.models import RepVGGBlock File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/models/init.py", line 2, in from .backbones import * # noqa: F401,F403 File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/models/backbones/init.py", line 3, in from .csp_darknet import YOLOv5CSPDarknet, YOLOv8CSPDarknet, YOLOXCSPDarknet File "/home/gpu-server/mmyolo_model_training/mmyolo/mmyolo/models/backbones/csp_darknet.py", line 7, in from mmdet.models.backbones.csp_darknet import CSPLayer, Focus File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/init.py", line 2, in from .backbones import * # noqa: F401,F403 File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/backbones/init.py", line 2, in from .csp_darknet import CSPDarknet File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/backbones/csp_darknet.py", line 11, in from ..layers import CSPLayer File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/layers/init.py", line 3, in from .bbox_nms import fast_nms, multiclass_nms File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmdet/models/layers/bbox_nms.py", line 5, in from mmcv.ops.nms import batched_nms File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmcv/ops/init.py", line 2, in from .active_rotated_filter import active_rotated_filter File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmcv/ops/active_rotated_filter.py", line 10, in ext_module = ext_loader.load_ext( File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/site-packages/mmcv/utils/ext_loader.py", line 13, in load_ext ext = importlib.import_module('mmcv.' + name) File "/home/gpu-server/anaconda3/envs/mmopenlab/lib/python3.10/importlib/init.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) ModuleNotFoundError: No module named 'mmcv._ext'

below is my env list (mmopenlab) gpu-server@gpu-server:~/mmyolo_model_training/mmyolo$ conda list

packages in environment at /home/gpu-server/anaconda3/envs/mmopenlab:

Name Version Build Channel

_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
addict 2.4.0 pypi_0 pypi albucore 0.0.24 pypi_0 pypi albumentations 2.0.8 pypi_0 pypi aliyun-python-sdk-core 2.16.0 pypi_0 pypi aliyun-python-sdk-kms 2.16.5 pypi_0 pypi annotated-types 0.7.0 pypi_0 pypi anyio 4.9.0 pypi_0 pypi argon2-cffi 23.1.0 pypi_0 pypi argon2-cffi-bindings 21.2.0 pypi_0 pypi arrow 1.3.0 pypi_0 pypi asttokens 3.0.0 pypi_0 pypi async-lru 2.0.5 pypi_0 pypi attrs 25.3.0 pypi_0 pypi babel 2.17.0 pypi_0 pypi beautifulsoup4 4.13.4 pypi_0 pypi binutils_impl_linux-64 2.40 h5293946_0
binutils_linux-64 2.40 hb3c18ed_9 conda-forge blas 1.0 mkl
bleach 6.2.0 pypi_0 pypi brotli-python 1.0.9 py310h6a678d5_9
bzip2 1.0.8 h5eee18b_6
ca-certificates 2025.4.26 hbd8a1cb_0 conda-forge certifi 2025.4.26 pyhd8ed1ab_0 conda-forge cffi 1.17.1 pypi_0 pypi charset-normalizer 3.3.2 pyhd3eb1b0_0
click 8.2.1 pypi_0 pypi colorama 0.4.6 pypi_0 pypi comm 0.2.2 pypi_0 pypi contourpy 1.3.2 pypi_0 pypi crcmod 1.7 pypi_0 pypi cryptography 45.0.3 pypi_0 pypi cuda-cccl 11.8.89 0 nvidia/label/cuda-11.8.0 cuda-command-line-tools 11.8.0 0 nvidia/label/cuda-11.8.0 cuda-compiler 11.8.0 0 nvidia/label/cuda-11.8.0 cuda-cudart 11.8.89 0 nvidia/label/cuda-11.8.0 cuda-cudart-dev 11.8.89 0 nvidia/label/cuda-11.8.0 cuda-cuobjdump 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-cupti 11.8.87 0 nvidia/label/cuda-11.8.0 cuda-cuxxfilt 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-documentation 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-driver-dev 11.8.89 0 nvidia/label/cuda-11.8.0 cuda-gdb 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-libraries 11.8.0 0 nvidia/label/cuda-11.8.0 cuda-libraries-dev 11.8.0 0 nvidia/label/cuda-11.8.0 cuda-memcheck 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-nsight 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-nsight-compute 11.8.0 0 nvidia/label/cuda-11.8.0 cuda-nvcc 11.8.89 0 nvidia/label/cuda-11.8.0 cuda-nvdisasm 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-nvml-dev 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-nvprof 11.8.87 0 nvidia/label/cuda-11.8.0 cuda-nvprune 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-nvrtc 11.8.89 0 nvidia/label/cuda-11.8.0 cuda-nvrtc-dev 11.8.89 0 nvidia/label/cuda-11.8.0 cuda-nvtx 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-nvvp 11.8.87 0 nvidia/label/cuda-11.8.0 cuda-profiler-api 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-sanitizer-api 11.8.86 0 nvidia/label/cuda-11.8.0 cuda-toolkit 11.8.0 0 nvidia/label/cuda-11.8.0 cuda-tools 11.8.0 0 nvidia/label/cuda-11.8.0 cuda-visual-tools 11.8.0 0 nvidia/label/cuda-11.8.0 cycler 0.12.1 pypi_0 pypi debugpy 1.8.14 pypi_0 pypi decorator 5.2.1 pypi_0 pypi defusedxml 0.7.1 pypi_0 pypi exceptiongroup 1.3.0 pypi_0 pypi executing 2.2.0 pypi_0 pypi fastjsonschema 2.21.1 pypi_0 pypi ffmpeg 4.3 hf484d3e_0 pytorch filelock 3.14.0 pypi_0 pypi fonttools 4.58.1 pypi_0 pypi fqdn 1.5.1 pypi_0 pypi freetype 2.13.3 h4a9f257_0
fsspec 2025.5.1 pypi_0 pypi gcc_impl_linux-64 15.1.0 h4393ad2_2 conda-forge gcc_linux-64 15.1.0 h6005d9a_10 conda-forge gds-tools 1.4.0.31 0 nvidia/label/cuda-11.8.0 giflib 5.2.2 h5eee18b_0
gmp 6.3.0 h6a678d5_0
gmpy2 2.2.1 py310h5eee18b_0
gnutls 3.6.15 he1e5248_0
gxx_impl_linux-64 15.1.0 h6a1bac1_2 conda-forge gxx_linux-64 15.1.0 h92237c4_10 conda-forge h11 0.16.0 pypi_0 pypi httpcore 1.0.9 pypi_0 pypi httpx 0.28.1 pypi_0 pypi idna 3.7 py310h06a4308_0
intel-openmp 2023.1.0 hdb19cb5_46306
ipykernel 6.29.5 pypi_0 pypi ipython 8.36.0 pypi_0 pypi isoduration 20.11.0 pypi_0 pypi jedi 0.19.2 pypi_0 pypi jinja2 3.1.6 py310h06a4308_0
jmespath 0.10.0 pypi_0 pypi jpeg 9e h5eee18b_3
json5 0.12.0 pypi_0 pypi jsonpointer 3.0.0 pypi_0 pypi jsonschema 4.24.0 pypi_0 pypi jsonschema-specifications 2025.4.1 pypi_0 pypi jupyter-client 8.6.3 pypi_0 pypi jupyter-core 5.8.1 pypi_0 pypi jupyter-events 0.12.0 pypi_0 pypi jupyter-lsp 2.2.5 pypi_0 pypi jupyter-server 2.16.0 pypi_0 pypi jupyter-server-terminals 0.5.3 pypi_0 pypi jupyterlab 4.4.3 pypi_0 pypi jupyterlab-pygments 0.3.0 pypi_0 pypi jupyterlab-server 2.27.3 pypi_0 pypi kernel-headers_linux-64 3.10.0 he073ed8_18 conda-forge kiwisolver 1.4.8 pypi_0 pypi lame 3.100 h7b6447c_0
lcms2 2.16 h92b89f2_1
ld_impl_linux-64 2.40 h12ee557_0
lerc 4.0.0 h6a678d5_0
libcublas 11.11.3.6 0 nvidia/label/cuda-11.8.0 libcublas-dev 11.11.3.6 0 nvidia/label/cuda-11.8.0 libcufft 10.9.0.58 0 nvidia/label/cuda-11.8.0 libcufft-dev 10.9.0.58 0 nvidia/label/cuda-11.8.0 libcufile 1.4.0.31 0 nvidia/label/cuda-11.8.0 libcufile-dev 1.4.0.31 0 nvidia/label/cuda-11.8.0 libcurand 10.3.0.86 0 nvidia/label/cuda-11.8.0 libcurand-dev 10.3.0.86 0 nvidia/label/cuda-11.8.0 libcusolver 11.4.1.48 0 nvidia/label/cuda-11.8.0 libcusolver-dev 11.4.1.48 0 nvidia/label/cuda-11.8.0 libcusparse 11.7.5.86 0 nvidia/label/cuda-11.8.0 libcusparse-dev 11.7.5.86 0 nvidia/label/cuda-11.8.0 libdeflate 1.22 h5eee18b_0
libffi 3.4.4 h6a678d5_1
libgcc 15.1.0 h767d61c_2 conda-forge libgcc-devel_linux-64 15.1.0 h4c094af_102 conda-forge libgcc-ng 15.1.0 h69a702a_2 conda-forge libgomp 15.1.0 h767d61c_2 conda-forge libiconv 1.16 h5eee18b_3
libidn2 2.3.4 h5eee18b_0
libjpeg-turbo 2.0.0 h9bf148f_0 pytorch libnpp 11.8.0.86 0 nvidia/label/cuda-11.8.0 libnpp-dev 11.8.0.86 0 nvidia/label/cuda-11.8.0 libnvjpeg 11.9.0.86 0 nvidia/label/cuda-11.8.0 libnvjpeg-dev 11.9.0.86 0 nvidia/label/cuda-11.8.0 libpng 1.6.39 h5eee18b_0
libsanitizer 15.1.0 h97b714f_2 conda-forge libstdcxx 15.1.0 h8f9b012_2 conda-forge libstdcxx-devel_linux-64 15.1.0 h4c094af_102 conda-forge libstdcxx-ng 11.2.0 h1234567_1
libtasn1 4.19.0 h5eee18b_0
libtiff 4.7.0 hde9077f_0
libunistring 0.9.10 h27cfd23_0
libuuid 1.41.5 h5eee18b_0
libwebp 1.3.2 h9f374a3_1
libwebp-base 1.3.2 h5eee18b_1
llvm-openmp 14.0.6 h9e868ea_0
lz4-c 1.9.4 h6a678d5_1
markdown 3.8 pypi_0 pypi markdown-it-py 3.0.0 pypi_0 pypi markupsafe 3.0.2 py310h5eee18b_0
matplotlib 3.10.3 pypi_0 pypi matplotlib-inline 0.1.7 pypi_0 pypi mdurl 0.1.2 pypi_0 pypi mistune 3.1.3 pypi_0 pypi mkl 2023.1.0 h213fc3f_46344
mkl-service 2.4.0 py310h5eee18b_2
mkl_fft 1.3.11 py310h5eee18b_0
mkl_random 1.2.8 py310h1128e8f_0
mmcv 2.0.1 pypi_0 pypi mmdet 3.0.0 pypi_0 pypi mmengine 0.7.1 pypi_0 pypi mmyolo 0.6.0 dev_0 model-index 0.1.11 pypi_0 pypi mpc 1.3.1 h5eee18b_0
mpfr 4.2.1 h5eee18b_0
mpmath 1.3.0 py310h06a4308_0
nbclient 0.10.2 pypi_0 pypi nbconvert 7.16.6 pypi_0 pypi nbformat 5.10.4 pypi_0 pypi ncurses 6.4 h6a678d5_0
nest-asyncio 1.6.0 pypi_0 pypi nettle 3.7.3 hbbd107a_1
networkx 3.4.2 py310h06a4308_0
ninja 1.11.1.4 pypi_0 pypi notebook-shim 0.2.4 pypi_0 pypi nsight-compute 2022.3.0.22 0 nvidia/label/cuda-11.8.0 numpy 1.26.4 pypi_0 pypi nvidia-cublas-cu11 11.11.3.6 pypi_0 pypi nvidia-cuda-cupti-cu11 11.8.87 pypi_0 pypi nvidia-cuda-nvrtc-cu11 11.8.89 pypi_0 pypi nvidia-cuda-runtime-cu11 11.8.89 pypi_0 pypi nvidia-cudnn-cu11 8.7.0.84 pypi_0 pypi nvidia-cufft-cu11 10.9.0.58 pypi_0 pypi nvidia-curand-cu11 10.3.0.86 pypi_0 pypi nvidia-cusolver-cu11 11.4.1.48 pypi_0 pypi nvidia-cusparse-cu11 11.7.5.86 pypi_0 pypi nvidia-nccl-cu11 2.19.3 pypi_0 pypi nvidia-nvtx-cu11 11.8.86 pypi_0 pypi opencv-python 4.11.0.86 pypi_0 pypi opendatalab 0.0.10 pypi_0 pypi openh264 2.1.1 h4ff587b_0
openjpeg 2.5.2 h0d4d230_1
openmim 0.3.9 pypi_0 pypi openssl 3.5.0 h7b32b05_1 conda-forge openxlab 0.1.2 pypi_0 pypi ordered-set 4.1.0 pypi_0 pypi oss2 2.17.0 pypi_0 pypi overrides 7.7.0 pypi_0 pypi packaging 24.2 pypi_0 pypi pandas 2.2.3 pypi_0 pypi pandocfilters 1.5.1 pypi_0 pypi parso 0.8.4 pypi_0 pypi pexpect 4.9.0 pypi_0 pypi pillow 11.1.0 py310hac6e08b_1
pip 23.0.1 pypi_0 pypi platformdirs 4.3.8 pypi_0 pypi prettytable 3.16.0 pypi_0 pypi prometheus-client 0.22.0 pypi_0 pypi prompt-toolkit 3.0.51 pypi_0 pypi psutil 7.0.0 pypi_0 pypi ptyprocess 0.7.0 pypi_0 pypi pure-eval 0.2.3 pypi_0 pypi pycocotools 2.0.9 pypi_0 pypi pycparser 2.22 pypi_0 pypi pycryptodome 3.23.0 pypi_0 pypi pydantic 2.11.5 pypi_0 pypi pydantic-core 2.33.2 pypi_0 pypi pygments 2.19.1 pypi_0 pypi pyparsing 3.2.3 pypi_0 pypi pysocks 1.7.1 py310h06a4308_0
pytest-runner 6.0.1 pypi_0 pypi python 3.10.16 he870216_1
python-dateutil 2.9.0.post0 pypi_0 pypi python-json-logger 3.3.0 pypi_0 pypi pytorch-mutex 1.0 cuda pytorch pytz 2023.4 pypi_0 pypi pyyaml 6.0.2 py310h5eee18b_0
pyzmq 26.4.0 pypi_0 pypi readline 8.2 h5eee18b_0
referencing 0.36.2 pypi_0 pypi requests 2.28.2 pypi_0 pypi rfc3339-validator 0.1.4 pypi_0 pypi rfc3986-validator 0.1.1 pypi_0 pypi rich 13.4.2 pypi_0 pypi rpds-py 0.25.1 pypi_0 pypi scipy 1.15.3 pypi_0 pypi send2trash 1.8.3 pypi_0 pypi setuptools 60.2.0 pypi_0 pypi shapely 2.1.1 pypi_0 pypi simsimd 6.2.1 pypi_0 pypi six 1.17.0 pypi_0 pypi sniffio 1.3.1 pypi_0 pypi soupsieve 2.7 pypi_0 pypi sqlite 3.45.3 h5eee18b_0
stack-data 0.6.3 pypi_0 pypi stringzilla 3.12.5 pypi_0 pypi sympy 1.13.1 pypi_0 pypi sysroot_linux-64 2.17 h0157908_18 conda-forge tabulate 0.9.0 pypi_0 pypi tbb 2021.8.0 hdb19cb5_0
termcolor 3.1.0 pypi_0 pypi terminado 0.18.1 pypi_0 pypi terminaltables 3.1.10 pypi_0 pypi tinycss2 1.4.0 pypi_0 pypi tk 8.6.14 h39e8969_0
tomli 2.2.1 pypi_0 pypi torch 2.2.2+cu118 pypi_0 pypi torchaudio 2.2.2+cu118 pypi_0 pypi torchvision 0.17.2+cu118 pypi_0 pypi tornado 6.5.1 pypi_0 pypi tqdm 4.65.2 pypi_0 pypi traitlets 5.14.3 pypi_0 pypi triton 2.2.0 pypi_0 pypi types-python-dateutil 2.9.0.20250516 pypi_0 pypi typing-inspection 0.4.1 pypi_0 pypi typing_extensions 4.12.2 py310h06a4308_0
tzdata 2025.2 pypi_0 pypi uri-template 1.3.0 pypi_0 pypi urllib3 1.26.20 pypi_0 pypi wcwidth 0.2.13 pypi_0 pypi webcolors 24.11.1 pypi_0 pypi webencodings 0.5.1 pypi_0 pypi websocket-client 1.8.0 pypi_0 pypi wheel 0.45.1 py310h06a4308_0
xz 5.6.4 h5eee18b_1
yaml 0.2.5 h7b6447c_0
yapf 0.43.0 pypi_0 pypi zlib 1.2.13 h5eee18b_1
zstd 1.5.6 hc292b87_0

Additional information

No response