nvImageCodec icon indicating copy to clipboard operation
nvImageCodec copied to clipboard

Memory leak when running in thread

Open roelmops opened this issue 4 months ago • 0 comments

Version

0.2.0

Describe the bug.

When I instantiate the nvImageCodec encoder for a second time in a thread, memory is not released. Which is more than 1 GB.

Minimum reproducible example


import os
import threading
import time

import numpy as np
import psutil
from nvidia import nvimgcodec

process = psutil.Process(os.getpid())
image_encoder = nvimgcodec.Encoder()
array = (np.random.rand(500, 500, 3) * 255).astype(np.uint8)
nvim = nvimgcodec.as_image(array)

def encode():

    image_encoder = nvimgcodec.Encoder()
    image_encoder.encode(nvim, "jpeg")


print("Process memory:")
print(f"Before encode in main thread: {process.memory_info().rss / (1024 * 1024):.2f} MB")

encode()

print(f"After encode in main thead:   {process.memory_info().rss / (1024 * 1024):.2f} MB")

thread = threading.Thread(target=encode)
thread.start()
thread.join()

print(f"After encode in sub thread:   {process.memory_info().rss / (1024 * 1024):.2f} MB")

Environment details

 ***OS Information***
 DISTRIB_ID=Ubuntu
 DISTRIB_RELEASE=20.04
 DISTRIB_CODENAME=focal
 DISTRIB_DESCRIPTION="Ubuntu 20.04.6 LTS"
 NAME="Ubuntu"
 VERSION="20.04.6 LTS (Focal Fossa)"
 ID=ubuntu
 ID_LIKE=debian
 PRETTY_NAME="Ubuntu 20.04.6 LTS"
 VERSION_ID="20.04"
 Linux <removed> 5.4.0-165-generic #182-Ubuntu SMP Mon Oct 2 19:43:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
 
 ***GPU Information***
 Tue Oct  8 09:01:04 2024
 +-----------------------------------------------------------------------------------------+
 | NVIDIA-SMI 550.54.14              Driver Version: 550.54.14      CUDA Version: 12.4     |
 |-----------------------------------------+------------------------+----------------------+
 | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
 | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
 |=========================================+========================+======================|
 |   0  NVIDIA GeForce RTX 2080 Ti     Off |   00000000:1B:00.0 Off |                  N/A |
 | 31%   29C    P8              3W /  250W |       0MiB /  11264MiB |      0%      Default |
 +-----------------------------------------+------------------------+----------------------+
 
 +-----------------------------------------------------------------------------------------+
 | Processes:                                                                              |
 |  No running processes found                                                             |
 +-----------------------------------------------------------------------------------------+

 ***CPU***
 Architecture:                       x86_64
 CPU(s):                             64
 Model name:                         Intel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz
 CPU MHz:                            3196.828
 CPU max MHz:                        3900.0000
 NUMA node0 CPU(s):                  0-15,32-47
 NUMA node1 CPU(s):                  16-31,48-63
 L1d cache:                          1 MiB
 L1i cache:                          1 MiB
 L2 cache:                           32 MiB
 L3 cache:                           44 MiB
 
 ***CMake***
 cmake version 3.29.3

 ***g++***
 g++ (conda-forge gcc 11.3.0-19) 11.3.0
 
 ***nvcc***
 nvcc: NVIDIA (R) Cuda compiler driver
 Cuda compilation tools, release 11.7, V11.7.99

 ***Python***
 Python 3.10.10


 ***conda packages***

 _libgcc_mutex             0.1                 conda_forge    conda-forge
 _openmp_mutex             4.5                  2_kmp_llvm    conda-forge
 absl-py                   2.1.0                    pypi_0    pypi
 aiofiles                  23.2.1                   pypi_0    pypi
 aiohttp                   3.9.5                    pypi_0    pypi
 aiosignal                 1.3.1                    pypi_0    pypi
 antlr4-python3-runtime    4.9.3                    pypi_0    pypi
 anyio                     4.4.0                    pypi_0    pypi
 appdirs                   1.4.4                    pypi_0    pypi
 argcomplete               3.3.0                    pypi_0    pypi
 asciitree                 0.3.3                    pypi_0    pypi
 asttokens                 2.4.1                    pypi_0    pypi
 astunparse                1.6.3                    pypi_0    pypi
 async-timeout             4.0.3                    pypi_0    pypi
 attrs                     22.2.0             pyh71513ae_0    conda-forge
 beautifulsoup4            4.12.3                   pypi_0    pypi
 binutils_impl_linux-64    2.40                 hf600244_0    conda-forge
 black                     22.12.0                  pypi_0    pypi
 blas                      2.116                       mkl    conda-forge
 blas-devel                3.9.0            16_linux64_mkl    conda-forge
 blinker                   1.8.2                    pypi_0    pypi
 bokeh                     3.4.1                    pypi_0    pypi
 boto3                     1.34.113                 pypi_0    pypi
 botocore                  1.34.113                 pypi_0    pypi
 brotli                    1.1.0                    pypi_0    pypi
 brotlipy                  0.7.0           py310h5764c6d_1005    conda-forge
 bzip2                     1.0.8                h7f98852_4    conda-forge
 ca-certificates           2024.8.30            hbcca054_0    conda-forge
 cachecontrol              0.12.14                  pypi_0    pypi
 cachetools                5.3.3                    pypi_0    pypi
 certifi                   2024.8.30          pyhd8ed1ab_0    conda-forge
 cffi                      1.16.0                   pypi_0    pypi
 cfgv                      3.4.0                    pypi_0    pypi
 charset-normalizer        3.3.2                    pypi_0    pypi
 clearml                   1.16.1                   pypi_0    pypi
 cleo                      2.0.1              pyhd8ed1ab_0    conda-forge
 click                     8.1.7                    pypi_0    pypi
 click-default-group       1.2.4                    pypi_0    pypi
 cloudpickle               2.2.1                    pypi_0    pypi
 cmake                     3.29.3                   pypi_0    pypi
 colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
 comm                      0.2.2                    pypi_0    pypi
 conda-lock                1.1.1                    pypi_0    pypi
 contourpy                 1.2.1                    pypi_0    pypi
 coverage                  7.5.2                    pypi_0    pypi
 crashtest                 0.4.1              pyhd8ed1ab_0    conda-forge
 cryptography              42.0.7                   pypi_0    pypi
 cts                       0.0.1                    pypi_0    pypi
 cucim                     23.10.0                  pypi_0    pypi
 cuda                      11.7.1                        0    nvidia
 cuda-cccl                 12.1.109                      0    nvidia
 cuda-command-line-tools   11.7.1                        0    nvidia
 cuda-compiler             11.7.1                        0    nvidia
 cuda-cudart               11.7.99                       0    nvidia
 cuda-cudart-dev           11.7.99                       0    nvidia
 cuda-cuobjdump            12.1.111                      0    nvidia
 cuda-cupti                11.7.101                      0    nvidia
 cuda-cuxxfilt             12.1.105                      0    nvidia
 cuda-demo-suite           12.1.105                      0    nvidia
 cuda-documentation        12.1.105                      0    nvidia
 cuda-driver-dev           12.1.105                      0    nvidia
 cuda-gdb                  12.1.105                      0    nvidia
 cuda-libraries            11.7.1                        0    nvidia
 cuda-libraries-dev        11.7.1                        0    nvidia
 cuda-memcheck             11.8.86                       0    nvidia
 cuda-nsight               12.1.105                      0    nvidia
 cuda-nsight-compute       12.1.1                        0    nvidia
 cuda-nvcc                 11.7.99                       0    nvidia
 cuda-nvdisasm             12.1.105                      0    nvidia
 cuda-nvml-dev             12.1.105                      0    nvidia
 cuda-nvprof               12.1.105                      0    nvidia
 cuda-nvprune              12.1.105                      0    nvidia
 cuda-nvrtc                11.7.99                       0    nvidia
 cuda-nvrtc-dev            11.7.99                       0    nvidia
 cuda-nvtx                 11.7.91                       0    nvidia
 cuda-nvvp                 12.1.105                      0    nvidia
 cuda-python               11.8.1          py310h3fd9d12_0    nvidia
 cuda-runtime              11.7.1                        0    nvidia
 cuda-sanitizer-api        12.1.105                      0    nvidia
 cuda-toolkit              11.7.1                        0    nvidia
 cuda-tools                11.7.1                        0    nvidia
 cuda-visual-tools         11.7.1                        0    nvidia
 cudatoolkit               11.7.0              hd8887f6_10    nvidia
 cupy-cuda11x              11.6.0                   pypi_0    pypi
 cycler                    0.12.1                   pypi_0    pypi
 dacite                    1.7.0                    pypi_0    pypi
 dash                      2.17.0                   pypi_0    pypi
 dash-bootstrap-components 1.6.0                    pypi_0    pypi
 dash-core-components      2.0.0                    pypi_0    pypi
 dash-grocery              0.0.7                    pypi_0    pypi
 dash-html-components      2.0.0                    pypi_0    pypi
 dash-table                5.0.0                    pypi_0    pypi
 dask                      2023.12.1                pypi_0    pypi
 dask-image                2022.9.0                 pypi_0    pypi
 dbus                      1.13.6               h5008d03_3    conda-forge
 debugpy                   1.8.1                    pypi_0    pypi
 decorator                 5.1.1                    pypi_0    pypi
 deprecated                1.2.14                   pypi_0    pypi
 dill                      0.3.8                    pypi_0    pypi
 distlib                   0.3.8                    pypi_0    pypi
 distributed               2023.12.1                pypi_0    pypi
 dm-tree                   0.1.8                    pypi_0    pypi
 dnspython                 2.6.1                    pypi_0    pypi
 dulwich                   0.21.3          py310h1fa729e_0    conda-forge
 ensureconda               1.4.4                    pypi_0    pypi
 et-xmlfile                1.1.0                    pypi_0    pypi
 exceptiongroup            1.2.1                    pypi_0    pypi
 executing                 2.0.1                    pypi_0    pypi
 expat                     2.5.0                hcb278e6_1    conda-forge
 fairscale                 0.4.13                   pypi_0    pypi
 fasteners                 0.19                     pypi_0    pypi
 fastjsonschema            2.19.1                   pypi_0    pypi
 fastrlock                 0.8.2                    pypi_0    pypi
 ffmpeg                    4.3                  hf484d3e_0    pytorch
 fiftyone                  0.23.8                   pypi_0    pypi
 fiftyone-brain            0.16.1                   pypi_0    pypi
 fiftyone-db               1.1.2                    pypi_0    pypi
 filelock                  3.14.0                   pypi_0    pypi
 flask                     3.0.3                    pypi_0    pypi
 fmt                       9.1.0                h924138e_0    conda-forge
 fonttools                 4.52.1                   pypi_0    pypi
 freetype                  2.12.1               hca18f0e_1    conda-forge
 frozenlist                1.4.1                    pypi_0    pypi
 fsspec                    2024.5.0                 pypi_0    pypi
 ftfy                      6.2.0                    pypi_0    pypi
 furl                      2.1.3                    pypi_0    pypi
 future                    1.0.0                    pypi_0    pypi
 fvcore                    0.1.5.post20221221          pypi_0    pypi
 gast                      0.6.0                    pypi_0    pypi
 gcc                       11.3.0              h02d0930_12    conda-forge
 gcc_impl_linux-64         11.3.0              hab1b70f_19    conda-forge
 gds-tools                 1.6.1.9                       0    nvidia
 gettext                   0.21.1               h27087fc_0    conda-forge
 glob2                     0.7                      pypi_0    pypi
 gmp                       6.2.1                h58526e2_0    conda-forge
 gmpy2                     2.1.2           py310h3ec546c_1    conda-forge
 gnutls                    3.6.13               h85f3911_1    conda-forge
 graphql-core              3.2.3                    pypi_0    pypi
 grpcio                    1.64.0                   pypi_0    pypi
 grpcio-tools              1.64.0                   pypi_0    pypi
 gunicorn                  23.0.0                   pypi_0    pypi
 gxx                       11.3.0              h02d0930_12    conda-forge
 gxx_impl_linux-64         11.3.0              hab1b70f_19    conda-forge
 h11                       0.14.0                   pypi_0    pypi
 h2                        4.1.0                    pypi_0    pypi
 hpack                     4.0.0                    pypi_0    pypi
 html5lib                  1.1                pyh9f0ad1d_0    conda-forge
 httpcore                  1.0.5                    pypi_0    pypi
 httpx                     0.27.0                   pypi_0    pypi
 huggingface-hub           0.23.2                   pypi_0    pypi
 humanize                  4.9.0                    pypi_0    pypi
 hydra-core                1.3.2                    pypi_0    pypi
 hypercorn                 0.16.0                   pypi_0    pypi
 hyperframe                6.0.1                    pypi_0    pypi
 icu                       72.1                 hcb278e6_0    conda-forge
 identify                  2.5.36                   pypi_0    pypi
 idna                      3.7                      pypi_0    pypi
 imageio                   2.34.1                   pypi_0    pypi
 importlib-metadata        6.6.0              pyha770c72_0    conda-forge
 importlib_metadata        6.6.0                hd8ed1ab_0    conda-forge
 importlib_resources       5.12.0             pyhd8ed1ab_0    conda-forge
 inflate64                 1.0.0                    pypi_0    pypi
 iniconfig                 2.0.0                    pypi_0    pypi
 iopath                    0.1.9                    pypi_0    pypi
 ipykernel                 6.29.4                   pypi_0    pypi
 ipympl                    0.9.4                    pypi_0    pypi
 ipython                   8.24.0                   pypi_0    pypi
 ipython-genutils          0.2.0                    pypi_0    pypi
 ipywidgets                8.1.2                    pypi_0    pypi
 isort                     5.13.2                   pypi_0    pypi
 itsdangerous              2.2.0                    pypi_0    pypi
 jaraco-classes            3.4.0                    pypi_0    pypi
 jedi                      0.19.1                   pypi_0    pypi
 jeepney                   0.8.0              pyhd8ed1ab_0    conda-forge
 jinja2                    3.1.4                    pypi_0    pypi
 jmespath                  1.0.1                    pypi_0    pypi
 joblib                    1.4.2                    pypi_0    pypi
 jpeg                      9e                   h5eee18b_3
 jsonlines                 4.0.0                    pypi_0    pypi
 jsonpickle                3.0.4                    pypi_0    pypi
 jsonschema                4.17.3             pyhd8ed1ab_0    conda-forge
 jupyter-client            8.6.2                    pypi_0    pypi
 jupyter-core              5.7.2                    pypi_0    pypi
 jupyterlab-widgets        3.0.10                   pypi_0    pypi
 kaleido                   0.2.1                    pypi_0    pypi
 kernel-headers_linux-64   2.6.32              he073ed8_15    conda-forge
 keyring                   23.13.1         py310hff52083_0    conda-forge
 kiwisolver                1.4.5                    pypi_0    pypi
 lame                      3.100             h166bdaf_1003    conda-forge
 lazy-loader               0.4                      pypi_0    pypi
 lcms2                     2.15                 hfd0df8a_0    conda-forge
 ld_impl_linux-64          2.40                 h41732ed_0    conda-forge
 lerc                      4.0.0                h27087fc_0    conda-forge
 libblas                   3.9.0            16_linux64_mkl    conda-forge
 libcblas                  3.9.0            16_linux64_mkl    conda-forge
 libcublas                 11.10.3.66                    0    nvidia
 libcublas-dev             11.10.3.66                    0    nvidia
 libcufft                  10.7.2.124           h4fbf590_0    nvidia
 libcufft-dev              10.7.2.124           h98a8f43_0    nvidia
 libcufile                 1.6.1.9                       0    nvidia
 libcufile-dev             1.6.1.9                       0    nvidia
 libcurand                 10.3.2.106                    0    nvidia
 libcurand-dev             10.3.2.106                    0    nvidia
 libcusolver               11.4.0.1                      0    nvidia
 libcusolver-dev           11.4.0.1                      0    nvidia
 libcusparse               11.7.4.91                     0    nvidia
 libcusparse-dev           11.7.4.91                     0    nvidia
 libdeflate                1.17                 h0b41bf4_0    conda-forge
 libexpat                  2.5.0                hcb278e6_1    conda-forge
 libffi                    3.4.2                h7f98852_5    conda-forge
 libgcc-devel_linux-64     11.3.0              h210ce93_19    conda-forge
 libgcc-ng                 12.2.0              h65d4601_19    conda-forge
 libgfortran-ng            12.2.0              h69a702a_19    conda-forge
 libgfortran5              12.2.0              h337968e_19    conda-forge
 libglib                   2.76.2               hebfc3b9_0    conda-forge
 libgomp                   12.2.0              h65d4601_19    conda-forge
 libhwloc                  2.9.1                hd6dc26d_0    conda-forge
 libiconv                  1.17                 h166bdaf_0    conda-forge
 libjpeg-turbo             2.1.4                h166bdaf_0    conda-forge
 liblapack                 3.9.0            16_linux64_mkl    conda-forge
 liblapacke                3.9.0            16_linux64_mkl    conda-forge
 libllvm11                 11.1.0               he0ac6c6_5    conda-forge
 libnpp                    11.7.4.75                     0    nvidia
 libnpp-dev                11.7.4.75                     0    nvidia
 libnsl                    2.0.0                h7f98852_0    conda-forge
 libnvjpeg                 11.8.0.2                      0    nvidia
 libnvjpeg-dev             11.8.0.2                      0    nvidia
 libpng                    1.6.39               h753d276_0    conda-forge
 librmm                    23.04.01        cuda11_230421_geab50f46_0    rapidsai
 libsanitizer              11.3.0              h239ccf8_19    conda-forge
 libsqlite                 3.40.0               h753d276_1    conda-forge
 libstdcxx-devel_linux-64  11.3.0              h210ce93_19    conda-forge
 libstdcxx-ng              12.2.0              h46fd767_19    conda-forge
 libtiff                   4.5.0                h6adf6a1_2    conda-forge
 libuuid                   2.38.1               h0b41bf4_0    conda-forge
 libwebp-base              1.3.0                h0b41bf4_0    conda-forge
 libxcb                    1.13              h7f98852_1004    conda-forge
 libxml2                   2.10.4               hfdac1af_0    conda-forge
 libzlib                   1.2.13               h166bdaf_4    conda-forge
 lightning                 2.2.5                    pypi_0    pypi
 lightning-utilities       0.11.2                   pypi_0    pypi
 line-profiler             4.1.3                    pypi_0    pypi
 lit                       18.1.6                   pypi_0    pypi
 llvm-openmp               16.0.2               h4dfa4b3_0    conda-forge
 llvmlite                  0.39.1          py310h58363a5_1    conda-forge
 locket                    1.0.0                    pypi_0    pypi
 lockfile                  0.12.2                     py_1    conda-forge
 lz4                       4.3.3                    pypi_0    pypi
 markdown                  3.6                      pypi_0    pypi
 markupsafe                2.1.5                    pypi_0    pypi
 matplotlib                3.9.0                    pypi_0    pypi
 matplotlib-inline         0.1.7                    pypi_0    pypi
 mkl                       2022.1.0           h84fe81f_915    conda-forge
 mkl-devel                 2022.1.0           ha770c72_916    conda-forge
 mkl-include               2022.1.0           h84fe81f_915    conda-forge
 mongoengine               0.24.2                   pypi_0    pypi
 more-itertools            10.2.0                   pypi_0    pypi
 motor                     3.4.0                    pypi_0    pypi
 mpc                       1.3.1                hfe3b2da_0    conda-forge
 mpfr                      4.2.0                hb012696_0    conda-forge
 mpmath                    1.3.0              pyhd8ed1ab_0    conda-forge
 msgpack-python            1.0.5           py310hdf3cbec_0    conda-forge
 multidict                 6.0.5                    pypi_0    pypi
 multivolumefile           0.2.3                    pypi_0    pypi
 mypy                      0.991                    pypi_0    pypi
 mypy-extensions           1.0.0                    pypi_0    pypi
 nbformat                  5.10.4                   pypi_0    pypi
 ncurses                   6.3                  h27087fc_1    conda-forge
 nest-asyncio              1.6.0                    pypi_0    pypi
 nettle                    3.6                  he412f7d_0    conda-forge
 networkx                  3.3                      pypi_0    pypi
 nodeenv                   1.8.0                    pypi_0    pypi
 nsight-compute            2023.1.1.4                    0    nvidia
 numba                     0.56.4          py310h0e39c9b_1    conda-forge
 numcodecs                 0.12.1                   pypi_0    pypi
 numpy                     1.23.5          py310h53a5b5f_0    conda-forge
 nvidia-cublas-cu11        11.10.3.66               pypi_0    pypi
 nvidia-cuda-cupti-cu11    11.7.101                 pypi_0    pypi
 nvidia-cuda-nvrtc-cu11    11.7.99                  pypi_0    pypi
 nvidia-cuda-runtime-cu11  11.7.99                  pypi_0    pypi
 nvidia-cudnn-cu11         8.5.0.96                 pypi_0    pypi
 nvidia-cufft-cu11         10.9.0.58                pypi_0    pypi
 nvidia-curand-cu11        10.2.10.91               pypi_0    pypi
 nvidia-cusolver-cu11      11.4.0.1                 pypi_0    pypi
 nvidia-cusparse-cu11      11.7.4.91                pypi_0    pypi
 nvidia-dali-cuda110       1.41.0                   pypi_0    pypi
 nvidia-nccl-cu11          2.14.3                   pypi_0    pypi
 nvidia-nvimgcodec-cu11    0.2.0.7                  pypi_0    pypi
 nvidia-nvtx-cu11          11.7.91                  pypi_0    pypi
 omegaconf                 2.3.0                    pypi_0    pypi
 opencv-python             4.9.0.80                 pypi_0    pypi
 opencv-python-headless    4.9.0.80                 pypi_0    pypi
 openh264                  2.1.1                h780b84a_0    conda-forge
 openjpeg                  2.5.0                hfec8fc6_2    conda-forge
 openpyxl                  3.1.5                    pypi_0    pypi
 openssl                   3.1.0                hd590300_1    conda-forge
 orderedmultidict          1.0.1                    pypi_0    pypi
 packaging                 23.2                     pypi_0    pypi
 pandas                    1.5.3                    pypi_0    pypi
 parso                     0.8.4                    pypi_0    pypi
 partd                     1.4.2                    pypi_0    pypi
 pathlib2                  2.3.7.post1              pypi_0    pypi
 pathspec                  0.12.1                   pypi_0    pypi
 pcre2                     10.40                hc3806b6_0    conda-forge
 pexpect                   4.9.0                    pypi_0    pypi
 pillow                    9.4.0           py310h023d228_1    conda-forge
 pims                      0.6.1                    pypi_0    pypi
 pip                       23.1.1             pyhd8ed1ab_0    conda-forge
 pkginfo                   1.10.0                   pypi_0    pypi
 pkgutil-resolve-name      1.3.10             pyhd8ed1ab_0    conda-forge
 platformdirs              2.6.2              pyhd8ed1ab_0    conda-forge
 plotly                    5.22.0                   pypi_0    pypi
 pluggy                    1.5.0                    pypi_0    pypi
 poetry                    1.4.2           linux_pyhd8ed1ab_0    conda-forge
 poetry-core               1.5.2              pyhd8ed1ab_0    conda-forge
 poetry-plugin-export      1.3.1              pyhd8ed1ab_0    conda-forge
 portalocker               2.8.2                    pypi_0    pypi
 pprintpp                  0.4.0                    pypi_0    pypi
 pre-commit                3.7.1                    pypi_0    pypi
 priority                  2.0.0                    pypi_0    pypi
 prompt-toolkit            3.0.43                   pypi_0    pypi
 protobuf                  5.27.0                   pypi_0    pypi
 psutil                    5.9.8                    pypi_0    pypi
 pthread-stubs             0.4               h36c2ea0_1001    conda-forge
 ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
 pure-eval                 0.2.2                    pypi_0    pypi
 py7zr                     0.21.0                   pypi_0    pypi
 pyarrow                   16.1.0                   pypi_0    pypi
 pyarrow-hotfix            0.6                      pypi_0    pypi
 pybcj                     1.0.2                    pypi_0    pypi
 pybind11                  2.13.6                   pypi_0    pypi
 pybind11-global           2.13.6                   pypi_0    pypi
 pycocotools               2.0.7                    pypi_0    pypi
 pycparser                 2.22                     pypi_0    pypi
 pycryptodomex             3.20.0                   pypi_0    pypi
 pydantic                  1.10.15                  pypi_0    pypi
 pygments                  2.18.0                   pypi_0    pypi
 pyjwt                     2.8.0                    pypi_0    pypi
 pymongo                   4.7.2                    pypi_0    pypi
 pyopenssl                 24.1.0                   pypi_0    pypi
 pyparsing                 3.1.2                    pypi_0    pypi
 pyppmd                    1.1.0                    pypi_0    pypi
 pyproject-hooks           1.1.0                    pypi_0    pypi
 pyrsistent                0.19.3          py310h1fa729e_0    conda-forge
 pysocks                   1.7.1              pyha2e5f31_6    conda-forge
 pytest                    7.4.4                    pypi_0    pypi
 pytest-cov                4.1.0                    pypi_0    pypi
 pytest-skip-slow          0.0.5                    pypi_0    pypi
 python                    3.10.10         he550d4f_0_cpython    conda-forge
 python-build              0.10.0             pyhd8ed1ab_0    conda-forge
 python-dateutil           2.9.0.post0              pypi_0    pypi
 python-graphviz           0.20.3                   pypi_0    pypi
 python-installer          0.7.0              pyhd8ed1ab_0    conda-forge
 python_abi                3.10                    3_cp310    conda-forge
 pytorch                   2.0.0           py3.10_cuda11.7_cudnn8.5.0_0    pytorch
 pytorch-cuda              11.7                 h778d358_3    pytorch
 pytorch-lightning         2.2.5                    pypi_0    pypi
 pytorch-mutex             1.0                        cuda    pytorch
 pyturbojpeg               1.7.7              pyh3b83783_0    conda-forge
 pytz                      2024.1                   pypi_0    pypi
 pywavelets                1.6.0                    pypi_0    pypi
 pyyaml                    6.0.1                    pypi_0    pypi
 pyzmq                     26.0.3                   pypi_0    pypi
 pyzstd                    0.16.0                   pypi_0    pypi
 qdrant-client             1.9.2                    pypi_0    pypi
 rambenchmark              1.3                      pypi_0    pypi
 rapidfuzz                 2.15.2                   pypi_0    pypi
 rarfile                   4.2                      pypi_0    pypi
 readline                  8.2                  h8228510_1    conda-forge
 referencing               0.35.1                   pypi_0    pypi
 regex                     2024.5.15                pypi_0    pypi
 requests                  2.28.2             pyhd8ed1ab_1    conda-forge
 requests-toolbelt         0.10.1             pyhd8ed1ab_0    conda-forge
 retrying                  1.3.4                    pypi_0    pypi
 rmm                       23.04.01        cuda11_py310_230421_geab50f46_0    rapidsai
 rpds-py                   0.18.1                   pypi_0    pypi
 ruamel-yaml               0.18.6                   pypi_0    pypi
 ruamel-yaml-clib          0.2.8                    pypi_0    pypi
 ruff                      0.1.15                   pypi_0    pypi
 s3transfer                0.10.1                   pypi_0    pypi
 scikit-image              0.19.3                   pypi_0    pypi
 scikit-learn              1.5.0                    pypi_0    pypi
 scipy                     1.13.1                   pypi_0    pypi
 secretstorage             3.3.3           py310hff52083_1    conda-forge
 setuptools                67.7.1             pyhd8ed1ab_0    conda-forge
 shapely                   2.0.4                    pypi_0    pypi
 shellingham               1.5.1              pyhd8ed1ab_0    conda-forge
 six                       1.16.0             pyh6c4a22f_0    conda-forge
 slicerator                1.1.0                    pypi_0    pypi
 sniffio                   1.3.1                    pypi_0    pypi
 sortedcontainers          2.4.0                    pypi_0    pypi
 soupsieve                 2.5                      pypi_0    pypi
 spdlog                    1.11.0               h9b3ece8_1    conda-forge
 spekpy                    2.0.11.1                 pypi_0    pypi
 sse-starlette             0.10.3                   pypi_0    pypi
 sseclient-py              1.8.0                    pypi_0    pypi
 stack-data                0.6.3                    pypi_0    pypi
 starlette                 0.37.2                   pypi_0    pypi
 strawberry-graphql        0.138.1                  pypi_0    pypi
 streamz                   0.6.4                    pypi_0    pypi
 sympy                     1.11.1          pypyh9d50eac_103    conda-forge
 sysroot_linux-64          2.12                he073ed8_15    conda-forge
 tabulate                  0.9.0                    pypi_0    pypi
 taskgroup                 0.0.0a4                  pypi_0    pypi
 tbb                       2021.9.0             hf52228f_0    conda-forge
 tblib                     3.0.0                    pypi_0    pypi
 tenacity                  8.3.0                    pypi_0    pypi
 tensorboard               2.16.2                   pypi_0    pypi
 tensorboard-data-server   0.7.2                    pypi_0    pypi
 termcolor                 2.4.0                    pypi_0    pypi
 texttable                 1.7.0                    pypi_0    pypi
 threadpoolctl             3.5.0                    pypi_0    pypi
 tifffile                  2024.5.22                pypi_0    pypi
 timm                      0.6.13                   pypi_0    pypi
 tk                        8.6.12               h27826a3_0    conda-forge
 toml                      0.10.2                   pypi_0    pypi
 tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
 tomlkit                   0.11.7             pyha770c72_0    conda-forge
 toolz                     0.12.1                   pypi_0    pypi
 torch-summary             1.4.5                    pypi_0    pypi
 torchmetrics              1.4.0.post0              pypi_0    pypi
 torchtriton               2.0.0                     py310    pytorch
 torchvision               0.15.1                   pypi_0    pypi
 torchviz                  0.0.2                    pypi_0    pypi
 tornado                   6.4                      pypi_0    pypi
 tqdm                      4.66.4                   pypi_0    pypi
 traitlets                 5.14.3                   pypi_0    pypi
 trove-classifiers         2023.4.22          pyhd8ed1ab_0    conda-forge
 typing                    3.10.0.0           pyhd8ed1ab_0    conda-forge
 typing-extensions         4.12.0                   pypi_0    pypi
 tzdata                    2023c                h71feb2d_0    conda-forge
 tzlocal                   5.2                      pypi_0    pypi
 universal-analytics-python3 1.1.1                    pypi_0    pypi
 urllib3                   1.26.15            pyhd8ed1ab_0    conda-forge
 virtualenv                20.21.1            pyhd8ed1ab_0    conda-forge
 voxel51-eta               0.12.6                   pypi_0    pypi
 wcwidth                   0.2.13                   pypi_0    pypi
 webencodings              0.5.1                      py_1    conda-forge
 werkzeug                  3.0.3                    pypi_0    pypi
 wheel                     0.43.0                   pypi_0    pypi
 widgetsnbextension        4.0.10                   pypi_0    pypi
 wrapt                     1.16.0                   pypi_0    pypi
 wsproto                   1.2.0                    pypi_0    pypi
 xmltodict                 0.13.0                   pypi_0    pypi
 xorg-libxau               1.0.9                h7f98852_0    conda-forge
 xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
 xraylib                   4.1.3                    pypi_0    pypi
 xyzservices               2024.4.0                 pypi_0    pypi
 xz                        5.2.6                h166bdaf_0    conda-forge
 yacs                      0.1.8                    pypi_0    pypi
 yarl                      1.9.4                    pypi_0    pypi
 zarr                      2.18.2                   pypi_0    pypi
 zict                      3.0.0                    pypi_0    pypi
 zipp                      3.19.0                   pypi_0    pypi
 zlib                      1.2.13               h166bdaf_4    conda-forge
 zstd                      1.5.2                h3eb15da_6    conda-forge

Relevant log output

Process memory: Before encode in main thread: 46.50 MB After encode in main thead: 150.33 MB After encode in sub thread: 1176.45 MB

Other/Misc.

No response

Check for duplicates

  • [x] I have searched the open bugs/issues and have found no duplicates for this bug report

roelmops avatar Oct 08 '24 11:10 roelmops