NVTabular icon indicating copy to clipboard operation
NVTabular copied to clipboard

Add Multi-hot feature into the movie-lens example

Open jershi425 opened this issue 3 years ago β€’ 12 comments

Added 'genres' as a multi-hot feature into the sample.

jershi425 avatar Aug 06 '21 08:08 jershi425

Click to view CI Results
GitHub pull request #1021 of commit 6be67eafb33b8c8035b5411d15fdb8da4b7bf884, no merge conflicts.
Running as SYSTEM
Setting status of 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3093/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
 > git rev-parse 6be67eafb33b8c8035b5411d15fdb8da4b7bf884^{commit} # timeout=10
Checking out Revision 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 # timeout=10
Commit message: "Add Multi-hot example"
 > git rev-list --no-walk 9a9267eb90c52dfa82a47ca7a89dbe6e82e54267 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins5271119042589813411.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.2.2)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.7.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> 
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+2.g6be67ea is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular Processing dependencies for nvtabular==0.6.0+2.g6be67ea Searching for pyarrow==1.0.1 Best match: pyarrow 1.0.1 Adding pyarrow 1.0.1 to easy-install.pth file Installing plasma_store script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for tqdm==4.61.2 Best match: tqdm 4.61.2 Processing tqdm-4.61.2-py3.8.egg tqdm 4.61.2 is already the active version in easy-install.pth Installing tqdm script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg Searching for numba==0.53.1 Best match: numba 0.53.1 Adding numba 0.53.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for pandas==1.1.5 Best match: pandas 1.1.5 Adding pandas 1.1.5 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for distributed==2021.4.1 Best match: distributed 2021.4.1 Adding distributed 2021.4.1 to easy-install.pth file Installing dask-ssh script to /var/jenkins_home/.local/bin Installing dask-scheduler script to /var/jenkins_home/.local/bin Installing dask-worker script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for dask==2021.4.1 Best match: dask 2021.4.1 Processing dask-2021.4.1-py3.8.egg dask 2021.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg Searching for PyYAML==5.4.1 Best match: PyYAML 5.4.1 Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg PyYAML 5.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg Searching for numpy==1.20.2 Best match: numpy 1.20.2 Adding numpy 1.20.2 to easy-install.pth file Installing f2py script to /var/jenkins_home/.local/bin Installing f2py3 script to /var/jenkins_home/.local/bin Installing f2py3.8 script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for llvmlite==0.36.0 Best match: llvmlite 0.36.0 Adding llvmlite 0.36.0 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for setuptools==57.4.0 Best match: setuptools 57.4.0 Adding setuptools 57.4.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for python-dateutil==2.8.2 Best match: python-dateutil 2.8.2 Adding python-dateutil 2.8.2 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for pytz==2021.1 Best match: pytz 2021.1 Adding pytz 2021.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for cloudpickle==1.6.0 Best match: cloudpickle 1.6.0 Processing cloudpickle-1.6.0-py3.8.egg cloudpickle 1.6.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg Searching for tblib==1.7.0 Best match: tblib 1.7.0 Processing tblib-1.7.0-py3.8.egg tblib 1.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg Searching for toolz==0.11.1 Best match: toolz 0.11.1 Processing toolz-0.11.1-py3.8.egg toolz 0.11.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg Searching for zict==2.0.0 Best match: zict 2.0.0 Processing zict-2.0.0-py3.8.egg zict 2.0.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg Searching for sortedcontainers==2.4.0 Best match: sortedcontainers 2.4.0 Processing sortedcontainers-2.4.0-py3.8.egg sortedcontainers 2.4.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg Searching for psutil==5.8.0 Best match: psutil 5.8.0 Processing psutil-5.8.0-py3.8-linux-x86_64.egg psutil 5.8.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg Searching for tornado==6.1 Best match: tornado 6.1 Processing tornado-6.1-py3.8-linux-x86_64.egg tornado 6.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg Searching for click==8.0.1 Best match: click 8.0.1 Processing click-8.0.1-py3.8.egg click 8.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg Searching for msgpack==1.0.2 Best match: msgpack 1.0.2 Processing msgpack-1.0.2-py3.8-linux-x86_64.egg msgpack 1.0.2 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg Searching for partd==1.2.0 Best match: partd 1.2.0 Processing partd-1.2.0-py3.8.egg partd 1.2.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg Searching for fsspec==2021.7.0 Best match: fsspec 2021.7.0 Processing fsspec-2021.7.0-py3.8.egg fsspec 2021.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/fsspec-2021.7.0-py3.8.egg Searching for six==1.15.0 Best match: six 1.15.0 Adding six 1.15.0 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for HeapDict==1.0.1 Best match: HeapDict 1.0.1 Processing HeapDict-1.0.1-py3.8.egg HeapDict 1.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg Searching for locket==0.2.1 Best match: locket 0.2.1 Processing locket-0.2.1-py3.8.egg locket 0.2.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg Finished processing dependencies for nvtabular==0.6.0+2.g6be67ea Running black --check All done! ✨ 🍰 ✨ 110 files would be left unchanged. Running flake8 Running isort /usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images warn(f"Likely recursive symlink detected to {resolved_path}") /usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs warn(f"Likely recursive symlink detected to {resolved_path}") Skipped 2 files Running bandit Running pylint ************* Module nvtabular.ops.categorify nvtabular/ops/categorify.py:459:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) ************* Module nvtabular.ops.fill nvtabular/ops/fill.py:66:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) ************* Module bench.datasets.tools.train_hugectr bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)


Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[135]:254:1: E902 IndentationError: unindent does not match any outer indentation level examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:4:15: E231 missing whitespace after ':' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:5:6: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:6:4: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:7:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:10:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:11:3: E131 continuation line unaligned for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:12:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:15:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:16:3: E131 continuation line unaligned for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:17:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:20:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:22:7: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:23:3: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:24:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:29:15: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:30:3: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:31:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:33:9: E231 missing whitespace after ':' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:37:11: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:38:3: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:39:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:69: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:43:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:32: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:47:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:31: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:51:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:31: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:55:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:59:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:63:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:66:2: E131 continuation line unaligned for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:67:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:71:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:75:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:30: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:79:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:32: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:3:25: E272 multiple spaces before keyword examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:9:20: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:10:19: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:15:8: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:26:1: W293 blank line contains whitespace examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:28:19: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:19: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:64: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:30:99: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:32:33: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:33:1: W293 blank line contains whitespace examples/getting-started-movielens/inference-HugeCTR/Training-with-HugeCTR.ipynb#In[17]:2:1: E265 block comment should start with '# ' Build step 'Execute shell' marked build as failure Performing Post build task... Match found for : : True Logical operation result is TRUE Running script : #!/bin/bash cd /var/jenkins_home/ CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" [nvtabular_tests] $ /bin/bash /tmp/jenkins5827686255363110841.sh

nvidia-merlin-bot avatar Aug 06 '21 08:08 nvidia-merlin-bot

Click to view CI Results
GitHub pull request #1021 of commit 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc, no merge conflicts.
Running as SYSTEM
Setting status of 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3094/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
 > git rev-parse 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc^{commit} # timeout=10
Checking out Revision 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc # timeout=10
Commit message: "modified path to data"
 > git rev-list --no-walk 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins1937025196937848310.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.2.2)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.7.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> 
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+3.g78c8ae4 is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular Processing dependencies for nvtabular==0.6.0+3.g78c8ae4 Searching for pyarrow==1.0.1 Best match: pyarrow 1.0.1 Adding pyarrow 1.0.1 to easy-install.pth file Installing plasma_store script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for tqdm==4.61.2 Best match: tqdm 4.61.2 Processing tqdm-4.61.2-py3.8.egg tqdm 4.61.2 is already the active version in easy-install.pth Installing tqdm script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg Searching for numba==0.53.1 Best match: numba 0.53.1 Adding numba 0.53.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for pandas==1.1.5 Best match: pandas 1.1.5 Adding pandas 1.1.5 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for distributed==2021.4.1 Best match: distributed 2021.4.1 Adding distributed 2021.4.1 to easy-install.pth file Installing dask-ssh script to /var/jenkins_home/.local/bin Installing dask-scheduler script to /var/jenkins_home/.local/bin Installing dask-worker script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for dask==2021.4.1 Best match: dask 2021.4.1 Processing dask-2021.4.1-py3.8.egg dask 2021.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg Searching for PyYAML==5.4.1 Best match: PyYAML 5.4.1 Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg PyYAML 5.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg Searching for numpy==1.20.2 Best match: numpy 1.20.2 Adding numpy 1.20.2 to easy-install.pth file Installing f2py script to /var/jenkins_home/.local/bin Installing f2py3 script to /var/jenkins_home/.local/bin Installing f2py3.8 script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for llvmlite==0.36.0 Best match: llvmlite 0.36.0 Adding llvmlite 0.36.0 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for setuptools==57.4.0 Best match: setuptools 57.4.0 Adding setuptools 57.4.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for python-dateutil==2.8.2 Best match: python-dateutil 2.8.2 Adding python-dateutil 2.8.2 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for pytz==2021.1 Best match: pytz 2021.1 Adding pytz 2021.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for tblib==1.7.0 Best match: tblib 1.7.0 Processing tblib-1.7.0-py3.8.egg tblib 1.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg Searching for zict==2.0.0 Best match: zict 2.0.0 Processing zict-2.0.0-py3.8.egg zict 2.0.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg Searching for toolz==0.11.1 Best match: toolz 0.11.1 Processing toolz-0.11.1-py3.8.egg toolz 0.11.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg Searching for click==8.0.1 Best match: click 8.0.1 Processing click-8.0.1-py3.8.egg click 8.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg Searching for tornado==6.1 Best match: tornado 6.1 Processing tornado-6.1-py3.8-linux-x86_64.egg tornado 6.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg Searching for msgpack==1.0.2 Best match: msgpack 1.0.2 Processing msgpack-1.0.2-py3.8-linux-x86_64.egg msgpack 1.0.2 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg Searching for psutil==5.8.0 Best match: psutil 5.8.0 Processing psutil-5.8.0-py3.8-linux-x86_64.egg psutil 5.8.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg Searching for sortedcontainers==2.4.0 Best match: sortedcontainers 2.4.0 Processing sortedcontainers-2.4.0-py3.8.egg sortedcontainers 2.4.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg Searching for cloudpickle==1.6.0 Best match: cloudpickle 1.6.0 Processing cloudpickle-1.6.0-py3.8.egg cloudpickle 1.6.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg Searching for partd==1.2.0 Best match: partd 1.2.0 Processing partd-1.2.0-py3.8.egg partd 1.2.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg Searching for fsspec==2021.7.0 Best match: fsspec 2021.7.0 Processing fsspec-2021.7.0-py3.8.egg fsspec 2021.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/fsspec-2021.7.0-py3.8.egg Searching for six==1.15.0 Best match: six 1.15.0 Adding six 1.15.0 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for HeapDict==1.0.1 Best match: HeapDict 1.0.1 Processing HeapDict-1.0.1-py3.8.egg HeapDict 1.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg Searching for locket==0.2.1 Best match: locket 0.2.1 Processing locket-0.2.1-py3.8.egg locket 0.2.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg Finished processing dependencies for nvtabular==0.6.0+3.g78c8ae4 Running black --check All done! ✨ 🍰 ✨ 110 files would be left unchanged. Running flake8 Running isort /usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images warn(f"Likely recursive symlink detected to {resolved_path}") /usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs warn(f"Likely recursive symlink detected to {resolved_path}") Skipped 2 files Running bandit Running pylint ************* Module nvtabular.ops.categorify nvtabular/ops/categorify.py:459:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) ************* Module nvtabular.ops.fill nvtabular/ops/fill.py:66:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) ************* Module bench.datasets.tools.train_hugectr bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)


Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[135]:254:1: E902 IndentationError: unindent does not match any outer indentation level examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:4:15: E231 missing whitespace after ':' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:5:6: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:6:4: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:7:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:10:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:11:3: E131 continuation line unaligned for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:12:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:15:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:16:3: E131 continuation line unaligned for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:17:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:20:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:22:7: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:23:3: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:24:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:12: E201 whitespace after '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:15: E202 whitespace before ']' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:29:15: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:30:3: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:31:5: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:33:9: E231 missing whitespace after ':' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:37:11: E211 whitespace before '[' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:38:3: E121 continuation line under-indented for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:39:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:69: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:43:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:32: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:47:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:31: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:51:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:31: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:55:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:59:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:63:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:66:2: E131 continuation line unaligned for hanging indent examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:67:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:71:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:29: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:75:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:30: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:79:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:3: E122 continuation line missing indentation or outdented examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:11: E201 whitespace after '{' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:32: E202 whitespace before '}' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:3:25: E272 multiple spaces before keyword examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:9:20: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:10:19: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:15:8: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:26:1: W293 blank line contains whitespace examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:28:19: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:19: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:64: E225 missing whitespace around operator examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:30:99: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:32:33: E231 missing whitespace after ',' examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:33:1: W293 blank line contains whitespace examples/getting-started-movielens/inference-HugeCTR/Training-with-HugeCTR.ipynb#In[17]:2:1: E265 block comment should start with '# ' Build step 'Execute shell' marked build as failure Performing Post build task... Match found for : : True Logical operation result is TRUE Running script : #!/bin/bash cd /var/jenkins_home/ CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" [nvtabular_tests] $ /bin/bash /tmp/jenkins7146219636824817313.sh

nvidia-merlin-bot avatar Aug 06 '21 08:08 nvidia-merlin-bot

@jershi425 when I train the model in the Training-with-HugeCTR nb, I get the following during model training:

[22d23h55m60s][HUGECTR][INFO]: Iter: 1900 Time(100 iters): 0.262071s Loss: 0.523336 lr:0.001000
[22d23h55m60s][HUGECTR][INFO]: Rank0: Dump hash table from GPU0
[22d23h55m60s][HUGECTR][INFO]: Rank0: Write hash table <key,value> pairs to file
[22d23h55m60s][HUGECTR][INFO]: Done
[22d23h55m60s][HUGECTR][INFO]: Dumping sparse weights to files, successful
[22d23h55m60s][HUGECTR][INFO]: Rank0: Write optimzer state to file
[22d23h55m60s][HUGECTR][INFO]: Done
[22d23h55m60s][HUGECTR][INFO]: Rank0: Write optimzer state to file
[22d23h55m60s][HUGECTR][INFO]: Done
[22d23h55m60s][HUGECTR][INFO]: Dumping sparse optimzer states to files, successful
[22d23h55m60s][HUGECTR][INFO]: Dumping dense weights to file, successful
[22d23h55m60s][HUGECTR][INFO]: Dumping dense optimizer states to file, successful
[22d23h55m60s][HUGECTR][INFO]: Dumping untrainable weights to file, successful
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
Finish 2000 iterations with batchsize: 2048 in 5.82s
[22d23h55m70s][HUGECTR][INFO]: Save the model graph to /model/movielens_hugectr/1/movielens.json, successful

Do you have any idea why I am getting set_mempolicy: Operation not permitted ? I use merlin-training:0.6 docker image.

rnyak avatar Aug 22 '21 23:08 rnyak

@jershi425 can you also explain these lines? why range(1, 31) ? where is 31 coming from? thanks.

rp_lst = [0]
cur = 0
for i in range(1, 31):
    if i % 3 == 0:
        cur += 2
        rp_lst.append(cur)
    else:
        cur += 1
        rp_lst.append(cur)

rnyak avatar Aug 23 '21 01:08 rnyak

@rnyak The set_mempolicy: Operation not permitted issue can be solved after you add --privileged when you start your docker container. The range(1, 31) comes from the fact that we have 3 columns in our data and I am using the first 10 samples to do the inference test. Therefore we have 3 * 10 = 30 row pointers.

jershi425 avatar Sep 06 '21 09:09 jershi425

@rnyak The set_mempolicy: Operation not permitted issue can be solved after you add --privileged when you start your docker container. The range(1, 31) comes from the fact that we have 3 columns in our data and I am using the first 10 samples to do the inference test. Therefore we have 3 * 10 = 30 row pointers.

@jershi425 thanks I solved set_mempolicy warning. Thanks for the explanation regarding range(1, 31).

rnyak avatar Sep 06 '21 14:09 rnyak

Check out this pull request onΒ  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@rnyak @jershi425 what is the plan for this PR?

albert17 avatar Nov 17 '21 15:11 albert17

@rnyak @jershi425 what is the plan for this PR?

@albert17 we already have multi-hot training example with HugeCTR based on this PR. It should work without issues. What is missing is the inference part. You only need to make the inference code created by Onur's PR work, and you can take Jerry's inference notebook as a guidance/reference/test point. Once you are done we can close this PR without merging :)

rnyak avatar Nov 17 '21 16:11 rnyak

Click to view CI Results
GitHub pull request #1021 of commit 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc, has merge conflicts.
Running as SYSTEM
Setting status of 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3744/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
 > git rev-parse 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc^{commit} # timeout=10
Checking out Revision 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc # timeout=10
Commit message: "modified path to data"
 > git rev-list --no-walk 5eb6c540ea1c3dfd08c4ca62c7e21fc01139e43a # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins2276861310117143877.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.3.1)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (59.1.1)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.0)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.8.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> 
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+3.g78c8ae4 is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular Processing dependencies for nvtabular==0.6.0+3.g78c8ae4 Searching for distributed==2021.4.1 Reading https://pypi.org/simple/distributed/ Downloading https://files.pythonhosted.org/packages/63/f8/ac2c18adde6477bca3881c4d3cfa74c7f4da7ee82f3c83c201aa3b9ca5ee/distributed-2021.4.1-py3-none-any.whl#sha256=fe0e005e9aa79d68e185008bd2ce6562388311efd1c59a04ab6127ee631b8808 Best match: distributed 2021.4.1 Processing distributed-2021.4.1-py3-none-any.whl Installing distributed-2021.4.1-py3-none-any.whl to /var/jenkins_home/.local/lib/python3.8/site-packages Removing distributed 2021.7.1 from easy-install.pth file Adding distributed 2021.4.1 to easy-install.pth file Installing dask-ssh script to /var/jenkins_home/.local/bin Installing dask-scheduler script to /var/jenkins_home/.local/bin Installing dask-worker script to /var/jenkins_home/.local/bin

Installed /var/jenkins_home/.local/lib/python3.8/site-packages/distributed-2021.4.1-py3.8.egg Searching for dask==2021.4.1 Reading https://pypi.org/simple/dask/ Downloading https://files.pythonhosted.org/packages/c3/23/42159cdb5c9edac174296c9976e175742513883f0f7bc132cfc2a2480fab/dask-2021.4.1-py3-none-any.whl#sha256=344c342d699466c3f742019b7a33caf2472b751f38370b200ede7d2f354aa1e4 Best match: dask 2021.4.1 Processing dask-2021.4.1-py3-none-any.whl Installing dask-2021.4.1-py3-none-any.whl to /var/jenkins_home/.local/lib/python3.8/site-packages Adding dask 2021.4.1 to easy-install.pth file

Installed /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg Searching for pyarrow==4.0.1 Best match: pyarrow 4.0.1 Adding pyarrow 4.0.1 to easy-install.pth file Installing plasma_store script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for tqdm==4.61.2 Best match: tqdm 4.61.2 Processing tqdm-4.61.2-py3.8.egg tqdm 4.61.2 is already the active version in easy-install.pth Installing tqdm script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg Searching for numba==0.54.0 Best match: numba 0.54.0 Processing numba-0.54.0-py3.8-linux-x86_64.egg numba 0.54.0 is already the active version in easy-install.pth Installing pycc script to /var/jenkins_home/.local/bin Installing numba script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/numba-0.54.0-py3.8-linux-x86_64.egg Searching for pandas==1.2.5 Best match: pandas 1.2.5 Processing pandas-1.2.5-py3.8-linux-x86_64.egg Removing pandas 1.3.3 from easy-install.pth file Adding pandas 1.2.5 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages/pandas-1.2.5-py3.8-linux-x86_64.egg Searching for PyYAML==5.4.1 Best match: PyYAML 5.4.1 Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg PyYAML 5.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg Searching for numpy==1.20.3 Best match: numpy 1.20.3 Adding numpy 1.20.3 to easy-install.pth file Installing f2py script to /var/jenkins_home/.local/bin Installing f2py3 script to /var/jenkins_home/.local/bin Installing f2py3.8 script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for setuptools==59.1.1 Best match: setuptools 59.1.1 Adding setuptools 59.1.1 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for llvmlite==0.37.0 Best match: llvmlite 0.37.0 Processing llvmlite-0.37.0-py3.8-linux-x86_64.egg llvmlite 0.37.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/llvmlite-0.37.0-py3.8-linux-x86_64.egg Searching for pytz==2021.1 Best match: pytz 2021.1 Adding pytz 2021.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for python-dateutil==2.8.2 Best match: python-dateutil 2.8.2 Adding python-dateutil 2.8.2 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for zict==2.0.0 Best match: zict 2.0.0 Processing zict-2.0.0-py3.8.egg zict 2.0.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg Searching for tornado==6.1 Best match: tornado 6.1 Processing tornado-6.1-py3.8-linux-x86_64.egg tornado 6.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg Searching for toolz==0.11.1 Best match: toolz 0.11.1 Processing toolz-0.11.1-py3.8.egg toolz 0.11.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg Searching for tblib==1.7.0 Best match: tblib 1.7.0 Processing tblib-1.7.0-py3.8.egg tblib 1.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg Searching for sortedcontainers==2.4.0 Best match: sortedcontainers 2.4.0 Processing sortedcontainers-2.4.0-py3.8.egg sortedcontainers 2.4.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg Searching for psutil==5.8.0 Best match: psutil 5.8.0 Processing psutil-5.8.0-py3.8-linux-x86_64.egg psutil 5.8.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg Searching for msgpack==1.0.2 Best match: msgpack 1.0.2 Processing msgpack-1.0.2-py3.8-linux-x86_64.egg msgpack 1.0.2 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg Searching for cloudpickle==1.6.0 Best match: cloudpickle 1.6.0 Processing cloudpickle-1.6.0-py3.8.egg cloudpickle 1.6.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg Searching for click==8.0.1 Best match: click 8.0.1 Processing click-8.0.1-py3.8.egg click 8.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg Searching for partd==1.2.0 Best match: partd 1.2.0 Processing partd-1.2.0-py3.8.egg partd 1.2.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg Searching for fsspec==2021.11.0 Best match: fsspec 2021.11.0 Adding fsspec 2021.11.0 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for six==1.15.0 Best match: six 1.15.0 Adding six 1.15.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for HeapDict==1.0.1 Best match: HeapDict 1.0.1 Processing HeapDict-1.0.1-py3.8.egg HeapDict 1.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg Searching for locket==0.2.1 Best match: locket 0.2.1 Processing locket-0.2.1-py3.8.egg locket 0.2.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg Finished processing dependencies for nvtabular==0.6.0+3.g78c8ae4 /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/easy_install.py:156: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools. warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.0.0.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.0.1.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.0.2.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.1.0.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.0.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.1.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.2.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.3.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.0.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.1.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.2.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.3.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.4.0.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.5.0.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.6.0.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.6.1.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.7.4.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.7.5.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.7.6.linux-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.8.1.macosx-10.5-x86-64 is an invalid version and will not be supported in a future release warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 10.5-x86-64 is an invalid version and will not be supported in a future release warnings.warn( Running black --check would reformat nvtabular/ops/fill.py would reformat nvtabular/ops/operator.py would reformat setup.py Oh no! πŸ’₯ πŸ’” πŸ’₯ 3 files would be reformatted, 107 files would be left unchanged. Build step 'Execute shell' marked build as failure Performing Post build task... Match found for : : True Logical operation result is TRUE Running script : #!/bin/bash cd /var/jenkins_home/ CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" [nvtabular_tests] $ /bin/bash /tmp/jenkins8362599707933361944.sh

nvidia-merlin-bot avatar Nov 17 '21 16:11 nvidia-merlin-bot

@rnyak Awesome.

Then, do we still need this notebook, https://github.com/NVIDIA-Merlin/NVTabular/blob/main/examples/getting-started-movielens/inference-HugeCTR/Training-with-HugeCTR.ipynb ?

albert17 avatar Nov 17 '21 16:11 albert17

Click to view CI Results
GitHub pull request #1021 of commit 44e957babd909db09989d5b80b3c990fe07f7087, has merge conflicts.
Running as SYSTEM
Setting status of 44e957babd909db09989d5b80b3c990fe07f7087 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3848/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
 > git rev-parse 44e957babd909db09989d5b80b3c990fe07f7087^{commit} # timeout=10
Checking out Revision 44e957babd909db09989d5b80b3c990fe07f7087 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 44e957babd909db09989d5b80b3c990fe07f7087 # timeout=10
Commit message: "solved multi-hot issue in movielens example"
 > git rev-list --no-walk 21cf20a5b0d00eb3366c97c4351234c40df48a63 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins372624190229744329.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.3.1)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (59.4.0)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.0)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.8.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> 
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+4.g44e957b is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular Processing dependencies for nvtabular==0.6.0+4.g44e957b Searching for pyarrow==4.0.1 Best match: pyarrow 4.0.1 Adding pyarrow 4.0.1 to easy-install.pth file Installing plasma_store script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for tqdm==4.61.2 Best match: tqdm 4.61.2 Processing tqdm-4.61.2-py3.8.egg tqdm 4.61.2 is already the active version in easy-install.pth Installing tqdm script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg Searching for numba==0.54.1 Best match: numba 0.54.1 Adding numba 0.54.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for pandas==1.2.5 Best match: pandas 1.2.5 Processing pandas-1.2.5-py3.8-linux-x86_64.egg Removing pandas 1.3.3 from easy-install.pth file Adding pandas 1.2.5 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages/pandas-1.2.5-py3.8-linux-x86_64.egg Searching for distributed==2021.4.1 Best match: distributed 2021.4.1 Processing distributed-2021.4.1-py3.8.egg Removing distributed 2021.7.1 from easy-install.pth file Adding distributed 2021.4.1 to easy-install.pth file Installing dask-ssh script to /var/jenkins_home/.local/bin Installing dask-scheduler script to /var/jenkins_home/.local/bin Installing dask-worker script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/distributed-2021.4.1-py3.8.egg Searching for dask==2021.4.1 Best match: dask 2021.4.1 Processing dask-2021.4.1-py3.8.egg Removing dask 2021.7.1 from easy-install.pth file Adding dask 2021.4.1 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg Searching for PyYAML==5.4.1 Best match: PyYAML 5.4.1 Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg PyYAML 5.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg Searching for numpy==1.20.3 Best match: numpy 1.20.3 Adding numpy 1.20.3 to easy-install.pth file Installing f2py script to /var/jenkins_home/.local/bin Installing f2py3 script to /var/jenkins_home/.local/bin Installing f2py3.8 script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for llvmlite==0.37.0 Best match: llvmlite 0.37.0 Processing llvmlite-0.37.0-py3.8-linux-x86_64.egg llvmlite 0.37.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/llvmlite-0.37.0-py3.8-linux-x86_64.egg Searching for setuptools==59.4.0 Best match: setuptools 59.4.0 Adding setuptools 59.4.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for pytz==2021.3 Best match: pytz 2021.3 Adding pytz 2021.3 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for python-dateutil==2.8.2 Best match: python-dateutil 2.8.2 Adding python-dateutil 2.8.2 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for zict==2.0.0 Best match: zict 2.0.0 Processing zict-2.0.0-py3.8.egg zict 2.0.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg Searching for tornado==6.1 Best match: tornado 6.1 Processing tornado-6.1-py3.8-linux-x86_64.egg tornado 6.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg Searching for toolz==0.11.1 Best match: toolz 0.11.1 Processing toolz-0.11.1-py3.8.egg toolz 0.11.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg Searching for tblib==1.7.0 Best match: tblib 1.7.0 Processing tblib-1.7.0-py3.8.egg tblib 1.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg Searching for sortedcontainers==2.4.0 Best match: sortedcontainers 2.4.0 Processing sortedcontainers-2.4.0-py3.8.egg sortedcontainers 2.4.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg Searching for psutil==5.8.0 Best match: psutil 5.8.0 Processing psutil-5.8.0-py3.8-linux-x86_64.egg psutil 5.8.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg Searching for msgpack==1.0.2 Best match: msgpack 1.0.2 Processing msgpack-1.0.2-py3.8-linux-x86_64.egg msgpack 1.0.2 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg Searching for cloudpickle==1.6.0 Best match: cloudpickle 1.6.0 Processing cloudpickle-1.6.0-py3.8.egg cloudpickle 1.6.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg Searching for click==8.0.1 Best match: click 8.0.1 Processing click-8.0.1-py3.8.egg click 8.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg Searching for partd==1.2.0 Best match: partd 1.2.0 Processing partd-1.2.0-py3.8.egg partd 1.2.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg Searching for fsspec==2021.11.1 Best match: fsspec 2021.11.1 Adding fsspec 2021.11.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for six==1.15.0 Best match: six 1.15.0 Adding six 1.15.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for HeapDict==1.0.1 Best match: HeapDict 1.0.1 Processing HeapDict-1.0.1-py3.8.egg HeapDict 1.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg Searching for locket==0.2.1 Best match: locket 0.2.1 Processing locket-0.2.1-py3.8.egg locket 0.2.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg Finished processing dependencies for nvtabular==0.6.0+4.g44e957b /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/easy_install.py:156: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools. warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. warnings.warn( Running black --check would reformat nvtabular/ops/fill.py would reformat nvtabular/ops/operator.py would reformat setup.py Oh no! πŸ’₯ πŸ’” πŸ’₯ 3 files would be reformatted, 107 files would be left unchanged. Build step 'Execute shell' marked build as failure Performing Post build task... Match found for : : True Logical operation result is TRUE Running script : #!/bin/bash cd /var/jenkins_home/ CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" [nvtabular_tests] $ /bin/bash /tmp/jenkins7655371699406797279.sh

nvidia-merlin-bot avatar Dec 03 '21 08:12 nvidia-merlin-bot