NVTabular MultiGPU TensorFlow uses Keras

Updated the multi-GPU TensorFlow example with TF.Keras as this is easier to use

Dec 14 '21 11:12 bschifferer

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

Dec 14 '21 11:12 review-notebook-app[bot]

Click to view CI Results

GitHub pull request #1321 of commit be3d3a91138c649ca494570c7f47c43597efe1e1, no merge conflicts. Running as SYSTEM Setting status of be3d3a91138c649ca494570c7f47c43597efe1e1 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3926/ and message: 'Pending' Using context: Jenkins Unit Test Run Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests using credential nvidia-merlin-bot Cloning the remote Git repository Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10 Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git > git --version # timeout=10 using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10 Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1321/*:refs/remotes/origin/pr/1321/* # timeout=10 > git rev-parse be3d3a91138c649ca494570c7f47c43597efe1e1^{commit} # timeout=10 Checking out Revision be3d3a91138c649ca494570c7f47c43597efe1e1 (detached) > git config core.sparsecheckout # timeout=10 > git checkout -f be3d3a91138c649ca494570c7f47c43597efe1e1 # timeout=10 Commit message: "update keras" > git rev-list --no-walk 3f3c3bb0d722224730030d2a45ccf7001a6efb3f # timeout=10 First time build. Skipping changelog. [nvtabular_tests] $ /bin/bash /tmp/jenkins502869898063893300.sh Installing NVTabular Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.3.1) Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (59.6.0) Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.0) Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.8.1) Requirement already satisfied: numpy==1.20.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (1.20.3) WARNING: Skipping nvtabular as it is not installed. running develop running egg_info creating nvtabular.egg-info writing nvtabular.egg-info/PKG-INFO writing dependency_links to nvtabular.egg-info/dependency_links.txt writing requirements to nvtabular.egg-info/requires.txt writing top-level names to nvtabular.egg-info/top_level.txt writing manifest file 'nvtabular.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/easy_install.py:156: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools. warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. warnings.warn( warning: no files found matching '*.h' under directory 'cpp' warning: no files found matching '*.cu' under directory 'cpp' warning: no files found matching '*.cuh' under directory 'cpp' adding license file 'LICENSE' writing manifest file 'nvtabular.egg-info/SOURCES.txt' running build_ext x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17 building 'nvtabular_cpp' extension creating build creating build/temp.linux-x86_64-3.8 creating build/temp.linux-x86_64-3.8/cpp creating build/temp.linux-x86_64-3.8/cpp/nvtabular creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+39.gbe3d3a9 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0 x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+39.gbe3d3a9 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0 x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+39.gbe3d3a9 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0 x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+39.gbe3d3a9 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0 creating build/lib.linux-x86_64-3.8 x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .) nvtabular 0.8.0+39.gbe3d3a9 is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular Processing dependencies for nvtabular==0.8.0+39.gbe3d3a9 Searching for protobuf==3.19.1 Best match: protobuf 3.19.1 Adding protobuf 3.19.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for tensorflow-metadata==1.2.0 Best match: tensorflow-metadata 1.2.0 Processing tensorflow_metadata-1.2.0-py3.8.egg tensorflow-metadata 1.2.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow_metadata-1.2.0-py3.8.egg Searching for pyarrow==4.0.1 Best match: pyarrow 4.0.1 Adding pyarrow 4.0.1 to easy-install.pth file Installing plasma_store script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for tqdm==4.61.2 Best match: tqdm 4.61.2 Processing tqdm-4.61.2-py3.8.egg tqdm 4.61.2 is already the active version in easy-install.pth Installing tqdm script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg Searching for numba==0.54.1 Best match: numba 0.54.1 Adding numba 0.54.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for pandas==1.3.3 Best match: pandas 1.3.3 Processing pandas-1.3.3-py3.8-linux-x86_64.egg pandas 1.3.3 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/pandas-1.3.3-py3.8-linux-x86_64.egg Searching for distributed==2021.7.1 Best match: distributed 2021.7.1 Processing distributed-2021.7.1-py3.8.egg distributed 2021.7.1 is already the active version in easy-install.pth Installing dask-ssh script to /var/jenkins_home/.local/bin Installing dask-scheduler script to /var/jenkins_home/.local/bin Installing dask-worker script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/distributed-2021.7.1-py3.8.egg Searching for dask==2021.7.1 Best match: dask 2021.7.1 Processing dask-2021.7.1-py3.8.egg dask 2021.7.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.7.1-py3.8.egg Searching for googleapis-common-protos==1.53.0 Best match: googleapis-common-protos 1.53.0 Processing googleapis_common_protos-1.53.0-py3.8.egg googleapis-common-protos 1.53.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/googleapis_common_protos-1.53.0-py3.8.egg Searching for absl-py==0.12.0 Best match: absl-py 0.12.0 Processing absl_py-0.12.0-py3.8.egg absl-py 0.12.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/absl_py-0.12.0-py3.8.egg Searching for numpy==1.20.3 Best match: numpy 1.20.3 Adding numpy 1.20.3 to easy-install.pth file Installing f2py script to /var/jenkins_home/.local/bin Installing f2py3 script to /var/jenkins_home/.local/bin Installing f2py3.8 script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for llvmlite==0.37.0 Best match: llvmlite 0.37.0 Processing llvmlite-0.37.0-py3.8-linux-x86_64.egg llvmlite 0.37.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/llvmlite-0.37.0-py3.8-linux-x86_64.egg Searching for setuptools==59.6.0 Best match: setuptools 59.6.0 Adding setuptools 59.6.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for pytz==2021.3 Best match: pytz 2021.3 Adding pytz 2021.3 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for python-dateutil==2.8.2 Best match: python-dateutil 2.8.2 Adding python-dateutil 2.8.2 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for zict==2.0.0 Best match: zict 2.0.0 Processing zict-2.0.0-py3.8.egg zict 2.0.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg Searching for tornado==6.1 Best match: tornado 6.1 Processing tornado-6.1-py3.8-linux-x86_64.egg tornado 6.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg Searching for toolz==0.11.1 Best match: toolz 0.11.1 Processing toolz-0.11.1-py3.8.egg toolz 0.11.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg Searching for tblib==1.7.0 Best match: tblib 1.7.0 Processing tblib-1.7.0-py3.8.egg tblib 1.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg Searching for sortedcontainers==2.4.0 Best match: sortedcontainers 2.4.0 Processing sortedcontainers-2.4.0-py3.8.egg sortedcontainers 2.4.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg Searching for PyYAML==5.4.1 Best match: PyYAML 5.4.1 Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg PyYAML 5.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg Searching for psutil==5.8.0 Best match: psutil 5.8.0 Processing psutil-5.8.0-py3.8-linux-x86_64.egg psutil 5.8.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg Searching for msgpack==1.0.2 Best match: msgpack 1.0.2 Processing msgpack-1.0.2-py3.8-linux-x86_64.egg msgpack 1.0.2 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg Searching for cloudpickle==1.6.0 Best match: cloudpickle 1.6.0 Processing cloudpickle-1.6.0-py3.8.egg cloudpickle 1.6.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg Searching for click==8.0.1 Best match: click 8.0.1 Processing click-8.0.1-py3.8.egg click 8.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg Searching for partd==1.2.0 Best match: partd 1.2.0 Processing partd-1.2.0-py3.8.egg partd 1.2.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg Searching for packaging==21.2 Best match: packaging 21.2 Adding packaging 21.2 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for fsspec==2021.11.1 Best match: fsspec 2021.11.1 Adding fsspec 2021.11.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for six==1.15.0 Best match: six 1.15.0 Adding six 1.15.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for HeapDict==1.0.1 Best match: HeapDict 1.0.1 Processing HeapDict-1.0.1-py3.8.egg HeapDict 1.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg Searching for locket==0.2.1 Best match: locket 0.2.1 Processing locket-0.2.1-py3.8.egg locket 0.2.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg Searching for pyparsing==2.4.7 Best match: pyparsing 2.4.7 Adding pyparsing 2.4.7 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Finished processing dependencies for nvtabular==0.8.0+39.gbe3d3a9 Running black --check All done! ✨ 🍰 ✨ 169 files would be left unchanged. Running flake8 Running isort Skipped 2 files Running bandit Running pylint ************* Module nvtabular.dispatch nvtabular/dispatch.py:607:11: I1101: Module 'numpy.random.mtrand' has no 'RandomState' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) ************* Module nvtabular.ops.categorify nvtabular/ops/categorify.py:516:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member) ************* Module nvtabular.ops.fill nvtabular/ops/fill.py:67:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb Building docs make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs' /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.7) or chardet (3.0.4) doesn't match a supported version! warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported " /usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document warn("Container node skipped: type={0}".format(mdnode.t)) /usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document warn("Container node skipped: type={0}".format(mdnode.t)) /usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document warn("Container node skipped: type={0}".format(mdnode.t)) make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs' ============================= test session starts ============================== platform linux -- Python 3.8.10, pytest-6.2.5, py-1.11.0, pluggy-1.0.0 rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml plugins: xdist-2.5.0, forked-1.4.0, cov-3.0.0 collected 1592 items / 1 skipped / 1591 selected

tests/unit/test_dask_nvt.py ............................................ [ 2%] ....................................................................... [ 7%] tests/unit/test_io.py .................................................. [ 10%] ........................................................................ [ 14%] ..................ssssssss.............................................. [ 19%] ......... [ 19%] tests/unit/test_notebooks.py ...... [ 20%] tests/unit/test_tf4rec.py . [ 20%] tests/unit/test_tools.py ...................... [ 21%] tests/unit/test_triton_inference.py ................................ [ 23%] tests/unit/framework_utils/test_tf_feature_columns.py . [ 23%] tests/unit/framework_utils/test_tf_layers.py ........................... [ 25%] ................................................... [ 28%] tests/unit/framework_utils/test_torch_layers.py . [ 28%] tests/unit/graph/test_column_schemas.py ................................ [ 30%] .................................................. [ 33%] tests/unit/graph/test_column_selector.py .................... [ 35%] tests/unit/graph/ops/test_selection.py ... [ 35%] tests/unit/inference/test_ensemble.py . [ 35%] tests/unit/inference/test_export.py . [ 35%] tests/unit/inference/test_graph.py . [ 35%] tests/unit/inference/test_inference_ops.py .. [ 35%] tests/unit/inference/test_op_runner.py ... [ 35%] tests/unit/inference/test_tensorflow_inf_op.py ... [ 36%] tests/unit/loader/test_dataloader_backend.py ...... [ 36%] tests/unit/loader/test_tf_dataloader.py ................................ [ 38%] ........................................s.. [ 41%] tests/unit/loader/test_torch_dataloader.py ............................. [ 43%] ........................................................ [ 46%] tests/unit/ops/test_categorify.py ...................................... [ 48%] ................................................................. [ 53%] tests/unit/ops/test_column_similarity.py ........................ [ 54%] tests/unit/ops/test_fill.py ............................................ [ 57%] ........ [ 57%] tests/unit/ops/test_hash_bucket.py ......................... [ 59%] tests/unit/ops/test_join.py ............................................ [ 62%] ........................................................................ [ 66%] .................................. [ 68%] tests/unit/ops/test_lambda.py .... [ 69%] tests/unit/ops/test_normalize.py ....................................... [ 71%] .. [ 71%] tests/unit/ops/test_ops.py ............................................. [ 74%] .......................... [ 76%] tests/unit/ops/test_ops_schema.py ...................................... [ 78%] ........................................................................ [ 82%] ........................................................................ [ 87%] ....................................... [ 89%] tests/unit/ops/test_target_encode.py ..................... [ 91%] tests/unit/workflow/test_cpu_workflow.py ...... [ 91%] tests/unit/workflow/test_workflow.py ................................... [ 93%] ........................................................... [ 97%] tests/unit/workflow/test_workflow_node.py ........... [ 98%] tests/unit/workflow/test_workflow_ops.py ... [ 98%] tests/unit/workflow/test_workflow_schemas.py ......................... [100%]

=============================== warnings summary =============================== tests/unit/test_dask_nvt.py: 3 warnings tests/unit/test_io.py: 24 warnings tests/unit/test_tf4rec.py: 1 warning tests/unit/test_tools.py: 2 warnings tests/unit/test_triton_inference.py: 7 warnings tests/unit/inference/test_export.py: 1 warning tests/unit/loader/test_tf_dataloader.py: 54 warnings tests/unit/loader/test_torch_dataloader.py: 54 warnings tests/unit/ops/test_categorify.py: 1 warning tests/unit/ops/test_column_similarity.py: 7 warnings tests/unit/ops/test_fill.py: 24 warnings tests/unit/ops/test_join.py: 1 warning tests/unit/ops/test_normalize.py: 28 warnings tests/unit/ops/test_ops.py: 4 warnings tests/unit/ops/test_target_encode.py: 21 warnings tests/unit/workflow/test_workflow.py: 30 warnings tests/unit/workflow/test_workflow_node.py: 1 warning tests/unit/workflow/test_workflow_schemas.py: 1 warning /usr/local/lib/python3.8/dist-packages/numba/cuda/compiler.py:865: NumbaPerformanceWarning: [1mGrid size (1) < 2 * SM count (112) will likely result in GPU under utilization due to low occupancy.[0m warn(NumbaPerformanceWarning(msg))

tests/unit/test_dask_nvt.py: 12 warnings /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 2 files did not have enough partitions to create 8 files. warnings.warn(

tests/unit/test_dask_nvt.py: 2 warnings tests/unit/test_io.py: 36 warnings tests/unit/workflow/test_workflow.py: 44 warnings /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/workflow/workflow.py:86: UserWarning: A global dask.distributed client has been detected, but the single-threaded scheduler will be used for execution. Please use the client argument to initialize a Workflow object with distributed-execution enabled. warnings.warn(

tests/unit/test_dask_nvt.py: 2 warnings tests/unit/test_io.py: 52 warnings tests/unit/workflow/test_workflow.py: 35 warnings /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dask.py:375: UserWarning: A global dask.distributed client has been detected, but the single-threaded scheduler will be used for this write operation. Please use the client argument to initialize a Dataset and/or Workflow object with distributed-execution enabled. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 6 files did not have enough partitions to create 7 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 8 files did not have enough partitions to create 9 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 8 files did not have enough partitions to create 10 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 8 files did not have enough partitions to create 11 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 12 files did not have enough partitions to create 13 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 12 files did not have enough partitions to create 14 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 12 files did not have enough partitions to create 15 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 12 files did not have enough partitions to create 16 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 12 files did not have enough partitions to create 17 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 12 files did not have enough partitions to create 18 files. warnings.warn(

tests/unit/test_io.py::test_io_partitions_push /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 12 files did not have enough partitions to create 19 files. warnings.warn(

tests/unit/test_io.py: 96 warnings /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/init.py:38: DeprecationWarning: ColumnGroup is deprecated, use ColumnSelector instead warnings.warn("ColumnGroup is deprecated, use ColumnSelector instead", DeprecationWarning)

tests/unit/test_io.py: 12 warnings tests/unit/workflow/test_workflow.py: 36 warnings /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 2 files did not have enough partitions to create 20 files. warnings.warn(

tests/unit/test_io.py::test_multifile_parquet[False-Shuffle.PER_WORKER-5-0-csv] tests/unit/test_io.py::test_multifile_parquet[False-Shuffle.PER_WORKER-5-2-csv] tests/unit/test_io.py::test_multifile_parquet[False-None-5-0-csv] tests/unit/test_io.py::test_multifile_parquet[False-None-5-2-csv] tests/unit/loader/test_torch_dataloader.py::test_horovod_multigpu tests/unit/loader/test_torch_dataloader.py::test_distributed_multigpu /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 1 files did not have enough partitions to create 5 files. warnings.warn(

tests/unit/test_io.py::test_to_parquet_output_files[Shuffle.PER_WORKER-4-6] tests/unit/test_io.py::test_to_parquet_output_files[False-4-6] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 2 files did not have enough partitions to create 6 files. warnings.warn(

tests/unit/test_io.py: 6 warnings tests/unit/loader/test_tf_dataloader.py: 2 warnings tests/unit/loader/test_torch_dataloader.py: 12 warnings tests/unit/workflow/test_workflow.py: 9 warnings /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 1 files did not have enough partitions to create 2 files. warnings.warn(

tests/unit/test_io.py: 20 warnings /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:521: UserWarning: A global dask.distributed client has been detected, but the single-threaded scheduler is being used for this shuffle operation. Please use the client argument to initialize a Dataset and/or Workflow object with distributed-execution enabled. warnings.warn(

tests/unit/test_tools.py::test_cat_rep[None-1000] tests/unit/test_tools.py::test_cat_rep[distro1-1000] /usr/local/lib/python3.8/dist-packages/numba/cuda/compiler.py:865: NumbaPerformanceWarning: [1mGrid size (3) < 2 * SM count (112) will likely result in GPU under utilization due to low occupancy.[0m warn(NumbaPerformanceWarning(msg))

tests/unit/test_tools.py::test_cat_rep[None-10000] tests/unit/test_tools.py::test_cat_rep[distro1-10000] /usr/local/lib/python3.8/dist-packages/numba/cuda/compiler.py:865: NumbaPerformanceWarning: [1mGrid size (30) < 2 * SM count (112) will likely result in GPU under utilization due to low occupancy.[0m warn(NumbaPerformanceWarning(msg))

tests/unit/inference/test_ensemble.py::test_workflow_tf_e2e_config_verification[parquet] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/inference/graph/ops/workflow.py:66: UserWarning: TF model expects int32 for column x_nvt, but workflow is producing type float64. Overriding dtype in NVTabular workflow. warnings.warn(

tests/unit/inference/test_export.py::test_export_run_ensemble_triton[tensorflow-parquet] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/inference/triton/ensemble.py:79: UserWarning: TF model expects int32 for column name-cat, but workflow is producing type int64. Overriding dtype in NVTabular workflow. warnings.warn(

tests/unit/inference/test_export.py::test_export_run_ensemble_triton[tensorflow-parquet] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/inference/triton/ensemble.py:79: UserWarning: TF model expects int32 for column name-string, but workflow is producing type int64. Overriding dtype in NVTabular workflow. warnings.warn(

tests/unit/inference/test_export.py::test_export_run_ensemble_triton[tensorflow-parquet] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/inference/triton/ensemble.py:278: UserWarning: Column x is being generated by NVTabular workflow but is unused in test_name_tf model warnings.warn(

tests/unit/inference/test_export.py::test_export_run_ensemble_triton[tensorflow-parquet] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/inference/triton/ensemble.py:278: UserWarning: Column y is being generated by NVTabular workflow but is unused in test_name_tf model warnings.warn(

tests/unit/inference/test_export.py::test_export_run_ensemble_triton[tensorflow-parquet] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/inference/triton/ensemble.py:278: UserWarning: Column id is being generated by NVTabular workflow but is unused in test_name_tf model warnings.warn(

tests/unit/loader/test_tf_dataloader.py::test_nested_list /usr/local/lib/python3.8/dist-packages/numba/cuda/compiler.py:865: NumbaPerformanceWarning: [1mGrid size (2) < 2 * SM count (112) will likely result in GPU under utilization due to low occupancy.[0m warn(NumbaPerformanceWarning(msg))

tests/unit/loader/test_tf_dataloader.py::test_sparse_tensors[False] tests/unit/loader/test_tf_dataloader.py::test_sparse_tensors[True] /usr/local/lib/python3.8/dist-packages/numba/cuda/compiler.py:865: NumbaPerformanceWarning: [1mGrid size (25) < 2 * SM count (112) will likely result in GPU under utilization due to low occupancy.[0m warn(NumbaPerformanceWarning(msg))

tests/unit/loader/test_tf_dataloader.py::test_sparse_tensors[False] tests/unit/loader/test_tf_dataloader.py::test_sparse_tensors[True] /usr/local/lib/python3.8/dist-packages/numba/cuda/compiler.py:865: NumbaPerformanceWarning: [1mGrid size (35) < 2 * SM count (112) will likely result in GPU under utilization due to low occupancy.[0m warn(NumbaPerformanceWarning(msg))

tests/unit/ops/test_fill.py::test_fill_missing[True-True-parquet] tests/unit/ops/test_fill.py::test_fill_missing[True-False-parquet] tests/unit/ops/test_ops.py::test_filter[parquet-0.1-True] /var/jenkins_home/.local/lib/python3.8/site-packages/pandas-1.3.3-py3.8-linux-x86_64.egg/pandas/core/indexing.py:1732: SettingWithCopyWarning: A value is trying to be set on a copy of a slice from a DataFrame

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy self._setitem_single_block(indexer, value, name)

tests/unit/ops/test_ops.py::test_filter[parquet-0.1-True] tests/unit/ops/test_ops.py::test_filter[parquet-0.1-True] tests/unit/ops/test_ops.py::test_filter[parquet-0.1-False] tests/unit/ops/test_ops.py::test_filter[parquet-0.1-False] /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.7.1-py3.8.egg/dask/dataframe/core.py:6778: UserWarning: Insufficient elements for head. 1 elements requested, only 0 elements available. Try passing larger npartitions to head. warnings.warn(msg.format(n, len(r)))

tests/unit/workflow/test_cpu_workflow.py: 6 warnings tests/unit/workflow/test_workflow.py: 24 warnings tests/unit/workflow/test_workflow_schemas.py: 1 warning /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 1 files did not have enough partitions to create 10 files. warnings.warn(

tests/unit/workflow/test_workflow.py::test_parquet_output[True-Shuffle.PER_WORKER] tests/unit/workflow/test_workflow.py::test_parquet_output[True-Shuffle.PER_PARTITION] tests/unit/workflow/test_workflow.py::test_parquet_output[True-None] tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-Shuffle.PER_WORKER] tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-Shuffle.PER_PARTITION] tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-None] tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-Shuffle.PER_WORKER] tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-Shuffle.PER_PARTITION] tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-None] /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/io/dataset.py:868: UserWarning: Only created 2 files did not have enough partitions to create 4 files. warnings.warn(

-- Docs: https://docs.pytest.org/en/stable/warnings.html

---------- coverage: platform linux, python 3.8.10-final-0 ----------- Name Stmts Miss Branch BrPart Cover Missing

examples/multi-gpu-movielens/torch_trainer.py 65 0 6 1 99% 32->36 examples/multi-gpu-movielens/torch_trainer_dist.py 63 0 2 0 100% nvtabular/init.py 18 0 0 0 100% nvtabular/dispatch.py 341 79 166 29 75% 37-39, 42-46, 51-53, 59-69, 76-77, 118-120, 128-130, 135-138, 142-147, 154, 173, 184, 190, 195->197, 208, 231-234, 265->267, 274, 278-280, 286, 311, 318, 349->354, 352, 355, 358->362, 397, 408-411, 416, 438, 445-448, 478, 482, 523, 547, 549, 556, 571-585, 600, 607 nvtabular/framework_utils/init.py 0 0 0 0 100% nvtabular/framework_utils/tensorflow/init.py 1 0 0 0 100% nvtabular/framework_utils/tensorflow/feature_column_utils.py 134 78 90 15 39% 30, 99, 103, 114-130, 140, 143-158, 162, 166-167, 173-198, 207-217, 220-227, 229->233, 234, 239-279, 282 nvtabular/framework_utils/tensorflow/layers/init.py 4 0 0 0 100% nvtabular/framework_utils/tensorflow/layers/embedding.py 153 12 89 6 91% 60, 68->49, 122, 179, 231-239, 335->343, 357->360, 363-364, 367 nvtabular/framework_utils/tensorflow/layers/interaction.py 47 25 22 1 45% 49, 74-103, 106-110, 113 nvtabular/framework_utils/tensorflow/layers/outer_product.py 30 24 12 0 19% 37-38, 41-60, 71-84, 87 nvtabular/framework_utils/tensorflow/tfrecords_to_parquet.py 58 58 30 0 0% 16-111 nvtabular/framework_utils/torch/init.py 0 0 0 0 100% nvtabular/framework_utils/torch/layers/init.py 2 0 0 0 100% nvtabular/framework_utils/torch/layers/embeddings.py 32 2 18 2 92% 50, 91 nvtabular/framework_utils/torch/models.py 45 1 30 4 93% 57->61, 87->89, 93->96, 103 nvtabular/framework_utils/torch/utils.py 75 5 34 5 91% 51->53, 64, 71->76, 75, 118-120 nvtabular/graph/init.py 4 0 0 0 100% nvtabular/graph/base_operator.py 68 2 22 1 94% 161, 165 nvtabular/graph/graph.py 55 1 36 1 98% 47 nvtabular/graph/node.py 278 46 154 15 80% 49, 76-84, 107, 165, 254, 264-265, 312, 330, 339, 349-354, 359, 381, 390-398, 406-409, 422-423, 431, 432->415, 438-441, 445, 479-484, 503 nvtabular/graph/ops/init.py 5 0 0 0 100% nvtabular/graph/ops/concat_columns.py 11 0 2 0 100% nvtabular/graph/ops/identity.py 6 1 2 0 88% 41 nvtabular/graph/ops/selection.py 19 0 2 0 100% nvtabular/graph/ops/subset_columns.py 13 1 2 0 93% 52 nvtabular/graph/ops/subtraction.py 10 2 2 0 83% 28-29 nvtabular/graph/schema.py 120 6 59 5 94% 38, 65, 167, 174, 199, 202 nvtabular/graph/schema_io/init.py 0 0 0 0 100% nvtabular/graph/schema_io/schema_writer_base.py 8 0 2 0 100% nvtabular/graph/schema_io/schema_writer_pbtxt.py 122 8 58 11 89% 45, 61->68, 64->66, 75, 92->97, 95->97, 118->133, 124-127, 169->185, 177, 181 nvtabular/graph/selector.py 78 0 40 0 100% nvtabular/graph/tags.py 16 0 2 0 100% nvtabular/inference/init.py 0 0 0 0 100% nvtabular/inference/graph/init.py 3 0 0 0 100% nvtabular/inference/graph/ensemble.py 55 0 10 0 100% nvtabular/inference/graph/node.py 3 0 2 0 100% nvtabular/inference/graph/op_runner.py 21 0 8 0 100% nvtabular/inference/graph/ops/init.py 0 0 0 0 100% nvtabular/inference/graph/ops/operator.py 29 6 12 1 78% 12-13, 18, 35, 39, 45 nvtabular/inference/graph/ops/tensorflow.py 41 11 14 1 75% 47-60 nvtabular/inference/graph/ops/workflow.py 36 0 10 1 98% 65->62 nvtabular/inference/triton/init.py 36 12 14 1 58% 42-49, 68, 72, 76-82 nvtabular/inference/triton/benchmarking_tools.py 52 52 10 0 0% 2-103 nvtabular/inference/triton/data_conversions.py 87 3 58 4 95% 32-33, 84 nvtabular/inference/triton/ensemble.py 290 139 106 7 55% 139-172, 217-261, 360-368, 394-410, 463-473, 522-562, 568-584, 588-655, 662->665, 665->661, 682->681, 747, 753-772, 778-802, 809 nvtabular/inference/triton/model/init.py 0 0 0 0 100% nvtabular/inference/triton/model/model_pt.py 101 101 42 0 0% 27-220 nvtabular/inference/triton/model_config_pb2.py 299 0 2 0 100% nvtabular/inference/triton/workflow_model.py 53 53 22 0 0% 27-125 nvtabular/inference/workflow/init.py 0 0 0 0 100% nvtabular/inference/workflow/base.py 92 92 56 0 0% 27-177 nvtabular/inference/workflow/hugectr.py 37 37 16 0 0% 27-87 nvtabular/inference/workflow/pytorch.py 10 10 6 0 0% 27-46 nvtabular/inference/workflow/tensorflow.py 31 31 10 0 0% 26-67 nvtabular/io/init.py 5 0 0 0 100% nvtabular/io/avro.py 88 88 32 0 0% 16-189 nvtabular/io/csv.py 57 6 22 5 86% 22-23, 99, 103->107, 108, 110, 124 nvtabular/io/dask.py 183 8 74 11 93% 111, 114, 150, 401, 411, 428->431, 439, 443->445, 445->441, 450, 452 nvtabular/io/dataframe_engine.py 61 5 30 6 88% 19-20, 50, 69, 88->92, 92->97, 94->97, 97->116, 125 nvtabular/io/dataframe_iter.py 21 1 14 1 94% 42 nvtabular/io/dataset.py 346 43 168 28 85% 48-49, 268, 270, 283, 308-322, 446->520, 451-454, 459->469, 476->474, 477->481, 494->498, 509, 520->529, 580-581, 582->586, 634, 762, 764, 766, 772, 776-778, 780, 840-841, 875, 882-883, 889, 895, 992-993, 1111-1116, 1122, 1134-1135 nvtabular/io/dataset_engine.py 31 1 6 0 97% 48 nvtabular/io/fsspec_utils.py 115 101 64 0 8% 26-27, 42-98, 103-114, 151-198, 220-270, 275-291, 295-297, 311-322 nvtabular/io/hugectr.py 45 2 26 2 92% 34, 74->97, 101 nvtabular/io/parquet.py 590 48 218 30 88% 34-35, 58, 80->156, 87, 101, 113-127, 140-153, 176, 205-206, 223->248, 234->248, 285-293, 313, 319, 337->339, 353, 371->381, 374, 423->435, 427, 549-554, 592-597, 713->720, 781->786, 787-788, 908, 912, 916, 922, 954, 971, 975, 982->984, 1092->exit, 1096->1093, 1103->1108, 1113->1123, 1128, 1150, 1177 nvtabular/io/shuffle.py 31 7 18 4 73% 42, 44-45, 49, 62-64 nvtabular/io/writer.py 184 13 78 5 92% 24-25, 51, 79, 125, 128, 212, 221, 224, 267, 299-301 nvtabular/io/writer_factory.py 18 2 8 2 85% 35, 60 nvtabular/loader/init.py 0 0 0 0 100% nvtabular/loader/backend.py 372 16 154 11 95% 27-28, 159-160, 300->302, 312-316, 363-364, 403->407, 404->403, 479, 483-484, 513, 589-590, 625, 633 nvtabular/loader/tensorflow.py 168 20 58 7 88% 66, 83, 97, 311, 339, 350, 365-367, 396-398, 408-416, 419-422 nvtabular/loader/tf_utils.py 57 10 22 6 80% 32->35, 35->37, 42->44, 46, 47->68, 53-54, 62-64, 70-74 nvtabular/loader/torch.py 87 14 26 3 80% 28-30, 33-39, 114, 158-159, 164 nvtabular/ops/init.py 23 0 0 0 100% nvtabular/ops/add_metadata.py 17 0 4 0 100% nvtabular/ops/bucketize.py 37 10 20 3 70% 53-55, 59->exit, 62-65, 84-87, 94 nvtabular/ops/categorify.py 655 69 352 47 87% 251, 253, 271, 275, 283, 291, 293, 320, 341-342, 378, 389->393, 397-404, 486-487, 511-516, 619, 715, 732, 777, 855-856, 871-875, 876->840, 894, 902, 909->exit, 933, 936->939, 988->986, 1048, 1053, 1074->1078, 1080->1035, 1086-1089, 1101, 1105, 1109, 1116, 1121-1124, 1202, 1204, 1274->1296, 1280->1296, 1297-1302, 1342, 1359->1364, 1363, 1373->1370, 1378->1370, 1385, 1388, 1396-1406 nvtabular/ops/clip.py 18 2 8 3 81% 44, 52->54, 55 nvtabular/ops/column_similarity.py 121 27 40 5 74% 19-20, 29-30, 82->exit, 112, 138, 202-203, 212-214, 222-238, 255->258, 259, 269 nvtabular/ops/data_stats.py 56 2 24 3 94% 91->93, 95, 97->87, 102 nvtabular/ops/difference_lag.py 33 1 12 1 96% 73->75, 98 nvtabular/ops/dropna.py 8 0 2 0 100% nvtabular/ops/fill.py 91 12 40 3 82% 63-67, 93, 121, 147, 151, 162-165 nvtabular/ops/filter.py 20 1 8 1 93% 49 nvtabular/ops/groupby.py 128 6 82 5 94% 72, 83, 93->95, 105->110, 137, 141-146 nvtabular/ops/hash_bucket.py 40 2 22 2 94% 73, 106->112, 118 nvtabular/ops/hashed_cross.py 36 4 17 3 87% 53, 66, 81, 91 nvtabular/ops/join_external.py 92 18 38 7 76% 20-21, 114, 116, 118, 135-161, 177->179, 216->227, 221 nvtabular/ops/join_groupby.py 101 7 38 4 92% 108, 115, 124, 131->130, 215-216, 219-220 nvtabular/ops/lambdaop.py 39 6 20 6 80% 59, 63, 77, 89, 94, 103 nvtabular/ops/list_slice.py 85 29 42 0 63% 21-22, 141-155, 163-185 nvtabular/ops/logop.py 19 0 6 0 100% nvtabular/ops/moments.py 69 0 24 0 100% nvtabular/ops/normalize.py 89 10 22 1 88% 89, 97-98, 104, 137-138, 160-161, 165, 176 nvtabular/ops/operator.py 12 1 2 0 93% 53 nvtabular/ops/rename.py 41 3 24 3 91% 47, 88-90 nvtabular/ops/stat_operator.py 8 0 2 0 100% nvtabular/ops/target_encoding.py 154 11 68 4 91% 168->172, 176->185, 233-234, 237-238, 250-256, 347->350, 363 nvtabular/ops/value_counts.py 30 0 6 1 97% 40->38 nvtabular/tools/init.py 0 0 0 0 100% nvtabular/tools/data_gen.py 251 12 86 6 95% 25-26, 124-127, 137-139, 161-162, 313, 323, 349 nvtabular/tools/dataset_inspector.py 50 7 22 1 81% 32-39 nvtabular/tools/inspector_script.py 46 46 0 0 0% 17-168 nvtabular/utils.py 106 43 48 8 54% 31-32, 36-37, 50, 61-62, 64-66, 69, 72, 78, 84, 90-126, 145, 149->153 nvtabular/worker.py 80 5 38 7 90% 24-25, 81->97, 89, 90->97, 97->100, 106, 108, 109->111 nvtabular/workflow/init.py 2 0 0 0 100% nvtabular/workflow/node.py 7 0 4 0 100% nvtabular/workflow/workflow.py 200 17 84 10 90% 28-29, 47, 176, 182->196, 208-210, 323, 338-339, 357-358, 374, 450, 466-468, 481

TOTAL 8380 1634 3503 366 78% Coverage XML written to file coverage.xml

Required test coverage of 70% reached. Total coverage: 78.25% =========================== short test summary info ============================ SKIPPED [1] ../../../../../usr/local/lib/python3.8/dist-packages/dask_cudf/io/tests/test_s3.py:16: could not import 's3fs': No module named 's3fs' SKIPPED [8] tests/unit/test_io.py:613: could not import 'uavro': No module named 'uavro' SKIPPED [1] tests/unit/loader/test_tf_dataloader.py:531: not working correctly in ci environment ========= 1583 passed, 10 skipped, 721 warnings in 1447.55s (0:24:07) ========== Performing Post build task... Match found for : : True Logical operation result is TRUE Running script : #!/bin/bash cd /var/jenkins_home/ CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" [nvtabular_tests] $ /bin/bash /tmp/jenkins295705578428510254.sh

Dec 14 '21 11:12 nvidia-merlin-bot

Click to view CI Results

GitHub pull request #1321 of commit 1c5aa3327ab4e886c2791b714bf8697df7a33272, no merge conflicts.
Running as SYSTEM
Setting status of 1c5aa3327ab4e886c2791b714bf8697df7a33272 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3941/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1321/*:refs/remotes/origin/pr/1321/* # timeout=10
 > git rev-parse 1c5aa3327ab4e886c2791b714bf8697df7a33272^{commit} # timeout=10
Checking out Revision 1c5aa3327ab4e886c2791b714bf8697df7a33272 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1c5aa3327ab4e886c2791b714bf8697df7a33272 # timeout=10
Commit message: "Merge branch 'main' into multigpu_tensorflow_movielens"
 > git rev-list --no-walk 93d984f22b0aba812f713cfa6fd44cfaee836783 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins2666342371048549055.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.3.1)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (59.6.0)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.0)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.8.1)
Requirement already satisfied: numpy==1.20.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (1.20.3)
Found existing installation: nvtabular 0.8.0+7.gb459467
ERROR: Exception:
Traceback (most recent call last):
  File "/var/jenkins_home/.local/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 164, in exc_logging_wrapper
    status = run_func(*args)
  File "/var/jenkins_home/.local/lib/python3.8/site-packages/pip/_internal/commands/uninstall.py", line 97, in run
    uninstall_pathset = req.uninstall(
  File "/var/jenkins_home/.local/lib/python3.8/site-packages/pip/_internal/req/req_install.py", line 670, in uninstall
    uninstalled_pathset = UninstallPathSet.from_dist(dist)
  File "/var/jenkins_home/.local/lib/python3.8/site-packages/pip/_internal/req/req_uninstall.py", line 533, in from_dist
    assert (
AssertionError: Egg-link /var/jenkins_home/workspace/nvtabular_tests/nvtabular does not match installed location of nvtabular (at /nvtabular)
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins699321966361151304.sh

Dec 15 '21 21:12 nvidia-merlin-bot

rerun tests

Dec 16 '21 17:12 karlhigley

Click to view CI Results

GitHub pull request #1321 of commit 1c5aa3327ab4e886c2791b714bf8697df7a33272, no merge conflicts.
Running as SYSTEM
Setting status of 1c5aa3327ab4e886c2791b714bf8697df7a33272 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3957/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1321/*:refs/remotes/origin/pr/1321/* # timeout=10
 > git rev-parse 1c5aa3327ab4e886c2791b714bf8697df7a33272^{commit} # timeout=10
Checking out Revision 1c5aa3327ab4e886c2791b714bf8697df7a33272 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1c5aa3327ab4e886c2791b714bf8697df7a33272 # timeout=10
Commit message: "Merge branch 'main' into multigpu_tensorflow_movielens"
 > git rev-list --no-walk 93d984f22b0aba812f713cfa6fd44cfaee836783 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins4249857804844571299.sh
rm: cannot remove '/var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link': No such file or directory
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins6722771596716163527.sh

Dec 16 '21 17:12 nvidia-merlin-bot

Click to view CI Results

GitHub pull request #1321 of commit c39484903a677c7f3cbf93a028cf1485bc87c2e8, no merge conflicts. Running as SYSTEM Setting status of c39484903a677c7f3cbf93a028cf1485bc87c2e8 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3982/ and message: 'Pending' Using context: Jenkins Unit Test Run Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests using credential nvidia-merlin-bot Cloning the remote Git repository Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10 Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git > git --version # timeout=10 using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10 Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1321/*:refs/remotes/origin/pr/1321/* # timeout=10 > git rev-parse c39484903a677c7f3cbf93a028cf1485bc87c2e8^{commit} # timeout=10 Checking out Revision c39484903a677c7f3cbf93a028cf1485bc87c2e8 (detached) > git config core.sparsecheckout # timeout=10 > git checkout -f c39484903a677c7f3cbf93a028cf1485bc87c2e8 # timeout=10 Commit message: "Merge branch 'main' into multigpu_tensorflow_movielens" > git rev-list --no-walk 8bf584ae9109316fbd89e39612e4c54f5cfc3a49 # timeout=10 First time build. Skipping changelog. [nvtabular_tests] $ /bin/bash /tmp/jenkins4957069612185695176.sh Installing NVTabular Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.3.1) Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (59.4.0) Collecting setuptools Downloading setuptools-60.0.4-py3-none-any.whl (952 kB) Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.1) Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.8.1) Requirement already satisfied: numpy==1.20.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (1.20.3) Found existing installation: nvtabular 0.8.0+7.gb459467 Can't uninstall 'nvtabular'. No files were found to uninstall. running develop running egg_info creating nvtabular.egg-info writing nvtabular.egg-info/PKG-INFO writing dependency_links to nvtabular.egg-info/dependency_links.txt writing requirements to nvtabular.egg-info/requires.txt writing top-level names to nvtabular.egg-info/top_level.txt writing manifest file 'nvtabular.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/easy_install.py:156: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools. warnings.warn( /var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. warnings.warn( warning: no files found matching '*.h' under directory 'cpp' warning: no files found matching '*.cu' under directory 'cpp' warning: no files found matching '*.cuh' under directory 'cpp' adding license file 'LICENSE' writing manifest file 'nvtabular.egg-info/SOURCES.txt' running build_ext x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17 building 'nvtabular_cpp' extension creating build creating build/temp.linux-x86_64-3.8 creating build/temp.linux-x86_64-3.8/cpp creating build/temp.linux-x86_64-3.8/cpp/nvtabular creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+47.gc394849 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0 x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+47.gc394849 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0 x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+47.gc394849 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0 x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.8.0+47.gc394849 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0 creating build/lib.linux-x86_64-3.8 x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .) nvtabular 0.8.0+47.gc394849 is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular Processing dependencies for nvtabular==0.8.0+47.gc394849 Searching for protobuf==3.19.1 Best match: protobuf 3.19.1 Adding protobuf 3.19.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for tensorflow-metadata==1.5.0 Best match: tensorflow-metadata 1.5.0 Processing tensorflow_metadata-1.5.0-py3.8.egg tensorflow-metadata 1.5.0 is already the active version in easy-install.pth

Using /usr/local/lib/python3.8/dist-packages/tensorflow_metadata-1.5.0-py3.8.egg Searching for pyarrow==4.0.1 Best match: pyarrow 4.0.1 Adding pyarrow 4.0.1 to easy-install.pth file Installing plasma_store script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages Searching for tqdm==4.62.3 Best match: tqdm 4.62.3 Processing tqdm-4.62.3-py3.8.egg tqdm 4.62.3 is already the active version in easy-install.pth Installing tqdm script to /var/jenkins_home/.local/bin

Using /usr/local/lib/python3.8/dist-packages/tqdm-4.62.3-py3.8.egg Searching for numba==0.54.1 Best match: numba 0.54.1 Adding numba 0.54.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for pandas==1.3.5 Best match: pandas 1.3.5 Processing pandas-1.3.5-py3.8-linux-x86_64.egg pandas 1.3.5 is already the active version in easy-install.pth

Using /usr/local/lib/python3.8/dist-packages/pandas-1.3.5-py3.8-linux-x86_64.egg Searching for distributed==2021.7.1 Best match: distributed 2021.7.1 Processing distributed-2021.7.1-py3.8.egg distributed 2021.7.1 is already the active version in easy-install.pth Installing dask-ssh script to /var/jenkins_home/.local/bin Installing dask-scheduler script to /var/jenkins_home/.local/bin Installing dask-worker script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages/distributed-2021.7.1-py3.8.egg Searching for dask==2021.7.1 Best match: dask 2021.7.1 Processing dask-2021.7.1-py3.8.egg dask 2021.7.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.7.1-py3.8.egg Searching for googleapis-common-protos==1.54.0 Best match: googleapis-common-protos 1.54.0 Adding googleapis-common-protos 1.54.0 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for absl-py==0.12.0 Best match: absl-py 0.12.0 Processing absl_py-0.12.0-py3.8.egg absl-py 0.12.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/absl_py-0.12.0-py3.8.egg Searching for numpy==1.20.3 Best match: numpy 1.20.3 Adding numpy 1.20.3 to easy-install.pth file Installing f2py script to /var/jenkins_home/.local/bin Installing f2py3 script to /var/jenkins_home/.local/bin Installing f2py3.8 script to /var/jenkins_home/.local/bin

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for setuptools==59.7.0 Best match: setuptools 59.7.0 Adding setuptools 59.7.0 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for llvmlite==0.37.0 Best match: llvmlite 0.37.0 Processing llvmlite-0.37.0-py3.8-linux-x86_64.egg llvmlite 0.37.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/llvmlite-0.37.0-py3.8-linux-x86_64.egg Searching for pytz==2021.3 Best match: pytz 2021.3 Adding pytz 2021.3 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for python-dateutil==2.8.2 Best match: python-dateutil 2.8.2 Adding python-dateutil 2.8.2 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for zict==2.0.0 Best match: zict 2.0.0 Processing zict-2.0.0-py3.8.egg zict 2.0.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg Searching for tornado==6.1 Best match: tornado 6.1 Processing tornado-6.1-py3.8-linux-x86_64.egg tornado 6.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg Searching for toolz==0.11.2 Best match: toolz 0.11.2 Processing toolz-0.11.2-py3.8.egg toolz 0.11.2 is already the active version in easy-install.pth

Using /usr/local/lib/python3.8/dist-packages/toolz-0.11.2-py3.8.egg Searching for tblib==1.7.0 Best match: tblib 1.7.0 Processing tblib-1.7.0-py3.8.egg tblib 1.7.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg Searching for sortedcontainers==2.4.0 Best match: sortedcontainers 2.4.0 Processing sortedcontainers-2.4.0-py3.8.egg sortedcontainers 2.4.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg Searching for PyYAML==5.4.1 Best match: PyYAML 5.4.1 Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg PyYAML 5.4.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg Searching for psutil==5.8.0 Best match: psutil 5.8.0 Processing psutil-5.8.0-py3.8-linux-x86_64.egg psutil 5.8.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg Searching for msgpack==1.0.3 Best match: msgpack 1.0.3 Processing msgpack-1.0.3-py3.8-linux-x86_64.egg msgpack 1.0.3 is already the active version in easy-install.pth

Using /usr/local/lib/python3.8/dist-packages/msgpack-1.0.3-py3.8-linux-x86_64.egg Searching for cloudpickle==2.0.0 Best match: cloudpickle 2.0.0 Processing cloudpickle-2.0.0-py3.8.egg cloudpickle 2.0.0 is already the active version in easy-install.pth

Using /usr/local/lib/python3.8/dist-packages/cloudpickle-2.0.0-py3.8.egg Searching for click==8.0.3 Best match: click 8.0.3 Processing click-8.0.3-py3.8.egg click 8.0.3 is already the active version in easy-install.pth

Using /usr/local/lib/python3.8/dist-packages/click-8.0.3-py3.8.egg Searching for partd==1.2.0 Best match: partd 1.2.0 Processing partd-1.2.0-py3.8.egg partd 1.2.0 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg Searching for packaging==21.3 Best match: packaging 21.3 Adding packaging 21.3 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for fsspec==2021.11.1 Best match: fsspec 2021.11.1 Adding fsspec 2021.11.1 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Searching for six==1.15.0 Best match: six 1.15.0 Adding six 1.15.0 to easy-install.pth file

Using /var/jenkins_home/.local/lib/python3.8/site-packages Searching for HeapDict==1.0.1 Best match: HeapDict 1.0.1 Processing HeapDict-1.0.1-py3.8.egg HeapDict 1.0.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg Searching for locket==0.2.1 Best match: locket 0.2.1 Processing locket-0.2.1-py3.8.egg locket 0.2.1 is already the active version in easy-install.pth

Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg Searching for pyparsing==3.0.6 Best match: pyparsing 3.0.6 Adding pyparsing 3.0.6 to easy-install.pth file

Using /usr/local/lib/python3.8/dist-packages Finished processing dependencies for nvtabular==0.8.0+47.gc394849 Running black --check All done! ✨ 🍰 ✨ 169 files would be left unchanged. Running flake8 Running isort Skipped 2 files Running bandit Running pylint ************* Module nvtabular.dispatch nvtabular/dispatch.py:607:11: I1101: Module 'numpy.random.mtrand' has no 'RandomState' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb Building docs make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs' /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.7) or chardet (3.0.4) doesn't match a supported version! warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported " /usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document warn("Container node skipped: type={0}".format(mdnode.t)) /usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document warn("Container node skipped: type={0}".format(mdnode.t)) /usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document warn("Container node skipped: type={0}".format(mdnode.t)) make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs' ============================= test session starts ============================== platform linux -- Python 3.8.10, pytest-6.2.5, py-1.11.0, pluggy-1.0.0 rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml plugins: xdist-2.5.0, forked-1.4.0, cov-3.0.0 collected 1593 items / 1 skipped / 1592 selected

tests/unit/test_dask_nvt.py ............................................ [ 2%] ....................................................................... [ 7%] tests/unit/test_io.py .................................................. [ 10%] ........................................................................ [ 14%] ..................ssssssss.............................................. [ 19%] ......... [ 19%] tests/unit/test_notebooks.py ...... [ 20%] tests/unit/test_tf4rec.py . [ 20%] tests/unit/test_tools.py ...................... [ 21%] tests/unit/test_triton_inference.py ................................ [ 23%] tests/unit/framework_utils/test_tf_feature_columns.py . [ 23%] tests/unit/framework_utils/test_tf_layers.py ........................... [ 25%] ................................................... [ 28%] tests/unit/framework_utils/test_torch_layers.py . [ 28%] tests/unit/graph/test_column_schemas.py ................................ [ 30%] .................................................. [ 33%] tests/unit/graph/test_column_selector.py .................... [ 35%] tests/unit/graph/ops/test_selection.py ... [ 35%] tests/unit/inference/test_ensemble.py . [ 35%] tests/unit/inference/test_export.py . [ 35%] tests/unit/inference/test_graph.py . [ 35%] tests/unit/inference/test_inference_ops.py .. [ 35%] tests/unit/inference/test_op_runner.py ... [ 35%] tests/unit/inference/test_tensorflow_inf_op.py ... [ 36%] tests/unit/loader/test_dataloader_backend.py ...... [ 36%] tests/unit/loader/test_tf_dataloader.py ................................ [ 38%] ........................................s.. [ 41%] tests/unit/loader/test_torch_dataloader.py ............................. [ 43%] ........................................................ [ 46%] tests/unit/ops/test_categorify.py ...................................... [ 48%] ................................................................. [ 52%] tests/unit/ops/test_column_similarity.py ........................ [ 54%] tests/unit/ops/test_fill.py ............................................ [ 57%] ........ [ 57%] tests/unit/ops/test_hash_bucket.py ......................... [ 59%] tests/unit/ops/test_join.py ............................................ [ 62%] ........................................................................ [ 66%] .................................. [ 68%] tests/unit/ops/test_lambda.py .... [ 68%] tests/unit/ops/test_normalize.py ....................................... [ 71%] .. [ 71%] tests/unit/ops/test_ops.py ............................................. [ 74%] .......................... [ 76%] tests/unit/ops/test_ops_schema.py ...................................... [ 78%] ........................................................................ [ 82%] ........................................................................ [ 87%] ....................................... [ 89%] tests/unit/ops/test_target_encode.py ..................... [ 91%] tests/unit/workflow/test_cpu_workflow.py ...... [ 91%] tests/unit/workflow/test_workflow.py ................................... [ 93%] ............................................................ [ 97%] tests/unit/workflow/test_workflow_node.py ........... [ 98%] tests/unit/workflow/test_workflow_ops.py ... [ 98%] tests/unit/workflow/test_workflow_schemas.py ......................... [100%]