Rename UniformNegativeSampling class

Open rnyak opened this issue 3 years ago • 7 comments

Addresses https://github.com/NVIDIA-Merlin/models/issues/650

Aug 21 '22 21:08 rnyak

Click to view CI Results

GitHub pull request #668 of commit 6face0620cbdb73683c0594205e79d9fcf5baaea, no merge conflicts.
Running as SYSTEM
Setting status of 6face0620cbdb73683c0594205e79d9fcf5baaea to PENDING with url https://10.20.13.93:8080/job/merlin_models/1012/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse 6face0620cbdb73683c0594205e79d9fcf5baaea^{commit} # timeout=10
Checking out Revision 6face0620cbdb73683c0594205e79d9fcf5baaea (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 6face0620cbdb73683c0594205e79d9fcf5baaea # timeout=10
Commit message: "rename UniformNegativeSampling clas"
 > git rev-list --no-walk ef2693bbe1f6bd5b8dc96894f4d04438f9120ce4 # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins13829500073425712312.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 658 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  3%]
tests/unit/datasets/test_synthetic.py .....                              [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  5%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 24%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 24%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 24%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 26%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 26%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 26%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 28%]
tests/unit/tf/core/test_combinators.py s...................              [ 31%]
tests/unit/tf/core/test_index.py ...                                     [ 31%]
tests/unit/tf/core/test_prediction.py ..                                 [ 32%]
tests/unit/tf/core/test_tabular.py ....                                  [ 32%]
tests/unit/tf/core/test_transformations.py s............................ [ 37%]
...                                                                      [ 37%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 37%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 39%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 39%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 40%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 40%]
tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 40%]
tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 40%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 40%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 40%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 41%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 41%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 41%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 46%]
..                                                                       [ 47%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 50%]
tests/unit/tf/layers/test_queue.py ..............                        [ 52%]
tests/unit/tf/losses/test_losses.py .......................              [ 55%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 56%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 59%]
tests/unit/tf/models/test_base.py s.................                     [ 62%]
tests/unit/tf/models/test_benchmark.py ..                                [ 62%]
tests/unit/tf/models/test_ranking.py ..........................          [ 66%]
tests/unit/tf/models/test_retrieval.py ................................  [ 71%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 72%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 74%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 75%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 75%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 75%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 76%]
tests/unit/tf/predictions/test_base.py .....                             [ 77%]
tests/unit/tf/predictions/test_classification.py .......                 [ 78%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 79%]
tests/unit/tf/predictions/test_regression.py ..                          [ 79%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 80%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 81%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 83%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 84%]
tests/unit/torch/features/test_embedding.py ..............               [ 86%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 96%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:807: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_file_o85s3vv.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:835: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
========== 647 passed, 11 skipped, 121 warnings in 890.39s (0:14:50) ===========
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins12654645657802917647.sh

Aug 21 '22 21:08 nvidia-merlin-bot

Documentation preview

https://nvidia-merlin.github.io/models/review/pr-668

Aug 21 '22 21:08 github-actions[bot]

Click to view CI Results

GitHub pull request #668 of commit 7bbda6338560e70291085d13b393b72c971d7153, no merge conflicts.
Running as SYSTEM
Setting status of 7bbda6338560e70291085d13b393b72c971d7153 to PENDING with url https://10.20.13.93:8080/job/merlin_models/1017/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse 7bbda6338560e70291085d13b393b72c971d7153^{commit} # timeout=10
Checking out Revision 7bbda6338560e70291085d13b393b72c971d7153 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 7bbda6338560e70291085d13b393b72c971d7153 # timeout=10
Commit message: "Merge branch 'main' into neg_sampling"
 > git rev-list --no-walk 93e376ede1ce362248eb91982a31d3dbcfaaac97 # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins10413093148347404278.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 658 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  3%]
tests/unit/datasets/test_synthetic.py .....                              [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  5%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 24%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 24%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 24%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 26%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 26%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 26%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 28%]
tests/unit/tf/core/test_combinators.py s...................              [ 31%]
tests/unit/tf/core/test_index.py ...                                     [ 31%]
tests/unit/tf/core/test_prediction.py ..                                 [ 32%]
tests/unit/tf/core/test_tabular.py ....                                  [ 32%]
tests/unit/tf/core/test_transformations.py s............................ [ 37%]
...                                                                      [ 37%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 37%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 39%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 39%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 40%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 40%]
tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 40%]
tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 40%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 40%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 40%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 41%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 41%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 41%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 46%]
..                                                                       [ 47%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 50%]
tests/unit/tf/layers/test_queue.py ..............                        [ 52%]
tests/unit/tf/losses/test_losses.py .......................              [ 55%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 56%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 59%]
tests/unit/tf/models/test_base.py s.................                     [ 62%]
tests/unit/tf/models/test_benchmark.py ..                                [ 62%]
tests/unit/tf/models/test_ranking.py ..........................          [ 66%]
tests/unit/tf/models/test_retrieval.py ................................  [ 71%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 72%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 74%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 75%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 75%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 75%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 76%]
tests/unit/tf/predictions/test_base.py .....                             [ 77%]
tests/unit/tf/predictions/test_classification.py .......                 [ 78%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 79%]
tests/unit/tf/predictions/test_regression.py ..                          [ 79%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 80%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 81%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 83%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 84%]
tests/unit/torch/features/test_embedding.py ..............               [ 86%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 96%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:807: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_fileimjkhok8.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:835: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
========== 647 passed, 11 skipped, 121 warnings in 889.48s (0:14:49) ===========
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins12800248287288133997.sh

Aug 22 '22 18:08 nvidia-merlin-bot

Click to view CI Results

GitHub pull request #668 of commit dd52538d4d9e908bc4f6d7927d228dce3f8742fc, no merge conflicts.
Running as SYSTEM
Setting status of dd52538d4d9e908bc4f6d7927d228dce3f8742fc to PENDING with url https://10.20.13.93:8080/job/merlin_models/1044/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse dd52538d4d9e908bc4f6d7927d228dce3f8742fc^{commit} # timeout=10
Checking out Revision dd52538d4d9e908bc4f6d7927d228dce3f8742fc (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f dd52538d4d9e908bc4f6d7927d228dce3f8742fc # timeout=10
Commit message: "Merge branch 'main' into neg_sampling"
 > git rev-list --no-walk 7fa51a66c16e75cb3164580f75663d1b8a60893a # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins17356208065057748537.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 671 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  2%]
tests/unit/datasets/test_synthetic.py .....                              [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  4%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 23%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 23%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 24%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 25%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 25%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 26%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 27%]
tests/unit/tf/core/test_combinators.py s...................              [ 30%]
tests/unit/tf/core/test_index.py ...                                     [ 31%]
tests/unit/tf/core/test_prediction.py ..                                 [ 31%]
tests/unit/tf/core/test_tabular.py ....                                  [ 32%]
tests/unit/tf/core/test_transformations.py s............................ [ 36%]
..................                                                       [ 39%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 39%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 40%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 41%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 41%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 41%]
tests/unit/tf/examples/test_03_exploring_different_models.py F           [ 41%]
tests/unit/tf/examples/test_04_export_ranking_models.py F                [ 42%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 42%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 42%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 42%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 42%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 43%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 48%]
..                                                                       [ 48%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 51%]
tests/unit/tf/layers/test_queue.py ..............                        [ 53%]
tests/unit/tf/losses/test_losses.py .......................              [ 56%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 57%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 60%]
tests/unit/tf/models/test_base.py s.................                     [ 63%]
tests/unit/tf/models/test_benchmark.py ..                                [ 63%]
tests/unit/tf/models/test_ranking.py ........................            [ 67%]
tests/unit/tf/models/test_retrieval.py ................................  [ 72%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 72%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 74%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 75%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 76%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 76%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 77%]
tests/unit/tf/predictions/test_base.py .....                             [ 77%]
tests/unit/tf/predictions/test_classification.py .......                 [ 78%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 80%]
tests/unit/tf/predictions/test_regression.py ..                          [ 80%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 80%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 82%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 83%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 84%]
tests/unit/torch/features/test_embedding.py ..............               [ 86%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 97%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=================================== FAILURES ===================================
__________________ test_example_03_exploring_different_models __________________
self = <testbook.client.TestbookNotebookClient object at 0x7fabeed2d310>
cell = {'cell_type': 'markdown', 'id': '0c63e2eb', 'metadata': {'pycharm': {'name': '#%% md\n'}}, 'source': 'NVTabular export... other words, Merlin Models relies on the schema object to automatically build all necessary input and output layers.'}
kwargs = {}, cell_indexes = [0, 1, 2, 3, 4, 5, ...]
executed_cells = [{'cell_type': 'code', 'execution_count': 2, 'id': '5f49a48e', 'metadata': {'pycharm': {'name': '#%%\n'}, 'execution':...d': '2dd02301', 'metadata': {'pycharm': {'name': '#%% md\n'}}, 'source': '## Feature Engineering with NVTabular'}, ...]
idx = 14
def execute_cell(self, cell, **kwargs) -> Union[Dict, List[Dict]]:
    """
    Executes a cell or list of cells
    """
    if isinstance(cell, slice):
        start, stop = self._cell_index(cell.start), self._cell_index(cell.stop)
        if cell.step is not None:
            raise TestbookError('testbook does not support step argument')

        cell = range(start, stop + 1)
    elif isinstance(cell, str) or isinstance(cell, int):
        cell = [cell]

    cell_indexes = cell

    if all(isinstance(x, str) for x in cell):
        cell_indexes = [self._cell_index(tag) for tag in cell]

    executed_cells = []
    for idx in cell_indexes:
        try:


          cell = super().execute_cell(self.nb['cells'][idx], idx, **kwargs)


/usr/local/lib/python3.8/dist-packages/testbook/client.py:133:

args = (<testbook.client.TestbookNotebookClient object at 0x7fabeed2d310>, {'cell_type': 'code', 'execution_count': 7, 'id': ...ath.join(output_path, "valid", "*.parquet"), part_size="500MB")\n\n# define schema object\nschema = train.schema'}, 14)
kwargs = {}
def wrapped(*args, **kwargs):


  return just_run(coro(*args, **kwargs))


/usr/local/lib/python3.8/dist-packages/nbclient/util.py:85:

coro = <coroutine object NotebookClient.async_execute_cell at 0x7fabbc05fb40>
def just_run(coro: Awaitable) -> Any:
    """Make the coroutine run, even if there is an event loop running (using nest_asyncio)"""
    try:
        loop = asyncio.get_running_loop()
    except RuntimeError:
        loop = None
    if loop is None:
        had_running_loop = False
        loop = asyncio.new_event_loop()
        asyncio.set_event_loop(loop)
    else:
        had_running_loop = True
    if had_running_loop:
        # if there is a running loop, we patch using nest_asyncio
        # to have reentrant event loops
        check_ipython()
        import nest_asyncio

        nest_asyncio.apply()
        check_patch_tornado()


  return loop.run_until_complete(coro)


/usr/local/lib/python3.8/dist-packages/nbclient/util.py:60:

self = <_UnixSelectorEventLoop running=False closed=False debug=False>
future = <Task finished name='Task-259' coro=<NotebookClient.async_execute_cell() done, defined at /usr/local/lib/python3.8/dis...rn\x1b[39;00m dataset\n\n\x1b[0;31mIndexError\x1b[0m: list index out of range\nIndexError: list index out of range\n')>
def run_until_complete(self, future):
    """Run until the Future is done.

    If the argument is a coroutine, it is wrapped in a Task.

    WARNING: It would be disastrous to call run_until_complete()
    with the same coroutine twice -- it would wrap it in two
    different Tasks and that can't be good.

    Return the Future's result, or raise its exception.
    """
    self._check_closed()
    self._check_running()

    new_task = not futures.isfuture(future)
    future = tasks.ensure_future(future, loop=self)
    if new_task:
        # An exception is raised if the future didn't complete, so there
        # is no need to log the "destroy pending task" message
        future._log_destroy_pending = False

    future.add_done_callback(_run_until_complete_cb)
    try:
        self.run_forever()
    except:
        if new_task and future.done() and not future.cancelled():
            # The coroutine raised a BaseException. Consume the exception
            # to not log a warning, the caller doesn't have access to the
            # local task.
            future.exception()
        raise
    finally:
        future.remove_done_callback(_run_until_complete_cb)
    if not future.done():
        raise RuntimeError('Event loop stopped before Future completed.')


  return future.result()


/usr/lib/python3.8/asyncio/base_events.py:616:

self = <testbook.client.TestbookNotebookClient object at 0x7fabeed2d310>
cell = {'cell_type': 'code', 'execution_count': 7, 'id': 'c213255c', 'metadata': {'pycharm': {'name': '#%%\n'}, 'execution': ...(os.path.join(output_path, "valid", "*.parquet"), part_size="500MB")\n\n# define schema object\nschema = train.schema'}
cell_index = 14, execution_count = None, store_history = True
async def async_execute_cell(
    self,
    cell: NotebookNode,
    cell_index: int,
    execution_count: t.Optional[int] = None,
    store_history: bool = True,
) -> NotebookNode:
    """
    Executes a single code cell.

    To execute all cells see :meth:`execute`.

    Parameters
    ----------
    cell : nbformat.NotebookNode
        The cell which is currently being processed.
    cell_index : int
        The position of the cell within the notebook object.
    execution_count : int
        The execution count to be assigned to the cell (default: Use kernel response)
    store_history : bool
        Determines if history should be stored in the kernel (default: False).
        Specific to ipython kernels, which can store command histories.

    Returns
    -------
    output : dict
        The execution output payload (or None for no output).

    Raises
    ------
    CellExecutionError
        If execution failed and should raise an exception, this will be raised
        with defaults about the failure.

    Returns
    -------
    cell : NotebookNode
        The cell which was just processed.
    """
    assert self.kc is not None

    await run_hook(self.on_cell_start, cell=cell, cell_index=cell_index)

    if cell.cell_type != 'code' or not cell.source.strip():
        self.log.debug("Skipping non-executing cell %s", cell_index)
        return cell

    if self.skip_cells_with_tag in cell.metadata.get("tags", []):
        self.log.debug("Skipping tagged cell %s", cell_index)
        return cell

    if self.record_timing:  # clear execution metadata prior to execution
        cell['metadata']['execution'] = {}

    self.log.debug("Executing cell:\n%s", cell.source)

    cell_allows_errors = (not self.force_raise_errors) and (
        self.allow_errors or "raises-exception" in cell.metadata.get("tags", [])
    )

    await run_hook(self.on_cell_execute, cell=cell, cell_index=cell_index)
    parent_msg_id = await ensure_async(
        self.kc.execute(
            cell.source, store_history=store_history, stop_on_error=not cell_allows_errors
        )
    )
    await run_hook(self.on_cell_complete, cell=cell, cell_index=cell_index)
    # We launched a code cell to execute
    self.code_cells_executed += 1
    exec_timeout = self._get_timeout(cell)

    cell.outputs = []
    self.clear_before_next_output = False

    task_poll_kernel_alive = asyncio.ensure_future(self._async_poll_kernel_alive())
    task_poll_output_msg = asyncio.ensure_future(
        self._async_poll_output_msg(parent_msg_id, cell, cell_index)
    )
    self.task_poll_for_reply = asyncio.ensure_future(
        self._async_poll_for_reply(
            parent_msg_id, cell, exec_timeout, task_poll_output_msg, task_poll_kernel_alive
        )
    )
    try:
        exec_reply = await self.task_poll_for_reply
    except asyncio.CancelledError:
        # can only be cancelled by task_poll_kernel_alive when the kernel is dead
        task_poll_output_msg.cancel()
        raise DeadKernelError("Kernel died")
    except Exception as e:
        # Best effort to cancel request if it hasn't been resolved
        try:
            # Check if the task_poll_output is doing the raising for us
            if not isinstance(e, CellControlSignal):
                task_poll_output_msg.cancel()
        finally:
            raise

    if execution_count:
        cell['execution_count'] = execution_count
    await run_hook(
        self.on_cell_executed, cell=cell, cell_index=cell_index, execute_reply=exec_reply
    )


  await self._check_raise_for_error(cell, cell_index, exec_reply)


/usr/local/lib/python3.8/dist-packages/nbclient/client.py:1025:

self = <testbook.client.TestbookNotebookClient object at 0x7fabeed2d310>
cell = {'cell_type': 'code', 'execution_count': 7, 'id': 'c213255c', 'metadata': {'pycharm': {'name': '#%%\n'}, 'execution': ...(os.path.join(output_path, "valid", "*.parquet"), part_size="500MB")\n\n# define schema object\nschema = train.schema'}
cell_index = 14
exec_reply = {'buffers': [], 'content': {'ename': 'IndexError', 'engine_info': {'engine_id': -1, 'engine_uuid': 'f09c9463-28a1-418a...e, 'engine': 'f09c9463-28a1-418a-b729-85554464f11c', 'started': '2022-08-25T17:33:20.121024Z', 'status': 'error'}, ...}
async def _check_raise_for_error(
    self, cell: NotebookNode, cell_index: int, exec_reply: t.Optional[t.Dict]
) -> None:

    if exec_reply is None:
        return None

    exec_reply_content = exec_reply['content']
    if exec_reply_content['status'] != 'error':
        return None

    cell_allows_errors = (not self.force_raise_errors) and (
        self.allow_errors
        or exec_reply_content.get('ename') in self.allow_error_names
        or "raises-exception" in cell.metadata.get("tags", [])
    )
    await run_hook(
        self.on_cell_error, cell=cell, cell_index=cell_index, execute_reply=exec_reply
    )
    if not cell_allows_errors:


      raise CellExecutionError.from_cell_and_msg(cell, exec_reply_content)


E E           ------------------ E E E
 E           # define schema object E           schema = train.schema E           ------------------ E
 E E E E E           [1;32m E           [1;32m E
 E E E E E E E E E E           [1;32m    309[0m         ) E
 E E E E E E E E E E E           [1;32m    318[0m     ) E E E
 E E E E E E
 E E E E E E E
 E E

nbclient.exceptions.CellExecutionError: An error occurred while executing the following cell: train = Dataset(os.path.join(output_path, "train", ".parquet"), part_size="500MB") valid = Dataset(os.path.join(output_path, "valid", ".parquet"), part_size="500MB") [0;31m---------------------------------------------------------------------------[0m [0;31mIndexError[0m                                Traceback (most recent call last) Input [0;32mIn [7][0m, in [0;36m<cell line: 1>[0;34m()[0m [0;32m----> 1[0m train [38;5;241m=[39m [43mDataset[49m[43m([49m[43mos[49m[38;5;241;43m.[39;49m[43mpath[49m[38;5;241;43m.[39;49m[43mjoin[49m[43m([49m[43moutput_path[49m[43m,[49m[43m [49m[38;5;124;43m"[39;49m[38;5;124;43mtrain[39;49m[38;5;124;43m"[39;49m[43m,[49m[43m [49m[38;5;124;43m"[39;49m[38;5;124;43m*.parquet[39;49m[38;5;124;43m"[39;49m[43m)[49m[43m,[49m[43m [49m[43mpart_size[49m[38;5;241;43m=[39;49m[38;5;124;43m"[39;49m[38;5;124;43m500MB[39;49m[38;5;124;43m"[39;49m[43m)[49m 2[0m valid [38;5;241m=[39m Dataset(os[38;5;241m.[39mpath[38;5;241m.[39mjoin(output_path, [38;5;124m"[39m[38;5;124mvalid[39m[38;5;124m"[39m, [38;5;124m"[39m[38;5;124m*.parquet[39m[38;5;124m"[39m), part_size[38;5;241m=[39m[38;5;124m"[39m[38;5;124m500MB[39m[38;5;124m"[39m) 4[0m [38;5;66;03m# define schema object[39;00m File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/dataset.py:303[0m, in [0;36mDataset.__init__[0;34m(self, path_or_source, engine, npartitions, part_size, part_mem_fraction, storage_options, dtypes, client, cpu, base_dataset, schema, **kwargs)[0m [1;32m    301[0m [38;5;28;01mif[39;00m [38;5;28misinstance[39m(engine, [38;5;28mstr[39m): [1;32m    302[0m     [38;5;28;01mif[39;00m engine [38;5;241m==[39m [38;5;124m"[39m[38;5;124mparquet[39m[38;5;124m"[39m: [0;32m--> 303[0m         [38;5;28mself[39m[38;5;241m.[39mengine [38;5;241m=[39m [43mParquetDatasetEngine[49m[43m([49m [1;32m    304[0m [43m            [49m[43mpaths[49m[43m,[49m[43m [49m[43mpart_size[49m[43m,[49m[43m [49m[43mstorage_options[49m[38;5;241;43m=[39;49m[43mstorage_options[49m[43m,[49m[43m [49m[43mcpu[49m[38;5;241;43m=[39;49m[38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43mcpu[49m[43m,[49m[43m [49m[38;5;241;43m[39;49m[38;5;241;43m[39;49m[43mkwargs[49m [1;32m    305[0m [43m        [49m[43m)[49m [1;32m    306[0m     [38;5;28;01melif[39;00m engine [38;5;241m==[39m [38;5;124m"[39m[38;5;124mcsv[39m[38;5;124m"[39m: [1;32m    307[0m         [38;5;28mself[39m[38;5;241m.[39mengine [38;5;241m=[39m CSVDatasetEngine( [1;32m    308[0m             paths, part_size, storage_options[38;5;241m=[39mstorage_options, cpu[38;5;241m=[39m[38;5;28mself[39m[38;5;241m.[39mcpu, [38;5;241m[39m[38;5;241m[39mkwargs File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:313[0m, in [0;36mParquetDatasetEngine.__init__[0;34m(self, paths, part_size, storage_options, row_groups_per_part, legacy, batch_size, cpu, **kwargs)[0m [1;32m    308[0m [38;5;28mself[39m[38;5;241m.[39mdataset_kwargs [38;5;241m=[39m [38;5;28mself[39m[38;5;241m.[39mread_parquet_kwargs[38;5;241m.[39mpop([38;5;124m"[39m[38;5;124mdataset[39m[38;5;124m"[39m, {}) [1;32m    310[0m [38;5;28;01mif[39;00m row_groups_per_part [38;5;129;01mis[39;00m [38;5;28;01mNone[39;00m: [1;32m    311[0m     [38;5;28mself[39m[38;5;241m.[39m_real_meta, rg_byte_size_0 [38;5;241m=[39m run_on_worker( [1;32m    312[0m         _sample_row_group, [0;32m--> 313[0m         [38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43m_path0[49m, [1;32m    314[0m         [38;5;28mself[39m[38;5;241m.[39mfs, [1;32m    315[0m         cpu[38;5;241m=[39m[38;5;28mself[39m[38;5;241m.[39mcpu, [1;32m    316[0m         memory_usage[38;5;241m=[39m[38;5;28;01mTrue[39;00m, [1;32m    317[0m         [38;5;241m[39m[38;5;241m[39m[38;5;28mself[39m[38;5;241m.[39mread_parquet_kwargs, [1;32m    319[0m     row_groups_per_part [38;5;241m=[39m [38;5;28mself[39m[38;5;241m.[39mpart_size [38;5;241m/[39m rg_byte_size_0 [1;32m    320[0m     [38;5;28;01mif[39;00m row_groups_per_part [38;5;241m<[39m [38;5;241m1.0[39m: File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:338[0m, in [0;36mParquetDatasetEngine._path0[0;34m(self)[0m [1;32m    335[0m [38;5;129m@property[39m  [38;5;66;03m# type: ignore[39;00m [1;32m    336[0m [38;5;129m@functools[39m[38;5;241m.[39mlru_cache([38;5;241m1[39m) [1;32m    337[0m [38;5;28;01mdef[39;00m [38;5;21m_path0[39m([38;5;28mself[39m): [0;32m--> 338[0m     [38;5;28;01mreturn[39;00m [38;5;28mnext[39m([38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43m_dataset[49m[38;5;241m.[39mget_fragments())[38;5;241m.[39mpath File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:368[0m, in [0;36mParquetDatasetEngine._dataset[0;34m(self)[0m [1;32m    365[0m     dataset [38;5;241m=[39m pa_ds[38;5;241m.[39mdataset(paths, filesystem[38;5;241m=[39mfs) [1;32m    366[0m [38;5;28;01melse[39;00m: [1;32m    367[0m     [38;5;66;03m# This is a directory or a single file[39;00m [0;32m--> 368[0m     dataset [38;5;241m=[39m pa_ds[38;5;241m.[39mdataset([43mpaths[49m[43m[[49m[38;5;241;43m0[39;49m[43m][49m, filesystem[38;5;241m=[39mfs) [1;32m    369[0m [38;5;28;01mreturn[39;00m dataset [0;31mIndexError[0m: list index out of range IndexError: list index out of range
/usr/local/lib/python3.8/dist-packages/nbclient/client.py:919: CellExecutionError
During handling of the above exception, another exception occurred:
tb = <testbook.client.TestbookNotebookClient object at 0x7fabeed2d310>
@testbook(REPO_ROOT / "examples/03-Exploring-different-models.ipynb", execute=False)
def test_example_03_exploring_different_models(tb):
    tb.inject(
        """
        import os
        os.environ["DATA_FOLDER"] = "/tmp/data/"
        os.environ["NUM_ROWS"] = "999"
        """
    )
    NUM_OF_CELLS = len(tb.cells)


  tb.execute_cell(list(range(0, NUM_OF_CELLS - 5)))


tests/unit/tf/examples/test_03_exploring_different_models.py:18:

self = <testbook.client.TestbookNotebookClient object at 0x7fabeed2d310>
cell = {'cell_type': 'markdown', 'id': '0c63e2eb', 'metadata': {'pycharm': {'name': '#%% md\n'}}, 'source': 'NVTabular export... other words, Merlin Models relies on the schema object to automatically build all necessary input and output layers.'}
kwargs = {}, cell_indexes = [0, 1, 2, 3, 4, 5, ...]
executed_cells = [{'cell_type': 'code', 'execution_count': 2, 'id': '5f49a48e', 'metadata': {'pycharm': {'name': '#%%\n'}, 'execution':...d': '2dd02301', 'metadata': {'pycharm': {'name': '#%% md\n'}}, 'source': '## Feature Engineering with NVTabular'}, ...]
idx = 14
def execute_cell(self, cell, **kwargs) -> Union[Dict, List[Dict]]:
    """
    Executes a cell or list of cells
    """
    if isinstance(cell, slice):
        start, stop = self._cell_index(cell.start), self._cell_index(cell.stop)
        if cell.step is not None:
            raise TestbookError('testbook does not support step argument')

        cell = range(start, stop + 1)
    elif isinstance(cell, str) or isinstance(cell, int):
        cell = [cell]

    cell_indexes = cell

    if all(isinstance(x, str) for x in cell):
        cell_indexes = [self._cell_index(tag) for tag in cell]

    executed_cells = []
    for idx in cell_indexes:
        try:
            cell = super().execute_cell(self.nb['cells'][idx], idx, **kwargs)
        except CellExecutionError as ce:


          raise TestbookRuntimeError(ce.evalue, ce, self._get_error_class(ce.ename))


E               testbook.exceptions.TestbookRuntimeError: An error occurred while executing the following cell:
E               ------------------
E               train = Dataset(os.path.join(output_path, "train", ".parquet"), part_size="500MB")
E               valid = Dataset(os.path.join(output_path, "valid", ".parquet"), part_size="500MB")
E

E               # define schema object
E               schema = train.schema
E               ------------------
E

E               [0;31m---------------------------------------------------------------------------[0m
E               [0;31mIndexError[0m                                Traceback (most recent call last)
E               Input [0;32mIn [7][0m, in [0;36m<cell line: 1>[0;34m()[0m
E               [0;32m----> 1[0m train [38;5;241m=[39m [43mDataset[49m[43m([49m[43mos[49m[38;5;241;43m.[39;49m[43mpath[49m[38;5;241;43m.[39;49m[43mjoin[49m[43m([49m[43moutput_path[49m[43m,[49m[43m [49m[38;5;124;43m"[39;49m[38;5;124;43mtrain[39;49m[38;5;124;43m"[39;49m[43m,[49m[43m [49m[38;5;124;43m"[39;49m[38;5;124;43m*.parquet[39;49m[38;5;124;43m"[39;49m[43m)[49m[43m,[49m[43m [49m[43mpart_size[49m[38;5;241;43m=[39;49m[38;5;124;43m"[39;49m[38;5;124;43m500MB[39;49m[38;5;124;43m"[39;49m[43m)[49m
E               [1;32m      2[0m valid [38;5;241m=[39m Dataset(os[38;5;241m.[39mpath[38;5;241m.[39mjoin(output_path, [38;5;124m"[39m[38;5;124mvalid[39m[38;5;124m"[39m, [38;5;124m"[39m[38;5;124m*.parquet[39m[38;5;124m"[39m), part_size[38;5;241m=[39m[38;5;124m"[39m[38;5;124m500MB[39m[38;5;124m"[39m)
E               [1;32m      4[0m [38;5;66;03m# define schema object[39;00m
E

E               File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/dataset.py:303[0m, in [0;36mDataset.__init__[0;34m(self, path_or_source, engine, npartitions, part_size, part_mem_fraction, storage_options, dtypes, client, cpu, base_dataset, schema, **kwargs)[0m
E               [1;32m    301[0m [38;5;28;01mif[39;00m [38;5;28misinstance[39m(engine, [38;5;28mstr[39m):
E               [1;32m    302[0m     [38;5;28;01mif[39;00m engine [38;5;241m==[39m [38;5;124m"[39m[38;5;124mparquet[39m[38;5;124m"[39m:
E               [0;32m--> 303[0m         [38;5;28mself[39m[38;5;241m.[39mengine [38;5;241m=[39m [43mParquetDatasetEngine[49m[43m([49m
E               [1;32m    304[0m [43m            [49m[43mpaths[49m[43m,[49m[43m [49m[43mpart_size[49m[43m,[49m[43m [49m[43mstorage_options[49m[38;5;241;43m=[39;49m[43mstorage_options[49m[43m,[49m[43m [49m[43mcpu[49m[38;5;241;43m=[39;49m[38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43mcpu[49m[43m,[49m[43m [49m[38;5;241;43m[39;49m[38;5;241;43m[39;49m[43mkwargs[49m
E               [1;32m    305[0m [43m        [49m[43m)[49m
E               [1;32m    306[0m     [38;5;28;01melif[39;00m engine [38;5;241m==[39m [38;5;124m"[39m[38;5;124mcsv[39m[38;5;124m"[39m:
E               [1;32m    307[0m         [38;5;28mself[39m[38;5;241m.[39mengine [38;5;241m=[39m CSVDatasetEngine(
E               [1;32m    308[0m             paths, part_size, storage_options[38;5;241m=[39mstorage_options, cpu[38;5;241m=[39m[38;5;28mself[39m[38;5;241m.[39mcpu, [38;5;241m[39m[38;5;241m[39mkwargs
E               [1;32m    309[0m         )
E

E               File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:313[0m, in [0;36mParquetDatasetEngine.__init__[0;34m(self, paths, part_size, storage_options, row_groups_per_part, legacy, batch_size, cpu, **kwargs)[0m
E               [1;32m    308[0m [38;5;28mself[39m[38;5;241m.[39mdataset_kwargs [38;5;241m=[39m [38;5;28mself[39m[38;5;241m.[39mread_parquet_kwargs[38;5;241m.[39mpop([38;5;124m"[39m[38;5;124mdataset[39m[38;5;124m"[39m, {})
E               [1;32m    310[0m [38;5;28;01mif[39;00m row_groups_per_part [38;5;129;01mis[39;00m [38;5;28;01mNone[39;00m:
E               [1;32m    311[0m     [38;5;28mself[39m[38;5;241m.[39m_real_meta, rg_byte_size_0 [38;5;241m=[39m run_on_worker(
E               [1;32m    312[0m         _sample_row_group,
E               [0;32m--> 313[0m         [38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43m_path0[49m,
E               [1;32m    314[0m         [38;5;28mself[39m[38;5;241m.[39mfs,
E               [1;32m    315[0m         cpu[38;5;241m=[39m[38;5;28mself[39m[38;5;241m.[39mcpu,
E               [1;32m    316[0m         memory_usage[38;5;241m=[39m[38;5;28;01mTrue[39;00m,
E               [1;32m    317[0m         [38;5;241m[39m[38;5;241m[39m[38;5;28mself[39m[38;5;241m.[39mread_parquet_kwargs,
E               [1;32m    318[0m     )
E               [1;32m    319[0m     row_groups_per_part [38;5;241m=[39m [38;5;28mself[39m[38;5;241m.[39mpart_size [38;5;241m/[39m rg_byte_size_0
E               [1;32m    320[0m     [38;5;28;01mif[39;00m row_groups_per_part [38;5;241m<[39m [38;5;241m1.0[39m:
E

E               File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:338[0m, in [0;36mParquetDatasetEngine._path0[0;34m(self)[0m
E               [1;32m    335[0m [38;5;129m@property[39m  [38;5;66;03m# type: ignore[39;00m
E               [1;32m    336[0m [38;5;129m@functools[39m[38;5;241m.[39mlru_cache([38;5;241m1[39m)
E               [1;32m    337[0m [38;5;28;01mdef[39;00m [38;5;21m_path0[39m([38;5;28mself[39m):
E               [0;32m--> 338[0m     [38;5;28;01mreturn[39;00m [38;5;28mnext[39m([38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43m_dataset[49m[38;5;241m.[39mget_fragments())[38;5;241m.[39mpath
E

E               File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:368[0m, in [0;36mParquetDatasetEngine._dataset[0;34m(self)[0m
E               [1;32m    365[0m     dataset [38;5;241m=[39m pa_ds[38;5;241m.[39mdataset(paths, filesystem[38;5;241m=[39mfs)
E               [1;32m    366[0m [38;5;28;01melse[39;00m:
E               [1;32m    367[0m     [38;5;66;03m# This is a directory or a single file[39;00m
E               [0;32m--> 368[0m     dataset [38;5;241m=[39m pa_ds[38;5;241m.[39mdataset([43mpaths[49m[43m[[49m[38;5;241;43m0[39;49m[43m][49m, filesystem[38;5;241m=[39mfs)
E               [1;32m    369[0m [38;5;28;01mreturn[39;00m dataset
E

E               [0;31mIndexError[0m: list index out of range
E               IndexError: list index out of range
/usr/local/lib/python3.8/dist-packages/testbook/client.py:135: TestbookRuntimeError
----------------------------- Captured stderr call -----------------------------
2022-08-25 17:33:16.405310: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-08-25 17:33:18.464476: I tensorflow/core/common_runtime/gpu/gpu_process_state.cc:222] Using CUDA malloc Async allocator for GPU: 0
2022-08-25 17:33:18.464639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 1627 MB memory:  -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-08-25 17:33:18.465359: I tensorflow/core/common_runtime/gpu/gpu_process_state.cc:222] Using CUDA malloc Async allocator for GPU: 1
2022-08-25 17:33:18.465414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 14508 MB memory:  -> device: 1, name: Tesla P100-DGXS-16GB, pci bus id: 0000:08:00.0, compute capability: 6.0
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
File "/usr/lib/python3.8/logging/init.py", line 2127, in shutdown
h.close()
File "/usr/local/lib/python3.8/dist-packages/absl/logging/init.py", line 934, in close
self.stream.close()
File "/usr/local/lib/python3.8/dist-packages/ipykernel/iostream.py", line 438, in close
self.watch_fd_thread.join()
AttributeError: 'OutStream' object has no attribute 'watch_fd_thread'
___________________ test_example_04_exporting_ranking_models ___________________
tb = <testbook.client.TestbookNotebookClient object at 0x7fabee3637c0>
@testbook(REPO_ROOT / "examples/04-Exporting-ranking-models.ipynb", execute=False)
def test_example_04_exporting_ranking_models(tb):
    tb.inject(
        """
        import os
        os.environ["DATA_FOLDER"] = "/tmp/data/"
        os.environ["NUM_ROWS"] = "999"
        """
    )


  tb.execute()


tests/unit/tf/examples/test_04_export_ranking_models.py:17:

/usr/local/lib/python3.8/dist-packages/testbook/client.py:147: in execute
super().execute_cell(cell, index)
/usr/local/lib/python3.8/dist-packages/nbclient/util.py:85: in wrapped
return just_run(coro(*args, **kwargs))
/usr/local/lib/python3.8/dist-packages/nbclient/util.py:60: in just_run
return loop.run_until_complete(coro)
/usr/lib/python3.8/asyncio/base_events.py:616: in run_until_complete
return future.result()
/usr/local/lib/python3.8/dist-packages/nbclient/client.py:1025: in async_execute_cell
await self._check_raise_for_error(cell, cell_index, exec_reply)

self = <testbook.client.TestbookNotebookClient object at 0x7fabee3637c0>
cell = {'cell_type': 'code', 'execution_count': 10, 'id': 'be3a3421', 'metadata': {'jupyter': {'outputs_hidden': False}, 'pyc...))\nvalid = Dataset(os.path.join(output_path, "valid", "*.parquet"))\n\n# define schema object\nschema = train.schema'}
cell_index = 20
exec_reply = {'buffers': [], 'content': {'ename': 'IndexError', 'engine_info': {'engine_id': -1, 'engine_uuid': 'b652472f-9f66-4f40...e, 'engine': 'b652472f-9f66-4f40-af58-9b7d76fa147e', 'started': '2022-08-25T17:33:34.660994Z', 'status': 'error'}, ...}
async def _check_raise_for_error(
    self, cell: NotebookNode, cell_index: int, exec_reply: t.Optional[t.Dict]
) -> None:

    if exec_reply is None:
        return None

    exec_reply_content = exec_reply['content']
    if exec_reply_content['status'] != 'error':
        return None

    cell_allows_errors = (not self.force_raise_errors) and (
        self.allow_errors
        or exec_reply_content.get('ename') in self.allow_error_names
        or "raises-exception" in cell.metadata.get("tags", [])
    )
    await run_hook(
        self.on_cell_error, cell=cell, cell_index=cell_index, execute_reply=exec_reply
    )
    if not cell_allows_errors:


      raise CellExecutionError.from_cell_and_msg(cell, exec_reply_content)


E           nbclient.exceptions.CellExecutionError: An error occurred while executing the following cell:
E           ------------------
E           # define train and valid dataset objects
E           train = Dataset(os.path.join(output_path, "train", ".parquet"))
E           valid = Dataset(os.path.join(output_path, "valid", ".parquet"))
E

E           # define schema object
E           schema = train.schema
E           ------------------
E

E           [0;31m---------------------------------------------------------------------------[0m
E           [0;31mIndexError[0m                                Traceback (most recent call last)
E           Input [0;32mIn [10][0m, in [0;36m<cell line: 2>[0;34m()[0m
E           [1;32m      1[0m [38;5;66;03m# define train and valid dataset objects[39;00m
E           [0;32m----> 2[0m train [38;5;241m=[39m [43mDataset[49m[43m([49m[43mos[49m[38;5;241;43m.[39;49m[43mpath[49m[38;5;241;43m.[39;49m[43mjoin[49m[43m([49m[43moutput_path[49m[43m,[49m[43m [49m[38;5;124;43m"[39;49m[38;5;124;43mtrain[39;49m[38;5;124;43m"[39;49m[43m,[49m[43m [49m[38;5;124;43m"[39;49m[38;5;124;43m*.parquet[39;49m[38;5;124;43m"[39;49m[43m)[49m[43m)[49m
E           [1;32m      3[0m valid [38;5;241m=[39m Dataset(os[38;5;241m.[39mpath[38;5;241m.[39mjoin(output_path, [38;5;124m"[39m[38;5;124mvalid[39m[38;5;124m"[39m, [38;5;124m"[39m[38;5;124m*.parquet[39m[38;5;124m"[39m))
E           [1;32m      5[0m [38;5;66;03m# define schema object[39;00m
E

E           File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/dataset.py:303[0m, in [0;36mDataset.__init__[0;34m(self, path_or_source, engine, npartitions, part_size, part_mem_fraction, storage_options, dtypes, client, cpu, base_dataset, schema, **kwargs)[0m
E           [1;32m    301[0m [38;5;28;01mif[39;00m [38;5;28misinstance[39m(engine, [38;5;28mstr[39m):
E           [1;32m    302[0m     [38;5;28;01mif[39;00m engine [38;5;241m==[39m [38;5;124m"[39m[38;5;124mparquet[39m[38;5;124m"[39m:
E           [0;32m--> 303[0m         [38;5;28mself[39m[38;5;241m.[39mengine [38;5;241m=[39m [43mParquetDatasetEngine[49m[43m([49m
E           [1;32m    304[0m [43m            [49m[43mpaths[49m[43m,[49m[43m [49m[43mpart_size[49m[43m,[49m[43m [49m[43mstorage_options[49m[38;5;241;43m=[39;49m[43mstorage_options[49m[43m,[49m[43m [49m[43mcpu[49m[38;5;241;43m=[39;49m[38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43mcpu[49m[43m,[49m[43m [49m[38;5;241;43m[39;49m[38;5;241;43m[39;49m[43mkwargs[49m
E           [1;32m    305[0m [43m        [49m[43m)[49m
E           [1;32m    306[0m     [38;5;28;01melif[39;00m engine [38;5;241m==[39m [38;5;124m"[39m[38;5;124mcsv[39m[38;5;124m"[39m:
E           [1;32m    307[0m         [38;5;28mself[39m[38;5;241m.[39mengine [38;5;241m=[39m CSVDatasetEngine(
E           [1;32m    308[0m             paths, part_size, storage_options[38;5;241m=[39mstorage_options, cpu[38;5;241m=[39m[38;5;28mself[39m[38;5;241m.[39mcpu, [38;5;241m[39m[38;5;241m[39mkwargs
E           [1;32m    309[0m         )
E

E           File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:313[0m, in [0;36mParquetDatasetEngine.__init__[0;34m(self, paths, part_size, storage_options, row_groups_per_part, legacy, batch_size, cpu, **kwargs)[0m
E           [1;32m    308[0m [38;5;28mself[39m[38;5;241m.[39mdataset_kwargs [38;5;241m=[39m [38;5;28mself[39m[38;5;241m.[39mread_parquet_kwargs[38;5;241m.[39mpop([38;5;124m"[39m[38;5;124mdataset[39m[38;5;124m"[39m, {})
E           [1;32m    310[0m [38;5;28;01mif[39;00m row_groups_per_part [38;5;129;01mis[39;00m [38;5;28;01mNone[39;00m:
E           [1;32m    311[0m     [38;5;28mself[39m[38;5;241m.[39m_real_meta, rg_byte_size_0 [38;5;241m=[39m run_on_worker(
E           [1;32m    312[0m         _sample_row_group,
E           [0;32m--> 313[0m         [38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43m_path0[49m,
E           [1;32m    314[0m         [38;5;28mself[39m[38;5;241m.[39mfs,
E           [1;32m    315[0m         cpu[38;5;241m=[39m[38;5;28mself[39m[38;5;241m.[39mcpu,
E           [1;32m    316[0m         memory_usage[38;5;241m=[39m[38;5;28;01mTrue[39;00m,
E           [1;32m    317[0m         [38;5;241m[39m[38;5;241m[39m[38;5;28mself[39m[38;5;241m.[39mread_parquet_kwargs,
E           [1;32m    318[0m     )
E           [1;32m    319[0m     row_groups_per_part [38;5;241m=[39m [38;5;28mself[39m[38;5;241m.[39mpart_size [38;5;241m/[39m rg_byte_size_0
E           [1;32m    320[0m     [38;5;28;01mif[39;00m row_groups_per_part [38;5;241m<[39m [38;5;241m1.0[39m:
E

E           File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:338[0m, in [0;36mParquetDatasetEngine._path0[0;34m(self)[0m
E           [1;32m    335[0m [38;5;129m@property[39m  [38;5;66;03m# type: ignore[39;00m
E           [1;32m    336[0m [38;5;129m@functools[39m[38;5;241m.[39mlru_cache([38;5;241m1[39m)
E           [1;32m    337[0m [38;5;28;01mdef[39;00m [38;5;21m_path0[39m([38;5;28mself[39m):
E           [0;32m--> 338[0m     [38;5;28;01mreturn[39;00m [38;5;28mnext[39m([38;5;28;43mself[39;49m[38;5;241;43m.[39;49m[43m_dataset[49m[38;5;241m.[39mget_fragments())[38;5;241m.[39mpath
E

E           File [0;32m/usr/local/lib/python3.8/dist-packages/merlin/io/parquet.py:368[0m, in [0;36mParquetDatasetEngine._dataset[0;34m(self)[0m
E           [1;32m    365[0m     dataset [38;5;241m=[39m pa_ds[38;5;241m.[39mdataset(paths, filesystem[38;5;241m=[39mfs)
E           [1;32m    366[0m [38;5;28;01melse[39;00m:
E           [1;32m    367[0m     [38;5;66;03m# This is a directory or a single file[39;00m
E           [0;32m--> 368[0m     dataset [38;5;241m=[39m pa_ds[38;5;241m.[39mdataset([43mpaths[49m[43m[[49m[38;5;241;43m0[39;49m[43m][49m, filesystem[38;5;241m=[39mfs)
E           [1;32m    369[0m [38;5;28;01mreturn[39;00m dataset
E

E           [0;31mIndexError[0m: list index out of range
E           IndexError: list index out of range
/usr/local/lib/python3.8/dist-packages/nbclient/client.py:919: CellExecutionError
----------------------------- Captured stderr call -----------------------------
2022-08-25 17:33:27.182020: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-08-25 17:33:29.242835: I tensorflow/core/common_runtime/gpu/gpu_process_state.cc:222] Using CUDA malloc Async allocator for GPU: 0
2022-08-25 17:33:29.242999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 1627 MB memory:  -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-08-25 17:33:29.243700: I tensorflow/core/common_runtime/gpu/gpu_process_state.cc:222] Using CUDA malloc Async allocator for GPU: 1
2022-08-25 17:33:29.243752: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 14508 MB memory:  -> device: 1, name: Tesla P100-DGXS-16GB, pci bus id: 0000:08:00.0, compute capability: 6.0
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
File "/usr/lib/python3.8/logging/init.py", line 2127, in shutdown
h.close()
File "/usr/local/lib/python3.8/dist-packages/absl/logging/init.py", line 934, in close
self.stream.close()
File "/usr/local/lib/python3.8/dist-packages/ipykernel/iostream.py", line 438, in close
self.watch_fd_thread.join()
AttributeError: 'OutStream' object has no attribute 'watch_fd_thread'
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:807: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_filew1lgkpkm.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:939: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
===== 2 failed, 658 passed, 11 skipped, 121 warnings in 870.18s (0:14:30) ======
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins9539568741472097196.sh

Aug 25 '22 17:08 nvidia-merlin-bot

@rnyak After discussion with @marcromeyn . Seems like adding something about 'in batch' to the name may help make the name closer to it's natural sense. Something like InBatchNegatives or InBatchNegativeSampling.

Aug 26 '22 10:08 oliverholworthy

Click to view CI Results

GitHub pull request #668 of commit 340f58b2171d440c2d3ec66dd0b30f9046b7e34f, no merge conflicts.
Running as SYSTEM
Setting status of 340f58b2171d440c2d3ec66dd0b30f9046b7e34f to PENDING with url https://10.20.13.93:8080/job/merlin_models/1062/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse 340f58b2171d440c2d3ec66dd0b30f9046b7e34f^{commit} # timeout=10
Checking out Revision 340f58b2171d440c2d3ec66dd0b30f9046b7e34f (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 340f58b2171d440c2d3ec66dd0b30f9046b7e34f # timeout=10
Commit message: "Merge branch 'main' into neg_sampling"
 > git rev-list --no-walk e0fd324da1953a9fb42f7415411f8ca0f0f85653 # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins973152926166672683.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 672 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  2%]
tests/unit/datasets/test_synthetic.py .....                              [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  4%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 23%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 23%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 24%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 25%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 25%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 26%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 27%]
tests/unit/tf/core/test_combinators.py s...................              [ 30%]
tests/unit/tf/core/test_index.py ...                                     [ 31%]
tests/unit/tf/core/test_prediction.py ..                                 [ 31%]
tests/unit/tf/core/test_tabular.py ....                                  [ 31%]
tests/unit/tf/core/test_transformations.py s............................ [ 36%]
..................                                                       [ 38%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 39%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 40%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 41%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 41%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 41%]
tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 41%]
tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 41%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 42%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 42%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 42%]
tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 42%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 42%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 43%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 48%]
..                                                                       [ 48%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 51%]
tests/unit/tf/layers/test_queue.py ..............                        [ 53%]
tests/unit/tf/losses/test_losses.py .......................              [ 56%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 57%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 61%]
tests/unit/tf/models/test_base.py s.................                     [ 63%]
tests/unit/tf/models/test_benchmark.py ..                                [ 63%]
tests/unit/tf/models/test_ranking.py ........................            [ 67%]
tests/unit/tf/models/test_retrieval.py ................................  [ 72%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 72%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 75%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 75%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 76%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 76%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 77%]
tests/unit/tf/predictions/test_base.py .....                             [ 77%]
tests/unit/tf/predictions/test_classification.py .......                 [ 78%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 80%]
tests/unit/tf/predictions/test_regression.py ..                          [ 80%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 80%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 82%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 83%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 84%]
tests/unit/torch/features/test_embedding.py ..............               [ 86%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 97%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_advertising.py: 1 warning
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 5 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_index.py: 8 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 13 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/data_augmentation/test_noise.py: 1 warning
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 18 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 28 warnings
tests/unit/tf/models/test_retrieval.py: 60 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 9 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 3 warnings
tests/unit/xgb/test_xgboost.py: 18 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 5 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_index.py: 3 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 10 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 18 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 26 warnings
tests/unit/tf/models/test_retrieval.py: 32 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 7 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 2 warnings
tests/unit/xgb/test_xgboost.py: 17 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/datasets/test_entertainment.py: 1 warning
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_prediction.py: 1 warning
tests/unit/tf/data_augmentation/test_negative_sampling.py: 9 warnings
tests/unit/tf/inputs/test_continuous.py: 2 warnings
tests/unit/tf/inputs/test_embedding.py: 9 warnings
tests/unit/tf/inputs/test_tabular.py: 8 warnings
tests/unit/tf/models/test_ranking.py: 16 warnings
tests/unit/tf/models/test_retrieval.py: 4 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/xgb/test_xgboost.py: 12 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:807: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_file9czu6thq.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:939: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/distributed/node.py:180: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 33423 instead
warnings.warn(
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
========== 661 passed, 11 skipped, 996 warnings in 954.62s (0:15:54) ===========
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins8002270659483990039.sh

Aug 29 '22 14:08 nvidia-merlin-bot

Click to view CI Results

GitHub pull request #668 of commit f5d953757b0084ab5a1cc5646d8edd4008cfbb42, no merge conflicts.
Running as SYSTEM
Setting status of f5d953757b0084ab5a1cc5646d8edd4008cfbb42 to PENDING with url https://10.20.13.93:8080/job/merlin_models/1103/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse f5d953757b0084ab5a1cc5646d8edd4008cfbb42^{commit} # timeout=10
Checking out Revision f5d953757b0084ab5a1cc5646d8edd4008cfbb42 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f f5d953757b0084ab5a1cc5646d8edd4008cfbb42 # timeout=10
Commit message: "Merge branch 'main' into neg_sampling"
 > git rev-list --no-walk b26bed6151fe1866019799874e978f827c1feddb # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins4664524692433074418.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 678 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  2%]
tests/unit/datasets/test_synthetic.py ......                             [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  5%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 23%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 23%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 24%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 25%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 25%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 25%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 27%]
tests/unit/tf/core/test_combinators.py s...................              [ 30%]
tests/unit/tf/core/test_index.py ...                                     [ 30%]
tests/unit/tf/core/test_prediction.py ..                                 [ 31%]
tests/unit/tf/core/test_tabular.py ....                                  [ 31%]
tests/unit/tf/core/test_transformations.py s............................ [ 36%]
..................                                                       [ 38%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 38%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 40%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 41%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 41%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 41%]
tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 41%]
tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 41%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 41%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 42%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 42%]
tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 42%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 42%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 43%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 48%]
..                                                                       [ 48%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 51%]
tests/unit/tf/layers/test_queue.py ..............                        [ 53%]
tests/unit/tf/losses/test_losses.py .......................              [ 56%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 57%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 60%]
tests/unit/tf/models/test_base.py s................                      [ 63%]
tests/unit/tf/models/test_benchmark.py ..                                [ 63%]
tests/unit/tf/models/test_ranking.py ..............................      [ 67%]
tests/unit/tf/models/test_retrieval.py ................................  [ 72%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 72%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 75%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 75%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 76%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 76%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 77%]
tests/unit/tf/predictions/test_base.py .....                             [ 78%]
tests/unit/tf/predictions/test_classification.py .......                 [ 79%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 80%]
tests/unit/tf/predictions/test_regression.py ..                          [ 80%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 81%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 82%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 83%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 84%]
tests/unit/torch/features/test_embedding.py ..............               [ 87%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 97%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_advertising.py: 1 warning
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 6 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_index.py: 8 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 13 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/data_augmentation/test_noise.py: 1 warning
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 34 warnings
tests/unit/tf/models/test_retrieval.py: 60 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 9 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 3 warnings
tests/unit/xgb/test_xgboost.py: 18 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 5 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_index.py: 3 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 10 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 32 warnings
tests/unit/tf/models/test_retrieval.py: 32 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 7 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 2 warnings
tests/unit/xgb/test_xgboost.py: 17 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/datasets/test_entertainment.py: 1 warning
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_prediction.py: 1 warning
tests/unit/tf/data_augmentation/test_negative_sampling.py: 9 warnings
tests/unit/tf/inputs/test_continuous.py: 2 warnings
tests/unit/tf/inputs/test_embedding.py: 9 warnings
tests/unit/tf/inputs/test_tabular.py: 8 warnings
tests/unit/tf/models/test_ranking.py: 16 warnings
tests/unit/tf/models/test_retrieval.py: 4 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/xgb/test_xgboost.py: 12 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:807: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_filel9e2x495.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_categorical_one_hot[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_hashed_cross[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:980: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_onehot_multihot_feature_interaction[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_feature_interaction_multi_optimizer[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
========== 667 passed, 11 skipped, 1011 warnings in 951.69s (0:15:51) ==========
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins582704728480124529.sh

Aug 31 '22 15:08 nvidia-merlin-bot

@rnyak After discussion with @marcromeyn . Seems like adding something about 'in batch' to the name may help make the name closer to it's natural sense. Something like InBatchNegatives or InBatchNegativeSampling.

@marcromeyn and @oliverholworthy Wonder if this would lead confusion for users. Since we also have in batch negative sampling in retrieval, we dont want people to think that they can use InBatchNegativeSampling class for retrieval models as well.. bcs they wont be able to, if I am not mistaken. so did we decide if InBatchNegativeSampling is only for ranking? If yes, we would explicit explanations in the docstrings to avoid confusion.

Sep 06 '22 13:09 rnyak

Click to view CI Results

GitHub pull request #668 of commit 308434590a6b3d33553bd7b8059d6594c4bd0067, no merge conflicts.
Running as SYSTEM
Setting status of 308434590a6b3d33553bd7b8059d6594c4bd0067 to PENDING with url https://10.20.13.93:8080/job/merlin_models/1152/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse 308434590a6b3d33553bd7b8059d6594c4bd0067^{commit} # timeout=10
Checking out Revision 308434590a6b3d33553bd7b8059d6594c4bd0067 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 308434590a6b3d33553bd7b8059d6594c4bd0067 # timeout=10
Commit message: "Merge branch 'main' into neg_sampling"
 > git rev-list --no-walk 8b15b77e9671fd259269798a6aaa5c8321f32c29 # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins6354751535028181804.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 681 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  2%]
tests/unit/datasets/test_synthetic.py ......                             [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  4%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 23%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 23%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 23%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 25%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 25%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 25%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 27%]
tests/unit/tf/core/test_combinators.py s...................              [ 30%]
tests/unit/tf/core/test_index.py ...                                     [ 30%]
tests/unit/tf/core/test_prediction.py ..                                 [ 31%]
tests/unit/tf/core/test_tabular.py ....                                  [ 31%]
tests/unit/tf/core/test_transformations.py s............................ [ 35%]
..................                                                       [ 38%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 38%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 40%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 40%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 41%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 41%]
tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 41%]
tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 41%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 41%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 41%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 41%]
tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 42%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 42%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 43%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 47%]
.....                                                                    [ 48%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 51%]
tests/unit/tf/layers/test_queue.py ..............                        [ 53%]
tests/unit/tf/losses/test_losses.py .......................              [ 56%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 57%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 60%]
tests/unit/tf/models/test_base.py s................                      [ 63%]
tests/unit/tf/models/test_benchmark.py ..                                [ 63%]
tests/unit/tf/models/test_ranking.py ..............................      [ 67%]
tests/unit/tf/models/test_retrieval.py ................................  [ 72%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 72%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 75%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 76%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 76%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 76%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 77%]
tests/unit/tf/predictions/test_base.py .....                             [ 78%]
tests/unit/tf/predictions/test_classification.py .......                 [ 79%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 80%]
tests/unit/tf/predictions/test_regression.py ..                          [ 80%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 81%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 82%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 83%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 85%]
tests/unit/torch/features/test_embedding.py ..............               [ 87%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 97%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_advertising.py: 1 warning
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 6 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_index.py: 8 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 13 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/data_augmentation/test_noise.py: 1 warning
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 34 warnings
tests/unit/tf/models/test_retrieval.py: 60 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 9 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 3 warnings
tests/unit/xgb/test_xgboost.py: 18 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 5 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_index.py: 3 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 10 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 32 warnings
tests/unit/tf/models/test_retrieval.py: 32 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 7 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 2 warnings
tests/unit/xgb/test_xgboost.py: 17 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/datasets/test_entertainment.py: 1 warning
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_prediction.py: 1 warning
tests/unit/tf/data_augmentation/test_negative_sampling.py: 9 warnings
tests/unit/tf/inputs/test_continuous.py: 2 warnings
tests/unit/tf/inputs/test_embedding.py: 9 warnings
tests/unit/tf/inputs/test_tabular.py: 8 warnings
tests/unit/tf/models/test_ranking.py: 16 warnings
tests/unit/tf/models/test_retrieval.py: 4 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/xgb/test_xgboost.py: 12 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:879: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_filev16rgd15.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_categorical_one_hot[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_hashed_cross[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:980: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_onehot_multihot_feature_interaction[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_feature_interaction_multi_optimizer[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
========== 670 passed, 11 skipped, 1011 warnings in 956.70s (0:15:56) ==========
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins4389178862763486141.sh

Sep 06 '22 14:09 nvidia-merlin-bot

Click to view CI Results

GitHub pull request #668 of commit 6bb1a73077529329641e8ca32352633faaee7219, no merge conflicts.
Running as SYSTEM
Setting status of 6bb1a73077529329641e8ca32352633faaee7219 to PENDING with url https://10.20.13.93:8080/job/merlin_models/1166/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse 6bb1a73077529329641e8ca32352633faaee7219^{commit} # timeout=10
Checking out Revision 6bb1a73077529329641e8ca32352633faaee7219 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 6bb1a73077529329641e8ca32352633faaee7219 # timeout=10
Commit message: "Merge branch 'main' into neg_sampling"
 > git rev-list --no-walk b5e31e622d216b83709d6d5f206015e286ac1070 # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins10921861590138963881.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 682 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  2%]
tests/unit/datasets/test_synthetic.py ......                             [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  4%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 23%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 23%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 23%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 25%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 25%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 25%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 27%]
tests/unit/tf/core/test_combinators.py s...................              [ 30%]
tests/unit/tf/core/test_encoder.py .                                     [ 30%]
tests/unit/tf/core/test_index.py ...                                     [ 30%]
tests/unit/tf/core/test_prediction.py ..                                 [ 31%]
tests/unit/tf/core/test_tabular.py ....                                  [ 31%]
tests/unit/tf/core/test_transformations.py s............................ [ 36%]
..................                                                       [ 38%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 38%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 40%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 41%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 41%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 41%]
tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 41%]
tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 41%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 41%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 41%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 42%]
tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 42%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 42%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 43%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 47%]
.....                                                                    [ 48%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 51%]
tests/unit/tf/layers/test_queue.py ..............                        [ 53%]
tests/unit/tf/losses/test_losses.py .......................              [ 56%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 57%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 60%]
tests/unit/tf/models/test_base.py s................                      [ 63%]
tests/unit/tf/models/test_benchmark.py ..                                [ 63%]
tests/unit/tf/models/test_ranking.py ..............................      [ 68%]
tests/unit/tf/models/test_retrieval.py ................................  [ 72%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 73%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 75%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 76%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 76%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 76%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 77%]
tests/unit/tf/predictions/test_base.py .....                             [ 78%]
tests/unit/tf/predictions/test_classification.py .......                 [ 79%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 80%]
tests/unit/tf/predictions/test_regression.py ..                          [ 80%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 81%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 82%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 84%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 85%]
tests/unit/torch/features/test_embedding.py ..............               [ 87%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 97%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_advertising.py: 1 warning
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 6 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_encoder.py: 2 warnings
tests/unit/tf/core/test_index.py: 8 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 13 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/data_augmentation/test_noise.py: 1 warning
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 34 warnings
tests/unit/tf/models/test_retrieval.py: 60 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 9 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 3 warnings
tests/unit/xgb/test_xgboost.py: 18 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 5 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_encoder.py: 2 warnings
tests/unit/tf/core/test_index.py: 3 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 10 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 32 warnings
tests/unit/tf/models/test_retrieval.py: 32 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 7 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 2 warnings
tests/unit/xgb/test_xgboost.py: 17 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/datasets/test_entertainment.py: 1 warning
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_encoder.py: 1 warning
tests/unit/tf/core/test_prediction.py: 1 warning
tests/unit/tf/data_augmentation/test_negative_sampling.py: 9 warnings
tests/unit/tf/inputs/test_continuous.py: 2 warnings
tests/unit/tf/inputs/test_embedding.py: 9 warnings
tests/unit/tf/inputs/test_tabular.py: 8 warnings
tests/unit/tf/models/test_ranking.py: 16 warnings
tests/unit/tf/models/test_retrieval.py: 4 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/xgb/test_xgboost.py: 12 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:879: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_fileo0mai9xm.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_categorical_one_hot[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_hashed_cross[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:980: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_onehot_multihot_feature_interaction[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_feature_interaction_multi_optimizer[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
========== 671 passed, 11 skipped, 1016 warnings in 954.66s (0:15:54) ==========
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins10644117759031732701.sh

Sep 07 '22 14:09 nvidia-merlin-bot

@rnyak After discussion with @marcromeyn . Seems like adding something about 'in batch' to the name may help make the name closer to it's natural sense. Something like InBatchNegatives or InBatchNegativeSampling.

@marcromeyn and @oliverholworthy Wonder if this would lead confusion for users. Since we also have in batch negative sampling in retrieval, we dont want people to think that they can use InBatchNegativeSampling class for retrieval models as well.. bcs they wont be able to, if I am not mistaken. so did we decide if InBatchNegativeSampling is only for ranking? If yes, we would explicit explanations in the docstrings to avoid confusion.

How about renaming the UniformNegativeSampling class to SampleFromBatch?

Sep 08 '22 15:09 sararb

Click to view CI Results

GitHub pull request #668 of commit 04df610fc211da4c3e6c4154ceeb2cf0670202db, no merge conflicts.
Running as SYSTEM
Setting status of 04df610fc211da4c3e6c4154ceeb2cf0670202db to PENDING with url https://10.20.13.93:8080/job/merlin_models/1191/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/668/*:refs/remotes/origin/pr/668/* # timeout=10
 > git rev-parse 04df610fc211da4c3e6c4154ceeb2cf0670202db^{commit} # timeout=10
Checking out Revision 04df610fc211da4c3e6c4154ceeb2cf0670202db (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 04df610fc211da4c3e6c4154ceeb2cf0670202db # timeout=10
Commit message: "Merge branch 'main' into neg_sampling"
 > git rev-list --no-walk 3e9c230118818cdb5ccda69173874cbdf4a53b5f # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins3115238236487603557.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.4.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.6)
Requirement already satisfied: traitlets>=5.1 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (5.3.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.9.1)
Requirement already satisfied: jupyter-core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.4)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0; python_version =2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version =2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (23.2.1)
Requirement already satisfied: tornado>=6.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0; python_version =1.4.0; python_version jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 682 items
tests/unit/config/test_schema.py ....                                    [  0%]
tests/unit/datasets/test_advertising.py .s                               [  0%]
tests/unit/datasets/test_ecommerce.py ..sss                              [  1%]
tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]
tests/unit/datasets/test_social.py .                                     [  2%]
tests/unit/datasets/test_synthetic.py ......                             [  3%]
tests/unit/implicit/test_implicit.py .                                   [  3%]
tests/unit/lightfm/test_lightfm.py .                                     [  4%]
tests/unit/tf/test_core.py ......                                        [  4%]
tests/unit/tf/test_dataset.py ................                           [  7%]
tests/unit/tf/test_public_api.py .                                       [  7%]
tests/unit/tf/blocks/test_cross.py ...........                           [  9%]
tests/unit/tf/blocks/test_dlrm.py ..........                             [ 10%]
tests/unit/tf/blocks/test_interactions.py .                              [ 10%]
tests/unit/tf/blocks/test_mlp.py .................................       [ 15%]
tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]
.....................                                                    [ 23%]
tests/unit/tf/blocks/retrieval/test_base.py .                            [ 23%]
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 23%]
tests/unit/tf/blocks/retrieval/test_two_tower.py ...........             [ 25%]
tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 25%]
tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 25%]
tests/unit/tf/core/test_aggregation.py .........                         [ 27%]
tests/unit/tf/core/test_base.py ..                                       [ 27%]
tests/unit/tf/core/test_combinators.py s...................              [ 30%]
tests/unit/tf/core/test_encoder.py .                                     [ 30%]
tests/unit/tf/core/test_index.py ...                                     [ 30%]
tests/unit/tf/core/test_prediction.py ..                                 [ 31%]
tests/unit/tf/core/test_tabular.py ....                                  [ 31%]
tests/unit/tf/core/test_transformations.py s............................ [ 36%]
..................                                                       [ 38%]
tests/unit/tf/data_augmentation/test_misc.py .                           [ 38%]
tests/unit/tf/data_augmentation/test_negative_sampling.py ..........     [ 40%]
tests/unit/tf/data_augmentation/test_noise.py .....                      [ 41%]
tests/unit/tf/examples/test_01_getting_started.py .                      [ 41%]
tests/unit/tf/examples/test_02_dataschema.py .                           [ 41%]
tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 41%]
tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 41%]
tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 41%]
tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 41%]
tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 42%]
tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 42%]
tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 42%]
tests/unit/tf/inputs/test_continuous.py .....                            [ 43%]
tests/unit/tf/inputs/test_embedding.py ................................. [ 47%]
.....                                                                    [ 48%]
tests/unit/tf/inputs/test_tabular.py ..................                  [ 51%]
tests/unit/tf/layers/test_queue.py ..............                        [ 53%]
tests/unit/tf/losses/test_losses.py .......................              [ 56%]
tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 57%]
tests/unit/tf/metrics/test_metrics_topk.py .......................       [ 60%]
tests/unit/tf/models/test_base.py s................                      [ 63%]
tests/unit/tf/models/test_benchmark.py ..                                [ 63%]
tests/unit/tf/models/test_ranking.py ..............................      [ 68%]
tests/unit/tf/models/test_retrieval.py ................................  [ 72%]
tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 73%]
tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 75%]
tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 76%]
tests/unit/tf/prediction_tasks/test_regression.py ..                     [ 76%]
tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 76%]
tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 77%]
tests/unit/tf/predictions/test_base.py .....                             [ 78%]
tests/unit/tf/predictions/test_classification.py .......                 [ 79%]
tests/unit/tf/predictions/test_dot_product.py ........                   [ 80%]
tests/unit/tf/predictions/test_regression.py ..                          [ 80%]
tests/unit/tf/predictions/test_sampling.py ....                          [ 81%]
tests/unit/tf/utils/test_batch.py ....                                   [ 81%]
tests/unit/tf/utils/test_tf_utils.py .....                               [ 82%]
tests/unit/torch/test_dataset.py .........                               [ 83%]
tests/unit/torch/test_public_api.py .                                    [ 84%]
tests/unit/torch/block/test_base.py ....                                 [ 84%]
tests/unit/torch/block/test_mlp.py .                                     [ 84%]
tests/unit/torch/features/test_continuous.py ..                          [ 85%]
tests/unit/torch/features/test_embedding.py ..............               [ 87%]
tests/unit/torch/features/test_tabular.py ....                           [ 87%]
tests/unit/torch/model/test_head.py ............                         [ 89%]
tests/unit/torch/model/test_model.py ..                                  [ 89%]
tests/unit/torch/tabular/test_aggregation.py ........                    [ 90%]
tests/unit/torch/tabular/test_tabular.py ...                             [ 91%]
tests/unit/torch/tabular/test_transformations.py .......                 [ 92%]
tests/unit/utils/test_schema_utils.py ................................   [ 97%]
tests/unit/xgb/test_xgboost.py ....................                      [100%]
=============================== warnings summary ===============================
../../../../../usr/lib/python3/dist-packages/requests/init.py:89
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.
'nearest': pil_image.NEAREST,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
'bilinear': pil_image.BILINEAR,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
'bicubic': pil_image.BICUBIC,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.
'hamming': pil_image.HAMMING,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.
'box': pil_image.BOX,
../../../../../usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41
/usr/local/lib/python3.8/dist-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.
'lanczos': pil_image.LANCZOS,
tests/unit/datasets/test_advertising.py: 1 warning
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 6 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_encoder.py: 2 warnings
tests/unit/tf/core/test_index.py: 8 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 13 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/data_augmentation/test_noise.py: 1 warning
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 34 warnings
tests/unit/tf/models/test_retrieval.py: 60 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 9 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 3 warnings
tests/unit/xgb/test_xgboost.py: 18 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py: 2 warnings
tests/unit/datasets/test_entertainment.py: 4 warnings
tests/unit/datasets/test_social.py: 1 warning
tests/unit/datasets/test_synthetic.py: 5 warnings
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_core.py: 6 warnings
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/test_cross.py: 5 warnings
tests/unit/tf/blocks/test_dlrm.py: 9 warnings
tests/unit/tf/blocks/test_mlp.py: 26 warnings
tests/unit/tf/blocks/test_optimizer.py: 30 warnings
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 10 warnings
tests/unit/tf/core/test_aggregation.py: 6 warnings
tests/unit/tf/core/test_base.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_encoder.py: 2 warnings
tests/unit/tf/core/test_index.py: 3 warnings
tests/unit/tf/core/test_prediction.py: 2 warnings
tests/unit/tf/core/test_transformations.py: 10 warnings
tests/unit/tf/data_augmentation/test_negative_sampling.py: 10 warnings
tests/unit/tf/inputs/test_continuous.py: 4 warnings
tests/unit/tf/inputs/test_embedding.py: 19 warnings
tests/unit/tf/inputs/test_tabular.py: 18 warnings
tests/unit/tf/models/test_base.py: 17 warnings
tests/unit/tf/models/test_benchmark.py: 2 warnings
tests/unit/tf/models/test_ranking.py: 32 warnings
tests/unit/tf/models/test_retrieval.py: 32 warnings
tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/tf/prediction_tasks/test_regression.py: 2 warnings
tests/unit/tf/predictions/test_base.py: 5 warnings
tests/unit/tf/predictions/test_classification.py: 7 warnings
tests/unit/tf/predictions/test_dot_product.py: 8 warnings
tests/unit/tf/predictions/test_regression.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 7 warnings
tests/unit/torch/block/test_base.py: 4 warnings
tests/unit/torch/block/test_mlp.py: 1 warning
tests/unit/torch/features/test_continuous.py: 1 warning
tests/unit/torch/features/test_embedding.py: 4 warnings
tests/unit/torch/features/test_tabular.py: 4 warnings
tests/unit/torch/model/test_head.py: 12 warnings
tests/unit/torch/model/test_model.py: 2 warnings
tests/unit/torch/tabular/test_aggregation.py: 6 warnings
tests/unit/torch/tabular/test_transformations.py: 2 warnings
tests/unit/xgb/test_xgboost.py: 17 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/datasets/test_ecommerce.py::test_synthetic_aliccp_raw_data
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-True-8]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-10]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-9]
tests/unit/tf/test_dataset.py::test_tf_drp_reset[100-False-8]
tests/unit/tf/test_dataset.py::test_tf_catname_ordering
tests/unit/tf/test_dataset.py::test_tf_map
/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:384: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.
warnings.warn(
tests/unit/datasets/test_entertainment.py: 1 warning
tests/unit/implicit/test_implicit.py: 1 warning
tests/unit/lightfm/test_lightfm.py: 1 warning
tests/unit/tf/test_dataset.py: 1 warning
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings
tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings
tests/unit/tf/core/test_combinators.py: 10 warnings
tests/unit/tf/core/test_encoder.py: 1 warning
tests/unit/tf/core/test_prediction.py: 1 warning
tests/unit/tf/data_augmentation/test_negative_sampling.py: 9 warnings
tests/unit/tf/inputs/test_continuous.py: 2 warnings
tests/unit/tf/inputs/test_embedding.py: 9 warnings
tests/unit/tf/inputs/test_tabular.py: 8 warnings
tests/unit/tf/models/test_ranking.py: 16 warnings
tests/unit/tf/models/test_retrieval.py: 4 warnings
tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings
tests/unit/xgb/test_xgboost.py: 12 warnings
/usr/local/lib/python3.8/dist-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].
warnings.warn(
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export
tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:879: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack
embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))
tests/unit/tf/core/test_index.py: 4 warnings
tests/unit/tf/models/test_retrieval.py: 54 warnings
tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings
tests/unit/tf/predictions/test_classification.py: 12 warnings
tests/unit/tf/predictions/test_dot_product.py: 2 warnings
tests/unit/tf/utils/test_batch.py: 2 warnings
/tmp/autograph_generated_filenwj6xr5b.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.1]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.3]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.5]
tests/unit/tf/data_augmentation/test_noise.py::test_stochastic_swap_noise[0.7]
tests/unit/tf/models/test_base.py::test_model_pre_post[True]
tests/unit/tf/models/test_base.py::test_model_pre_post[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.
return dispatch_target(*args, **kwargs)
tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]
tests/unit/tf/models/test_base.py::test_freeze_sequential_block
tests/unit/tf/models/test_base.py::test_freeze_unfreeze
tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks
/usr/local/lib/python3.8/dist-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.
super(SGD, self).init(name, **kwargs)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_categorical_one_hot[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_hashed_cross[False]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/transformations.py:980: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag
return py_builtins.overload_of(f)(*args)
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_onehot_multihot_feature_interaction[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_feature_interaction_multi_optimizer[False]
/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.
warnings.warn(
tests/unit/torch/block/test_mlp.py::test_mlp_block
/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)
return {key: torch.tensor(value) for key, value in data.items()}
tests/unit/xgb/test_xgboost.py::test_without_dask_client
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]
tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]
tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple
tests/unit/xgb/test_xgboost.py::TestEvals::test_default
tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid
tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data
/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:335: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].
warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")
tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective
/usr/local/lib/python3.8/dist-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first
self.make_current()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:62: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:78: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [1] tests/unit/datasets/test_ecommerce.py:92: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP
SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR
SKIPPED [4] ../../../../../usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py:2746: Not a test.
========== 671 passed, 11 skipped, 1016 warnings in 957.70s (0:15:57) ==========
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_models] $ /bin/bash /tmp/jenkins16734786332296458486.sh

Sep 12 '22 14:09 nvidia-merlin-bot

Closing this since the rename has been made in #710 to InBatchNegatives

Sep 21 '22 09:09 oliverholworthy