Merlin icon indicating copy to clipboard operation
Merlin copied to clipboard

[QST]Follow the example 'getting started movies' to execute an error.

Open jianhuaz opened this issue 1 year ago • 4 comments

❓ Questions & Help

Details

Merlin-PyTorch

batch : ({'userId': tensor([13849, 1743, 35896, ..., 339, 79530, 88722], device='cuda:0'), 'movieId': tensor([ 890, 2922, 780, ..., 9143, 2444, 813], device='cuda:0'), 'genres__values': tensor([ 4, 3, 10, ..., 17, 15, 12], device='cuda:0'), 'genres__offsets': tensor([ 0, 2, 6, ..., 89550, 89555, 89557], device='cuda:0', dtype=torch.int32)}, tensor([1., 1., 0., ..., 1., 1., 1.], device='cuda:0'))

target_columns : ['userId', 'movieId', 'genres']

Why are ‘genres_values‘ and ’genres_offsets‘ in batch instead of ’genres‘?

image

jianhuaz avatar Oct 19 '23 12:10 jianhuaz

@jianhuaz Because genres is a ragged list input feature, and we represent ragged tensors with __values and __offsets.

how did you install Merlin libraries? are you using a docker image to run our examples?

rnyak avatar Dec 05 '23 02:12 rnyak

This issue is still present. I have installed the Merlin libraries locally and it works up exactly to that point.

I believe this problem could be solved by writing a different transform function rather than the standard one present at https://github.com/NVIDIA-Merlin/NVTabular/blob/main/nvtabular/framework_utils/torch/utils.py

Any update on this?

CarloNicolini avatar May 20 '24 13:05 CarloNicolini

I am getting the same error using PyTorch container as shown below. I like the framework but this type of error discourage new users from the getgo.

image

yueming-zhang avatar Jun 01 '24 00:06 yueming-zhang

Getting the same error. Did you manage to find a solution?

zainkhan-afk avatar Jul 03 '24 07:07 zainkhan-afk