Redis Materialization fails: wrong number of arguments for 'hset' command

[adamschmidt]

Expected Behavior

Materialization from a Snowflake offline store to a Redis online store completes successfully

Current Behavior

Running the materialize-incremental CLI command (Snowflake -> Redis) fails with the following message:

redis.exceptions.ResponseError: Command # 1 (HSET ACCOUNT_ID�<project name> _ts:<feature view name>��ז ��Cp 5 ��y� 5 4�> ) of pipeline caused error: wrong number of arguments for 'hset' command

Steps to reproduce

• Set up feature services and feature views
• Provision redis store
• Create offline dataset in Snowflake
• Configure feature_store.yaml with Snowflake offline/Redis online stores
• Run feast materialize-incremental <timestamp>
• Wait for crash

Specifications

• Version: 0.22.1
• Platform: Python 3.10, Linux, Docker
• Subsystem: AWS EKS

Possible Solution

Unsure. Possibly issues with the bytes being written as either the key or value?

[m0hitbansal]

I am getting same issue b'\x02\x00\x00\x00merchant_id\x02\x00\x00\x00source\x04\x00\x00\x00\x08\x00\x00\x00\x98\xf7\x81\x00\x00\x00\x00\x00\x02\x00\x00\x00\x04\x00\x00\x00PAYUfraud_demo' {'_ts:merchant_featureview': b'\x08\xc6\xa5\x8a\x98\x06', b'!2\x1e\xe2': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'\xfag\x86\x90': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'\xa0(2\xde': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'@q?\xae': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'$\xe0)W': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'5\xe6\x87\xae': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'\xbeD:-': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'\xf3E\x9dX': b')\x00\x00\x00\x00\x00\x00\x00\x00', b'\xf2\xef&\xe5': b')\x00\x00\x00\x00\x00\x00\x00\x00', b')@\x957': b' \x00', b'\x9d\xca\xcfD': b')\x00\x00\x00\x00\x00\x00\x00\x00'} 0%| | 0/100 [00:00<?, ?it/s] Traceback (most recent call last):

raise response

redis.exceptions.ResponseError: Command # 1 (HSET merchant_idsourc��BCfraud_demo _ts:merchant_featureviewƥ�� !2� ) �����? �g�� )�Z����? �(2� )�wI� (s? @q?� )�wI� (s? $�)W ) 5懮 ) �D:- ) �E�X ) ��&� ) )@�7 ���D )) of pipeline caused error: wrong number of arguments for 'hset' command

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[sfc-gh-madkins]

@m0hitbansal @adamschmidt were you ever able to resolve this issue? Can you add more details about your project?

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[sfc-gh-madkins]

bump

On Sat, May 20, 2023 at 11:37 AM stale[bot] @.***> wrote:

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

— Reply to this email directly, view it on GitHub https://github.com/feast-dev/feast/issues/2953#issuecomment-1555948209, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATSRCU7NO7S4F7IQVOVWH7DXHDXLPANCNFSM54CGDTLQ . You are receiving this because you commented.Message ID: @.***>