Oleksii Diagiliev

Hi @agrimn , Do you submit the jar or run it from your IDE? I tried to run your code from IDE and getting the following that seems to be...

Hi @tsekityam , the `SaveMode.Append` uses `hmset` command internally, so it may not completely overwrite the row if the scheme of new dataframe is different. You are right, the documentation...

Hi @zhxchnl , It looks like it is not possible. We will need to create a new API function for this. For now you can add the following to your...

Hi @justinTM , could you try it with spark-redis 3.1.0? Also, could you try to specify connection parameters when creating Spark session rather than as dataframe save options?

Hi @VarunWachaspati , did you consider converting your dataframe to a key/value pair RDD and saving to RDD then? https://github.com/RedisLabs/spark-redis/blob/master/doc/rdd.md#strings-1 It will store the RDD as Redis strings.

Yep, we might want to introduce it, but for now it's a low priority since one can use the alternative API to achieve the same.

Hi, What is a motivation of having RDD?

I have prototyped changes similar similar to what @YYY3000 proposed in this branch https://github.com/RedisLabs/spark-redis/compare/master...fe2s:issue-120-prototyping-byte-operations Unfortunately they will require quite a lot of duplication and increase code complexity. At the moment...

Hi @dggc , We will need to recompile the source base with Spark 3.0 dependencies and run the tests to answer this question. We haven't done this yet.

Hi @MartinsGabrielC , I think it should be possible to add DataFrame support for byte array fields. I will take a look.