Arun Sethia

icon indicating an email [email protected]

icon location United States icon location Passionate about open source distributed scalable computing, reactive, technologies, enjoy designing and coding scalable systems.

Results 1 issues of Arun Sethia

Pushdown filter not working with Varchar datatype

1 comment

Hi, In our code ``` spark.read .format("com.databricks.spark.redshift") .option("url","") .option("user","user") .option("password","password") .option("forward_spark_s3_credentials" -> "true") .option("tempdir","") .option("dbtable","schema.tablename") .load() .select("*") .filter("FIELDNAME='N'") ``` The physical plan shows PushedFilters: [] Library version: com.databricks:spark-redshift_2.11:2.0.1 Spark Version...