seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

use hbase as sink :java.lang.NoSuchMethodError

Open justor opened this issue 3 years ago • 1 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

use hbase as sink ,error occured :java.lang.NoSuchMethodError

SeaTunnel Version

2.1.2

SeaTunnel Config

hbase {
    source_table_name = "tbl_hbase_test"
    hbase.zookeeper.quorum = "host01:2181,host02:2181,host03:2181"
    catalog = "{\"table\":{\"namespace\":\"default\", \"name\":\"customer\"},\"rowkey\":\"c_custkey\",\"columns\":{\"c_custkey\":{\"cf\":\"rowkey\", \"col\":\"c_custkey\", \"type\":\"bigint\"},\"c_name\":{\"cf\":\"info\", \"col\":\"c_name\", \"type\":\"string\"},\"c_address\":{\"cf\":\"info\", \"col\":\"c_address\", \"type\":\"string\"},\"c_city\":{\"cf\":\"info\", \"col\":\"c_city\", \"type\":\"string\"},\"c_nation\":{\"cf\":\"info\", \"col\":\"c_nation\", \"type\":\"string\"},\"c_region\":{\"cf\":\"info\", \"col\":\"c_region\", \"type\":\"string\"},\"c_phone\":{\"cf\":\"info\", \"col\":\"c_phone\", \"type\":\"string\"},\"c_mktsegment\":{\"cf\":\"info\", \"col\":\"c_mktsegment\", \"type\":\"string\"}}}"
    staging_dir = "/tmp/hbase-staging/"
    save_mode = "overwrite"
}

Running Command

./bin/start-seatunnel-spark.sh --master local[4] --deploy-mode client --config ./config/spark.streaming.conf.template

Error Exception

java.loang.NoSuchMethodError:org.apache.hadoop.hbase.util.Bytes.<init>([B)V
at org.apache.hadoop.hbase.client.ColumnFamilyDescriptorBuilder.<clinit>

Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

justor avatar Jun 20 '22 08:06 justor

Does another hbase libraries in your classpath? i see the branch 2.1.2-release use hbase with version 2.1.0.

hk-lrzy avatar Jun 22 '22 09:06 hk-lrzy