starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

read har file by broker fail

Open blanklin030 opened this issue 1 year ago • 0 comments

Steps to reproduce the behavior (Required)

LOAD LABEL db.xxxxx_label (
DATA INFILE("har://hdfs-Cluster5/user/xx/yy/har/xx/xx_label_1d__202403.har/dt=2024-03-03/*")
INTO TABLE tb_sr
TEMPORARY PARTITION(temp__p20240303)
COLUMNS TERMINATED BY "\u0001"
FORMAT as "ORC"
(`dri_name`, `open_company_id`, `vehicle_ord_type`, `is_open_dri`, `dri_contribute_type`, `city_id`)
SET (
 `dri_name` = `dri_name`,
 `open_company_id` = `open_company_id`,
 `vehicle_ord_type` = `vehicle_ord_type`,
 `is_open_dri` =  `is_open_dri`,
 `dri_contribute_type` =  `dri_contribute_type`,
 `city_id` =  `city_id`,
 `dt` = '2024-03-03'
) 
)WITH BROKER 'hdfs_broker' (
    "username" = "xxxx",
    "password" = "xxxx"
) 
PROPERTIES(
       "timeout" = "72000"
)

Expected behavior (Required)

load success

Real behavior (Required)

URL: null; ErrorMsg: type:ETL_RUN_FAIL; msg:Broker list path failed. path=har://hdfs-Cluster5/user/xx/yy/har/xx/xx_label_1d__202403.har/dt=2024-03-03/*,broker=TNetworkAddress(hostname:10.xx.yy.11, port:17113),msg=org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): hadoop's password not specified., cause by: hadoop's password not specified.

StarRocks version (Required)

2.5.12

blanklin030 avatar May 08 '24 16:05 blanklin030