alibabacloud-jindodata icon indicating copy to clipboard operation
alibabacloud-jindodata copied to clipboard

dataload功能失败

Open ruan875417 opened this issue 1 year ago • 2 comments

参考dataload数据预加载功能: https://github.com/aliyun/alibabacloud-jindodata/blob/master/docs/user/6.x/6.2.0/jindo_fluid/jindo_fluid_dataload.md

环境版本: jindufx集群: 6.2.0

镜像版本: smartdata: image: registry.cn-shanghai.aliyuncs.com/jindofs/smartdata:6.2.0 fuse: image: registry.cn-shanghai.aliyuncs.com/jindofs/jindo-fuse:6.2.0 controller: image: fluidcloudnative/jindoruntime-controller:v1.0.1-14eda3b

dataLoad yaml:

apiVersion: data.fluid.io/v1alpha1
kind: DataLoad   
metadata:
   name: rwl-fluid-jindo-dataload-demo1   
spec:   
  loadMetadata: true   
  dataset:   
    name: rwl-fluid-jindo-demo1   
    namespace: default   

pod失败日志 image

  • [[ -z '' ]]
  • enableFilter=false
  • dafault=jindo://
  • paths=/
  • paths=(${paths//:/ })
  • replicas=1
  • replicas=(${replicas//:/ })
  • (( i=0 ))
  • (( i<1 ))
  • local path=/
  • local replica=1
  • echo -e 'distributedLoad on / starts'
  • distributedLoad / 1 jindo://
  • local path=/
  • local replica=1
  • local default=jindo://
  • local 'cmd=jindocache -load'
  • checkPathExistence /
  • local targetPath=/ ++ timeout 30s jindo fs -ls jindo:/// ++ tail -3
  • local 'checkPathResult=E8/26 01:46:58 JcomOptionsImpl.cpp:119 Failed to load configure file /jindosdk.cfg or from base or from default conf dir'
  • local 'strUnexistence=No such file or directory'
  • [[ E8/26 01:46:58 JcomOptionsImpl.cpp:119 Failed to load configure file /jindosdk.cfg or from base or from default conf dir =~ No such file or directory ]]
  • [[ true == \t\r\u\e ]]
  • echo -e '--- enable metaCache'

ruan875417 avatar Aug 26 '24 02:08 ruan875417

完整日志 dataloader.log

ruan875417 avatar Aug 26 '24 07:08 ruan875417

看报错是没有配置cacheset

adrian-wang avatar Nov 19 '24 02:11 adrian-wang