clickhouse-backup icon indicating copy to clipboard operation
clickhouse-backup copied to clipboard

Whether Huawei OBS is supported?

Open liubo-it opened this issue 1 year ago • 2 comments
trafficstars

Whether data can be backed up to HuaWei obs? @Slach

liubo-it avatar Aug 16 '24 10:08 liubo-it

directly not

looks like OBS is S3 compatible storage

try

general:
  remote_storage: s3
s3:
   ...  

and report logs here if some issues happens

Slach avatar Aug 16 '24 12:08 Slach

do you success with s3 for Huawei OBS?

Slach avatar Aug 22 '24 09:08 Slach

do you success with s3 for Huawei OBS?

I'm sorry I just saw it.

I tried to use S3 protocol to use Huawei OBS can work.

Thank you for your help.

liubo-it avatar Aug 28 '24 09:08 liubo-it

Could you provide worked config s3 section without sensitive credentials for who next time will search?

Slach avatar Aug 28 '24 09:08 Slach

Could you provide worked config s3 section without sensitive credentials for who next time will search?

ok,Configure as follows

s3:
  access_key: "xxx"
  secret_key: "xxx"
  bucket: "xxx"
  endpoint: "https://xxx.huaweicloud.com"
  region:
  acl: private
  assume_role_arn: ""
  force_path_style: false
  path: "/"
  disable_ssl: false
  compression_level: 1
  compression_format: tar
  sse: ""
  disable_cert_verification: false
  use_custom_storage_class: false
  storage_class: STANDARD
  concurrency: 4
  part_size: 536870912
  max_parts_count: 10000
  allow_multipart_download: true
  debug: false

liubo-it avatar Aug 28 '24 09:08 liubo-it

better remove part_size and use max_parts_count: 4000 it could improve upload/download speed

Slach avatar Aug 28 '24 09:08 Slach

better remove part_size and use max_parts_count: 4000 it could improve upload/download speed

Ok, I'll try

thx

liubo-it avatar Aug 28 '24 12:08 liubo-it