paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[filesystems] Supported Tencent Cloud COS filesystem

Open chenxi0599 opened this issue 1 year ago • 3 comments

Purpose

Linked issue: close #xxx

Tests

API and Format

Documentation

chenxi0599 avatar Mar 27 '24 04:03 chenxi0599

I have passed the test on my own computer, using Tencent cos to read and write data

chenxi0599 avatar Mar 27 '24 04:03 chenxi0599

Hi @chenxi0599 , can you explain the difference between using s3 interface and using cos interface? Both can support Tencent Cloud COS filesystem.

JingsongLi avatar Mar 27 '24 05:03 JingsongLi

Hi @chenxi0599 , can you explain the difference between using s3 interface and using cos interface? Both can support Tencent Cloud COS filesystem.

I've searched extensively for an answer to this question but haven't found one yet.
I believe it's preferable to use Tencent Cloud COS's native interface whenever possible, as they may have optimized it for their specific platform. I've also compared accessing COS using both the S3 SDK and COS SDK, and it seems like the performance is slightly better with the COS SDK. Additionally, error messages returned by the server are better reflected in the logs when using the COS SDK.

chenxi0599 avatar Mar 27 '24 05:03 chenxi0599

Hi @chenxi0599 , I contacted the engineers of tencent cloud, it looks like it is OK to use S3 SDK to connect tencent COS. We can wait for more information.

JingsongLi avatar Aug 12 '24 00:08 JingsongLi