dolphinscheduler
dolphinscheduler copied to clipboard
[Feature][resource center] Can the resource center support Tencent Cloud COS
Search before asking
- [X] I had searched in the issues and found no similar feature requirement.
Description
I am currently using HDFS in the resource center and I want to migrate to Tencent Cloud COS uniformly. What changes do I need to make? Tencent Cloud's bucket is public read
Use case
After switching to Tencent Cloud COS, you can perform upload, download, and preview operations in the resource center
Related issues
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Currently there are no plans to support it.
Can I connect to Tencent Cloud COS through the dependency of S3Utils and AWS Java SDK S3
You can try it, but cos doesn't work well with S3.
The above picture shows our program configuration, and when downloading from the resource center, the following error occurred。
It is obvious that AWS Java SDK S3 is designed for Amazon S3 cloud services, not the S3 protocol
The optional regions are shown in the above figure
@SbloodyS
for me ,it work
Hi, I am currently working on this feature (#16396) to support Tencent Cloud COS as a storage plugin in DS.
Could you please assign this issue to me?
This work is due by September 30, 2024.
Hi, I am currently working on this feature (#16396) to support Tencent Cloud COS as a storage plugin in DS.
Could you please assign this issue to me?
This work is due by September 30, 2024.
done