Tracking issue of services support

[Xuanwo]

This tracking issue intends to track the implementations of different underlying storage schemes. Please feel free to take any of them.

Need Tests

This section is used to track services that are waiting for passing integration tests.

• [ ] onedrive
• [ ] vercel_artifacts
• [ ] upyun
• [ ] chainsafe
• [ ] foundationdb
• [ ] atomicserver
• [ ] ipfs
• [ ] ipmfs
• [ ] pcloud

Need Implementation

This section is used to track services that are working on their first release.

• [ ] #377
• [ ] #408
• [ ] https://github.com/apache/incubator-opendal/issues/2639
• [ ] https://github.com/apache/incubator-opendal/issues/2640
• [ ] #2641
• [ ] https://github.com/apache/incubator-opendal/issues/3143
• [ ] https://github.com/apache/incubator-opendal/issues/2753
• [ ] #3859
• [ ] https://github.com/apache/incubator-opendal/issues/2627
• [ ] Box

No Started Yet

This section is used to track services that no developers interested in. Please feel free to take one of them.

• [ ] Skynet
• [ ] Fichier
• [ ] Akamai Netstorage
• [ ] Citrix ShareFile
• [ ] Scaleway Glacier
• [ ] Digi Storage
• [ ] Dreamhost
• [ ] Enterprise File Fabric
• [ ] Hetzner Storage Box
• [ ] HiDrive
• [ ] Hubic
• [ ] Jottacloud
• [ ] IDrive e2
• [ ] Mail.ru Cloud
• [ ] OVH
• [ ] premiumize.me
• [ ] put.io
• [ ] Rackspace Cloud Files
• [ ] Seagate Lyve Cloud
• [ ] StackPath
• [ ] Uptobox
• [ ] Zoho WorkDrive
• [ ] #4035
• [ ] https://github.com/apache/incubator-opendal/issues/2708
• [x] #3415

Notes

• ssh removed: https://github.com/apache/incubator-opendal/issues/2643
• China Mobile Ecloud Elastic Object Storage (EOS) removed: No native API (only S3).
• github removed: no use cases.
• gitlab removed: no use cases.
• rsync.net removed: no usable API, requires ssh

[teckick]

Hi! I want to implement the Huawei Object Storage Service backend. Please assign to me. ^_^

[Xuanwo]

Hi! I want to implement the Huawei Object Storage Service backend. Please assign to me. ^_^

Thanks for taking part!

I have created an issue for you: https://github.com/datafuselabs/opendal/issues/512

[theshashankpal]

Hi @Xuanwo , This issue seems to be a good initiation of my journey towards contribution to FOSS projects. Can you please assign this to me?

[Xuanwo]

This issue seems to be a good initiation of my journey towards contribution to FOSS projects.

Thanks for your interest! Which service do you want to work on? I can create a sub-issue and assign it to you.

[theshashankpal]

Hi @Xuanwo , thanks for the reply. I would love to work on Google Drive Storage Service

[Xuanwo]

I would love to work on Google Drive Storage Service

I have created a sub-issue of google drive support at https://github.com/datafuselabs/opendal/issues/654

[damooo]

Next Cloud support in some random future may be worthwhile.

[Xuanwo]

Next Cloud support in some random future may be worthwhile.

Thanks for suggestion, added!

[piaoger]

indexeddb support can be interesting.

[imWildCat]

@Xuanwo do you want to create issues to track dropbox and OneDrive? I can take one or two.

[Xuanwo]

@Xuanwo do you want to create issues to track dropbox and OneDrive? I can take one or two.

Thanks for your interest! https://github.com/datafuselabs/opendal/issues/1098 and https://github.com/datafuselabs/opendal/issues/1099 has been created.

[teckick]

To support https://github.com/datafuselabs/databend/issues/7974, we need delta backend first.

[Xuanwo]

To support datafuselabs/databend#7974, we need delta backend first.

delta is not a storage backend. Instead, we need to port delta to opendal based.

For example:

/// An S3 implementation of the [ObjectStore] trait
///
/// The backend can optionally use [dynamodb_lock] to better support concurrent writers.
pub struct S3StorageBackend {
    inner: Arc<DynObjectStore>,
    s3_lock_client: Option<S3LockClient>,
    /// Whether allowed to performance rename_if_not_exist as rename
    allow_unsafe_rename: bool,
}

Implement this client with opendal.

[knight42]

Is it reasonable to add etcd to the list? given that etcd is also widely used nowadays.

[Xuanwo]

Is it reasonable to add etcd to the list? given that etcd is also widely used nowadays.

Added.

[Gnosnay]

Do we have any plan to support zookeeper? thx

[Xuanwo]

Do we have any plan to support zookeeper? thx

As of now, there is no existing plan. Would you be interested in utilizing opendal for accessing data stored in zookeeper? Could you provide further information regarding your specific use case?

[Gnosnay]

Do we have any plan to support zookeeper? thx

As of now, there is no existing plan. Would you be interested in utilizing opendal for accessing data stored in zookeeper? Could you provide further information regarding your specific use case?

sorry i dont have actual use case, it is just one idea. (´ཀ`」 ∠)

feel free to close this comment if no plan to do so. thank you for your reply.

[Xuanwo]

sorry i dont have actual use case, it is just one idea. (´ཀ`」 ∠)

Haha, got it. I will add it into the list.

[mcronce]

Is this an appropriate place to request a new storage service be added? If so, I'd like to add Ceph RADOS to the list. If not, apologies!

[Xuanwo]

If so, I'd like to add Ceph RADOS to the list

Thanks for the advice, already added!

[gouwazi]

Hi, can I try opendrive? @Xuanwo

[Xuanwo]

Hi, can I try opendrive? @Xuanwo

Sorry for missing this message. I have created a new issue for you: https://github.com/apache/incubator-opendal/issues/3143

Have fun!

[hoslo]

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

[Xuanwo]

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

This is cool! However, remember that OpenDAL requires its own HttpClient for all HTTP-based services and don't allow third-party crates like alluxio-rs. Are you still interested in implementing it in OpenDAL?

[hoslo]

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

This is cool! However, remember that OpenDAL requires its own HttpClient for all HTTP-based services and don't allow third-party crates like alluxio-rs. Are you still interested in implementing it in OpenDAL?

I think i can

[Xuanwo]

I think i can

Created a new issue at https://github.com/apache/incubator-opendal/issues/3548

[hoslo]

request assign Backblaze B2 support

[Xuanwo]

request assign Backblaze B2 support

Thanks a lot! I have created https://github.com/apache/incubator-opendal/issues/3585, please take a look.

[hoslo]

request assign seafile web api support