public-cloud-roadmap
public-cloud-roadmap copied to clipboard
ovh
Object Storage - High Performance
As a user, I want Object Storage coming through and with a wide coverage of S3 standard APIs, with low lantency/lot of IOps.
API call included Incoming traffic included Outgoing traffic toward OVHcloud Services included Billed per GB per month/per GB of outgoing traffic (going out of OVHcloud)
ETA SBG : 21/02 ETA GRA : April 2022
Hi @JacquesMrz @mhurtrel,
I know it's a difficult question but do you have any approximate ETA regarding this feature ? We use a lot of swift (via S3 API) containers to store our images, leading to a lot of "live" calls and current performances are too unstable for us to keep using OVH's Object Storage services for such a load (and yes, we already discussed this numerous times with the support, without leading to any solution).
Maybe an early access/beta version available soon so that we can validate and do the switch as soon as the product goes GA ?
Any news on that topic? It make now a while that we expect a solution, and nothing seems to be announced ...
Any news here ? The current service offer (both via Swift or S3) is more and more becoming unusable for live workload... This is becoming nothing more than a place for backups...
At this point, without clear vision, we'll have to consider an external service... which is really against what we try to build with OVH.
Ping @JacquesMrz @mhurtrel
Yes I noticed some spikes to 20-40 seconds under load for even small objects...
(Pure object storage read workload)
Yes exact same pattern for us (storing media images for tens of thousands of movies) - each of those spikes generates impacts on our QoS / QoEx
Agreed, Object Storage performance is really poor with OVH in my experience too. As a test (since I hadn't used many Object Storage services prior) I moved to using Vultr's Object Storage and received three to four times the performance that I ever got with OVH Object Storage, but their Object Storage is only in one region which is a huge limitation when it comes to data sovereignty. This leads me to really desire OVH to improve the performance of Object Storage because right now it's too slow and too unreliable - but thankfully it has the advantage of existing in all regions which I really need in my use-case to keep the data in Canada for example. I hope OVH improves the performance of Object Storage significantly soon.
Hi all, Our High Performance Object Storage service is officially in BETA ! All the information you want to know about this BETA and how to get access to it, available here https://labs.ovh.com/high-perf-object-storage .
Hello, quick question !
In the new price list, it is stated that Outgoing Internal traffic is Included. How is something "Internal" or "External" defined ? Is Internal traffic just data that transits inside OVH Network ? Does traffic from High Perf Object Storage to So You Start servers count as internal or external traffic ? So you start servers are technically internal to OVH Network, but external to OVH right ?
Thanks a lot !
Hello, quick question !
In the new price list, it is stated that Outgoing Internal traffic is Included. How is something "Internal" or "External" defined ? Is Internal traffic just data that transits inside OVH Network ? Does traffic from High Perf Object Storage to So You Start servers count as internal or external traffic ? So you start servers are technically internal to OVH Network, but external to OVH right ?
Thanks a lot !
hello Right. Internal outgoing traffic is from OVHcloud object storage to a OVHcloud servers (VPS, instance, VMS hosted on bare metal, Soyoustarts servers...)
Does someone in BETA has the way to perform a s3benchmark on this new version?
Here are the tests on:
- AWS S3 (FRA): https://pastebin.com/iABh4mbw
- SCALEWAY (PAR, recent Multi-AZ offer): https://pastebin.com/zfBBqCvq
The delta between AWS and Scaleway is just 🤯 specially on PUT requests. I really hope that OVH will get numbers very close to AWS...
Hello,
I did some testing this morning on the SBG region, and I am bit confused regarding the Bucket access policy.
From my understanding from here: https://docs.ovh.com/fr/storage/s3/debuter-avec-s3/
- I can add a bucket via S3 cli (done) or via UI (also tried)
- Then via the UI or via OVH API I need to link a user.
However, I do not see any process to see/alter who has access to the bucket.
- Via CLI I get this (An error occurred (NotImplemented) when calling the GetBucketPolicy operation: The requested resource is not implemented).
- The UI don't show up any options
- There is no API Call for it.
I know that for the swift container (or the S3 layer on top of it) this was the same via API and UI. However, the swift cli allowed us to alter the permission with commands similar to this ones:
- See the bucket policies/info
swift stat my-bucket - Alter the policies
swift post my-bucket -w read-policy-name -r write-policy-name
Am I missing something or is this not supported or an oversight for the High perf S3.
Hello @Lebvanih, have you found a solution for this ? I am currently facing the same problem, personnaly, the error I am facing is
botocore.exceptions.ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden
used with Django-Rest-Framework (Django-> Python) and its remote storage library: django-storages with aws S3 api
@cambierr Object Storage S3 High Performance is planned is BHS soon (August 22)
Great! Thanks !
Sent from a typical smartphone. If this is illiterate, it’s the voice recognition’s fault.
From: CharlotteLetamendia @.> Sent: Thursday, July 14, 2022 7:06:30 PM To: ovh/public-cloud-roadmap @.> Cc: Romain Cambier @.>; Mention @.> Subject: Re: [ovh/public-cloud-roadmap] Object Storage - High Performance (#38)
@cambierrhttps://github.com/cambierr Object Storage S3 High Performance is planned is BHS soon (August 22)
— Reply to this email directly, view it on GitHubhttps://github.com/ovh/public-cloud-roadmap/issues/38#issuecomment-1184682446, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACTBVY4ADLJLFDDSAEVV423VUBCJNANCNFSM4TYNHN4Q. You are receiving this because you were mentioned.Message ID: @.***>
Object Storage High Performance -S3 API is not planned this year in LIM . It is available in SBG/GRA/BHS Object Storage Standard - S3 API is available in GRA, soon in RBX, than SBG/BHS, and LIM/ERI/WAW (Jan/ February)
@Izaia64 I see that there's no "Outgoing Internal traffic" pricing for Object Storage (Swift) in BHS — does that mean I'll be charged for outgoing traffic to a VPS in BHS even though it's internal to the data centre? I was told by a sales contact that that wouldn't be the case.
you can totally access any of your existing swift buckets through the S3 protocol with some limitations such as for multipart transfers, lifecycle managmeent, etc.
We've been doing it for years and it worked well enough to run many of our production platforms ;-)
@cambierr Thanks for the info — I appreciate it. 🙂
Do you happen to know: OVH claims that "outgoing internal traffic" from object storage is free:
However my tests show me being billed for traffic from object storage to an OVH VPS. Do you have any experience with this? I can't seem to get any answers from anyone there about this.