How can I get objects in a S3 bucket?

Is there an upper limit of requests per second on objects stored in Amazon's S3?

  • Both for post and get. Also provided that there is no CloudFront and objects are requested by url.

  • Answer:

    i'm using now S3 for several years and i never hit this quota. looking at the documentation i found the following [1]: As with any distributed system, S3 has protection mechanisms which detect intentional or unintentional resource over-consumption and react accordingly. SlowDown errors can occur when a high request rate triggers one of these mechanisms. Reducing your request rate will decrease or eliminate errors of this type. Generally speaking, most users will not experience these errors regularly; however, if you would like more information or are experiencing high or unexpected SlowDown errors, please post to our Amazon S3 developer forum http://developer.amazonwebservices.com/connect/forum.jspa?forumID=24 or sign up for AWS Premium Support http://aws.amazon.com/premiumsupport/. if you dig in the forums [2] you find some more additional information: 'High request rate' will vary, but it is orders of magnitude higher than 1 rps. (The 1rps is for the Amazon Associates web service.)  Amazon S3 will return this error when the request rate is high enough that servicing the requests would cause degraded service for other customers.  This error is very rarely triggered.  If you do receive it, you should exponentially back off.  If this error occurs, system resources will be reactively rebalanced/allocated to better support a higher request rate.  As a result, the time period during which this error would be thrown should be relatively short. The threshold where this error is trigged varies and will depend, in part, on the request type and pattern.  In general, you'll be able to achieve higher rps with gets vs. puts and with lots of gets for a small number of keys vs. lots of gets for a large number of keys.  When geting or puting a large number of keys you'll be able to achieve higher rps if the keys are in alphanumeric order vs. random/hashed order. [1] http://docs.amazonwebservices.com/AmazonS3/latest/dev/index.html?ErrorBestPractices.html [2] https://forums.aws.amazon.com/thread.jspa?messageID=89752&#89752

Jodok Batlogg at Quora Visit the source

Was this solution helpful to you?

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.