Find solution
How to sequence events while uploading large files to Amazon S3?

How can I back up files stored on Amazon S3?

  • I have a web-service wherein users upload files and these are accessible by only them or to users whom they authorize. I need to keep a backup of these files. How can I keep backup of these files in some other Amazon S3 bucket? What other strategy would you suggest to keep backup of S3 file? Please let me know your thoughts.

  • Answer:

    Using AWS Export, as suggests is a good idea. Another alternative would be to backup the data to a bucket in a separate AWS region. In addition, I would configure that bucket to support versioning and MFA delete.  Then you have the security of backups in a completely separate region as well as the security of knowing that, even if someone hacked your AWS credentials, they still couldn't delete files from the backup bucket without the MultiFactor Authentication token.  You can also use the new Virtual MFA (http://aws.typepad.com/aws/2011/11/new-virtual-software-multi-factor-authentication-rfc-6238-support.html) which delivers the authentication tokens to your phone.

Mitch Garnaat at Quora Visit the source

Was this solution helpful to you?

Other answers

You can use Minio Client aka "mc" which provides commands like cp, ls, mirror, share and session management  - https://github.com/minio/mc Read following blog on our rationale behind a new CLI for s3  - https://medium.com/cloud-storage/go-based-alternative-to-amazon-s3-command-line-interface-43ea9fd241fb

Harshavardhana "."

Google makes this extremely easy. Go to Google Cloud Storage and setup a daily transfer from S3. Google will then keep the S3 bucket in sync with the Google Cloud Storage bucket (there are even several replication options - including keeping deleted from s3 files around in the Google Storage bucket). You can even configure the Google Storage bucket as nearline storage, which is very cheap. It works great.

Victor Trac

You could consider creating backups in AWS Glacier. It has much much lower cost than S3 ( check here http://aws.amazon.com/glacier/pricing/ to make your calculations), 99.999999999% durability, and easy to backup your S3 data using AWS Import/Export

Kostas Papageorgiou

I wouldn't back up to another bucket, unless it's in a different region.  I would suggest the following: 1. Use AWS export to get a local copy (on SATA hard drive(s)) of the data 2. Mirror data to another cloud-based storage set of servers (another AWS region, Rackspace CloudFiles, etc).  This will require running a server that does the syncing, and you may have to write custom code here.  (if you stay in AWS, you could use s3sync, but I think you'll have to write to local disk as an intermediate step.

Joe Emison

Related Q & A:

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.