How to sequence events while uploading large files to Amazon S3?

Giant uploads - how, who, what, where?

  • How can I upload large amounts of data, like 5 to 50 GB worth of files to a specific server, such as YouTube or my own FTP server? I only have 3 Mbps ADSL and it takes a day to upload just a few GB. I don't know anyone with fiber, nor would I want to accidentally cap their account. I had been wanting to upload my own files for a small business... however lately I've been digitizing old videos from the 1980s-1990s (which are historically noteworthy) for a client and he may want to post them on YouTube. The problem is there are about 100 files at 2 hours (2 GB) a piece, so uploading to YouTube is just not viable. Are there services that receive a flash drive or USB hard drive and either perform the upload or connect to a machine and allow me to SSH or VPN in to do transfers? Seems this would be a good side-benefit for a web hosting service, but I've never heard of one that will receive drives and connect them to a machine at an affordable price. I also looked at Amazon S3 and apparently they don't receive or load media either. In the past I used Rentacoder to do little jobs like this, but that site was gutted by new owners a few years ago.

  • Answer:

    My internet bandwidth is unlimited between midnight and 8 AM, and you might know someone with a similar account in your area. That way, you can queue uploads to happen when bandwidth is not capped. If you want to transfer files from an FTP to YouTube, http://stackoverflow.com/questions/14406836/auto-upload-videos-to-youtube-from-ftp-server, though nothing as easy as uploading straight to YouTube or via http://www.dvdvideosoft.com/products/dvd/Free-YouTube-Uploader.htm, but at least you have an option.

crapmatic at Ask.Metafilter.Com Visit the source

Was this solution helpful to you?

Other answers

Yeah, we've done something like this with Rackspace as well, I remember having to pay for it, seems their current pricing is https://www.rackspace.com/apps/support/node/1196

Oktober

When you say that you used to use Rentacoder, did you mail them the physical files? If mailing is still an option, you can probably post this to Metafilter Jobs and find someone who would do it for you.

CathyG

When I used Rentacoder I put out a job to upload, say, a 10 GB file, and people would bid on it. These were small $20-30 jobs. Rentacoder kept the money in escrow, so it wasn't like trying to get help on Craigslist.

crapmatic

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.