How hard is it to migrate from a EC2/EBS DB setup to one using RDS?
-
This is a follow-up question to .
-
Answer:
Airbnb migrated from a MySQL server on EC2 to an RDS instance back in November 2010. We did a writeup of our reasoning and migration process on our engineering blog: http://nerds.airbnb.com/mysql-in-the-cloud-at-airbnb The other answers do a good job explaining the advantages and disadvantages of managing your own MySQL instance vs. using RDS, but there's not much talk about the actual migration process. Here's one excerpt from our post that is probably useful in that regard: Everything is straightforward if you are setting up a site for the first time, but what if you have an existing database with gigabytes of data that you want to migrate to RDS? This is where the fun begins. At the time we did the migration, we already had gigabytes of data and some tables with millions of records. RDS instances only expose MySQL and don't give you direct access to the machine via SSH or other tools, so unfortunately there is no way to do this on the file system level. The only practical way to move your data over is to do a mysqldump on the source machine, followed by a mysqlimport in RDS. This can take a significant amount of time if you have a lot of data, and unless you want to spend days or weeks figuring out a complex migration strategy, the only option is to take down the site during the process. We wanted to keep the downtime as low as possible, so we looked for simple ways to transfer a significant amount of our data while the site was still running. We came up with the idea to copy the data in tables that never receive UPDATEs or DELETEs, so we would only have to copy the diff later on. Once those tables were carefully selected, the procedure was pretty straightforward. The actual script that we used to do our migration is available at https://gist.github.com/671874 This approach allowed us to perform the whole migration with only 15 minutes of downtime.
Christopher Lin at Quora Visit the source
Other answers
RDS is not OLTP ready unless you plan on having a Multi-AZ deployment. The primary reason I can never recommend the MySQL RDS deployment to customers is recoverability. AWS RDS states that you may lose up to 5 minutes of data. Can you afford that? In addition, there is no SLA on how long recovery will take. This is one of the most frustrating times when your site is down. You have lost complete control about how long it will be. I have a more detailed description as a draft blog post I will be publishing soon.
Ronald Bradford
For RDS you only have the last option, which takes a little bit more time. Be sure to first get your sql dumps close to your RDS instance, on an EC2 instance in the same region. WE encountered several things that pose problems on RDS, that can go unnoticed on a 'regular' MySQL install. All of these have to do with use of the disk. For example, views, are very bad performers on RDS. And queries that don't have proper indexes behave very badly. Both of these examples are always insufficient, but on RDS they are not hidden anymore.
Jurg van Vliet
mysqldump is your friend. Here is one example: http://developmentables.com/post/499001044/migrating-inventables-to-amazon-rds
Deepak Singh
Also there are some parameters that you cannot change on RDS. I don't have a list but we came across an issue with the case sensitive parameters. Creating certain objects such as Triggers require you to switch off binary logging by setting the backup retention period to 0 - the error msg isn't helpful as it refers to permissions. We have migrated several productions instances of 4 or 5 different database schemas over to RDS with no major issue - but from MySQL running on our own kit.
Janaka Abeywardhana
Although little old question but I think this link will make sense for many like me who are visiting this site. http://www.scalebase.com/checklist-migrate-premises-mysql-aws-rds/ A very nice article which depicts approach for RDS migration..
Taral Shah
Related Q & A:
- How hard is it to find a tenured position?Best solution by Academia
- How to Login to Stackoverflow in Chrome with a different Google ID than the one I'm using for Chrome?Best solution by Meta Stack Overflow
- How can I migrate to a new Yahoo user ID?Best solution by in.answers.yahoo.com
- How hard is it to find a job with a marketing degree?Best solution by Yahoo! Answers
- How hard is it making a career out of sports betting?do a lot of people manage okay and make a decent salary?Best solution by Yahoo! Answers
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.