CODEWITHSUNDEEP
mysqlamazon-web-servicesdatabase-migrationamazon-rdsdms
hpaknia
hpaknia

Reputation: 3118

AWS DMS MySQL Migration is Stuck, "Full load rows" Keeps increasing

I have a fairly small database (2.5 MB dump) to migrate from AWS EC2 instance to Aurora (mariadb 10 to Aurora 5.7) Migration sticks on one of the tables. Even though the table has only ~1300 rows, total number of rows in the tables statistics keeps growing (more than 800 million!) And migration never finishes. But in fact the database is migrated. Just Full Load Rows Keeps increasing and migration never ends.

The problem is blocking us from migrating all the databases at once. In fact with setting 6 concurrent table migrations some of the tables stick and a large replication instance with 30 GB of memory, runs out of it!

I'm doing a Full load migration. In cloudwatch logs I see thousands of:

2019-04-09T18:52:06 https://forums.aws.amazon.com/I: Table 'rls_acronym_test'.'hours_overrides' has 1321 rows. Resume fetch is enabled (mysql_endpoint_unload.c:187)

Upvotes: 1

Views: 1665

Answers (1)

hpaknia
hpaknia

Reputation: 3118

The full LOB mod does not work. Use the Limited LOB mode with a very high value, a value you know your data for a row (or a cell maybe) does not exceed in size.

Upvotes: 0

Related Questions