Skip to content

Conversation

@sureshc
Copy link
Contributor

@sureshc sureshc commented Dec 15, 2025

The user_levels table now takes about 18.5 hours to export from MySQL to Redshift. As a very short term workaround, increase the timeout that our export cronjob waits for the Database Migration Service (DMS) Replication Task to complete to 19 hours.

We were holding off on this until we resolved the issue with History Length increasing on the production Aurora cluster during exports, but that was resolved with #69998

Testing story

Deployment strategy

Follow-up work

  • Switch to streaming data from MySQL to Redshift using Change Data Capture in the DMS once we re-enable binary logging in production
  • Switch to Aurora Redshift Zero-ETL Integration

Privacy

Security

Caching

PR Creation Checklist:

  • Tests provide adequate coverage
  • Privacy impacts have been documented
  • Security impacts have been documented
  • Code is well-commented
  • New features are translatable or updates will not break translations
  • Relevant documentation has been added or updated
  • User impact is well-understood and desirable
  • Follow-up work items (including potential tech debt) are tracked and linked

@sureshc sureshc requested review from a team December 15, 2025 19:56
@sureshc sureshc marked this pull request as ready for review December 15, 2025 19:56
@sureshc sureshc merged commit cde60c1 into staging Dec 16, 2025
6 checks passed
@sureshc sureshc deleted the infrastructure/increase-mysql-to-redshift-export-timeout branch December 16, 2025 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants