Amazon Aurora MySQL

Last updated on Sep 03, 2024

Amazon Aurora is a drop-in replacement for MySQL that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases. Amazon Aurora is fully managed by Amazon Relational Database Service (RDS), which automates time-consuming administration tasks like hardware provisioning, database setup, patching, and backups.

You can ingest data from your Amazon Aurora MySQL database using Hevo Pipelines and replicate it to a Destination of your choice.


Source Considerations

  • MySQL does not generate log entries for cascading deletes. So, Hevo cannot capture these deletes for log-based Pipelines.

Limitations

  • Hevo only fetches tables from the MySQL database. It does not fetch other entities such as functions, stored procedures, views, and triggers.

    To fetch views, you can create individual Pipelines in Custom SQL mode. However, some limitations may arise based on the type of data synchronization, the query mode, or the number of Events. Contact Hevo Support for more details.

  • During the historical load, Hevo reads table definitions directly from the MySQL database schema, whereas for incremental updates, Hevo reads from the BinLog. As a result, certain fields, such as nested JSON, are parsed differently during historical and incremental loads. In the Destination tables, nested JSON fields are parsed as a struct or JSON during historical loads, but as a string during incremental loads. This leads to a data type mismatch between the Source and Destination data, causing Events to be sidelined.

    To ensure JSON fields are parsed correctly during the historical load, you can apply transformations to every table containing nested JSON fields. Contact Hevo Support for more details.


See Also


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Jul-31-2024 NA Updated section, Limitations to add information about Hevo reading table definitions differently during historical and incremental loads.
Apr-29-2024 NA Updated section, Specify Amazon Aurora MySQL Connection Settings to include more detailed steps.
Mar-18-2024 2.21.2 Updated section, Specify Amazon Aurora MySQL Connection Settings to add information about the Load all CA certificates option.
Mar-05-2024 2.21 Added the Data Replication section.
Nov-03-2023 NA Renamed section, Object Settings to Object and Query Mode Settings.
Oct-27-2023 NA Updated section, Create a Database User and Grant Privileges with the latest steps.
Jul-25-2023 NA Updated section, Create a Database User and Grant Privileges for more clarity.
Jun-26-2023 NA Added section, Source Considerations.
Apr-21-2023 NA Updated section, Specify Amazon Aurora MySQL Connection Settings to add a note to inform users that all loaded Events are billable for Custom SQL mode-based Pipelines.
Mar-09-2023 2.09 Updated section, Specify Amazon Aurora MySQL Connection Settings to mention about SEE MORE in the Select an Ingestion Mode section.
Dec-19-2022 2.04 Updated section, Specify Amazon Aurora MySQL Connection Settings to add information that you must specify all fields to create a Pipeline.
Dec-07-2022 2.03 Updated section, Specify Amazon Aurora MySQL Connection Settings to mention about including skipped objects post-Pipeline creation.
Dec-07-2022 2.03 Updated section, Specify Amazon Aurora MySQL Connection Settings to mention about the connectivity checker.
Oct-14-2022 NA - Updated section, Set up MySQL Binary Logs for Replication to add information about steps for setting up the binary logs for replication.
- Removed section, Source Considerations.
Oct-13-2022 1.99 Updated section, Specify Amazon Aurora MySQL Connection Settings to reflect the latest UI changes.
Apr-25-2022 NA - Added section, Source Considerations.
- Added a prerequisite for connecting to a master database if BinLog replication is required.
Apr-21-2022 1.86 Updated section, Specify Amazon Aurora MySQL Connection Settings.
Feb-07-2022 1.81 Updated section, Whitelist Hevo’s IP Address to remove details about Outbound rules as they are not required.
Jan-03-2022 1.79 Updated the description of the Include New Tables in the Pipeline advance setting in the Specify Amazon Aurora MySQL Connection Settings section.
Aug-09-2021 NA Added a note in Step 3 of section, Create a Database User and Grant Privileges section.
Jul-26-2021 1.68 Added a note for the Database Host field.
Jul-12-2021 NA Added section, Specify Amazon Aurora MySQL Connection Settings.

Tell us what went wrong