Amazon Aurora (MySQL)

Amazon Aurora is a drop-in replacement for MySQL that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases. Amazon Aurora is fully managed by Amazon Relational Database Service (RDS), which automates time-consuming administration tasks like hardware provisioning, database setup, patching, and backups.

You can ingest data from your Amazon Aurora MySQL database using Hevo Pipelines and replicate it to a Destination of your choice.

Prerequisites

  • The Amazon Aurora RDS instance (not a localhost) is running, which means a valid DNS Server is available. To check:
    1. Open the Amazon RDS console.
    2. Click Databases in the left navigation pane.
    3. In the right pane, check that the Status field for that instance has the value as Available.
  • The MySQL version is 5.1 or higher. You can choose the MySQL version while creating the instance.

  • Binary Log (BinLog) replication is enabled, if Pipeline mode is BinLog.

  • Hevo’s IP addresses are whitelisted.

Setting up MySQL Binary Logs for Replication

A binary log is a collection of log files that records information about data modifications and data object modifications made on a MySQL server instance. Typically binary logs are used for data replication and data recovery.

Hevo supports data ingestion for replication from MySQL servers via binary logs (BinLog). For this, binary logging must be enabled on your MySQL server.

To enable binary logging for an Aurora DB cluster, follow these steps:

  1. Open the Amazon RDS console.

  2. In the left navigation pane, select Parameter groups.

    Select parameter groups

  3. Select the instance with Type as DB cluster parameter group.

    Note: If you are using the default Aurora DB cluster parameter group, then create a new DB cluster parameter group. Type, choose DB cluster parameter group.

  4. Click Edit Parameters.

    Edit parameters

  5. Search for the parameter Name binlog_format, and activate binary log replication by setting the Values to ROW.

  6. Click Save changes.

    Specify binlog format

This confirms that binary logging is now enabled for your Aurora MySQL instance.

Read BinLog Replication and BinLog Alerts.

The replication reference guide on MySQL’s documentation portal provides a complete reference of the options available for replication and binary logging.

Whitelisting Hevo’s IP Addresses

You need to whitelist the Hevo IP address for your region to enable Hevo to connect to your Amazon Aurora MySQL database. To do this:

  1. Open the Amazon RDS console.

  2. In the left navigation pane, click Databases (or Instances if you’re using an older version)

  3. In the Databases section on the right, click the DB identifier of the Amazon Aurora instance to configure a security group on.

  4. In the Connectivity & security tab, click the link text under Security, VPC security groups.

  5. In the Actions drop-down on the top right, select Edit inbound rules.

  6. In the Edit inbound rules page:

    1. Click Add rule.

    2. Add a new rule either with 0.0.0.0/0 or Hevo’s IP address for your region to give access to the Amazon Aurora MySQL instance.

    3. Click Save rules.

      Add rule to whitelist Hevo

Limitations

None.

Last updated on 21 Oct 2020