MySQL

Hevo supports the following variations of MySQL as a Source:

Click each variant above to know the prerequisites and pre-configuration setups specific to it. Once you complete the setups, follow the steps mentioned below to configure it as a Source in your Hevo Pipeline and start ingesting data:

Configuring MySQL as a Source in Hevo

Click + CREATE in the Pipeline List View page, select MySQL in the Select Source Type page, and specify the following settings:

1. Pipeline Mode

Select how you want Hevo to read your data from the MySQL Source. This can be BinLog, Custom SQL, or Table.

Read Pipeline Modes.

For Pipeline mode as Table, refer to Object Settings below to configure the objects to be replicated.

2. MySQL Connection Settings

Provide your MySQL database connection details in the Configure Your MySQL Source page:

MySQL settings

  1. Pipeline Name: A unique name for your Pipeline.

  2. Database Host: The MySQL host’s IP address or DNS.

  3. Database Port: The port on which your MySQL server is listening for connections. Default value: 3306.

  4. Database User: The authenticated user that can read the tables in your database.

  5. Database Password: Password for the database user.

  6. Database Name: The database you want to load data from, if the Pipeline mode is Table or Custom SQL.

  7. Connection Settings:

    • Connect through SSH: Enable this option to connect to Hevo using an SSH tunnel, instead of directly connecting your MySQL database host to Hevo. This provides an additional level of security to your database by not exposing your MySQL setup to the public. Read Connecting Through SSH.

      If this option is disabled, you must whitelist Hevo’s IP addresses to allow Hevo to connect to your MySQL host. Refer to the content for your MySQL variant for steps to do this.

    • Use SSL: Enable it to use SSL encrypted connection. To enable this, specify the following:

      • CA File: The file containing the SSL server certificate authority (CA).
      • Client Certificate: The client public key certificate file.
      • Client Key: The client private key file.
  8. Advance Settings: (for Pipelines with BinLog mode)

    • Load All Databases: If this option is enabled, Hevo loads the data from all databases on the selected host. Else, specify a comma-separated list of Database Names you want to load data from.

    • Load Historical Data: If this option is enabled, the entire table data is fetched during the first run of the Pipeline. If disabled, Hevo loads only the data that was written in your database after the time of creation of the Pipeline.

    • Merge Collections: If this option is enabled, Hevo merges tables with the same name from different databases while loading the data to the warehouse. Hevo loads the Database Name field with each record. If disabled, the database name is prefixed to each table name. Read How does the Merge Tables feature work?.

  9. Click TEST & CONTINUE to proceed for setting up the Destination.

Object Settings

Object settings must be configured if the Pipeline mode is Table. To do this:

  • After Step 9 above, in the SELECT OBJECTS YOU WANT TO REPLICATE page, select the objects to be replicated.

    Note: Each object represents a table in your database.

  • In the CONFIGURE SOURCE OBJECTS page, specify the query mode to be used for each selected object.

Last updated on 10 Nov 2020