How can I load different folders of an Amazon S3 bucket as separate Event Types?

While configuring Amazon S3 as a Source for the Pipeline, the Create Event Types from folders setting controls whether folders from an S3 bucket are loaded as different Event Types or merged into one.

For the folders to be loaded as separate Event Types, the files they contain must be in either CSV or JSON format.

You can enable and disable the Create Event Types from folders option in the Configure your S3 Source page as shown in the image below:

CreateEventTypesFromFolders Option

Let us suppose that you have an S3 bucket, hevo-demo-3, containing the folders, Json, and parent_folder:

S3 Source Folder

  • If the Create Event Types from folders option is enabled, then the two folders are loaded as separate Event Types:

    Folders loaded as Separate EventTypes

  • If the Create Event Types from folders option is disabled, then the two folders are loaded as a single Event Type. The name of the Event Type is the same as the S3 folder name:

    Folders loaded as single EventType


Revision History

Refer to the following table for the list of key updates made to this page:

Date Release Description of Change
Nov-07-2022 NA Created as a new document.
Last updated on 03 Nov 2022

Tell us what went wrong