How can I load different folders of an Amazon S3 bucket as separate Event Types?

While configuring Amazon S3 as a Source for the Pipeline, the Create Event Types from folders setting controls whether folders from an S3 bucket are loaded as different Event Types or merged into one.

For the folders to be loaded as separate Event Types, the files they contain must be in either CSV or JSON format.

You can enable and disable the Create Event Types from folders option in the Configure your S3 Source page as shown in the image below:

Let us suppose that you have an S3 bucket, hevo-demo-3, containing the folders, Json, and parent_folder:

• If the Create Event Types from folders option is enabled, then the two folders are loaded as separate Event Types:

  

• If the Create Event Types from folders option is disabled, then the two folders are loaded as a single Event Type. The name of the Event Type is the same as the S3 folder name:

  

Revision History