A pipeline in Hevo may run multiple ingestion jobs to fetch data from your source. All these jobs run as per a schedule defined for them and look for new data. The schedule is displayed on the top right corner of the Pipeline below the Pipeline Status badge from where it can be changed at any time. There are two ways in which the schedule may be defined:
- Running on a frequency: You can use this to run the ingestion jobs on a fixed frequency. You can set the ingestion jobs to run every X minutes or every X hours.
- Running at an exact time: This option will allow you to define a specific time for the ingestion jobs to run. You have 2 options in this:
- Daily: This will ensure that ingestion jobs run daily at a specified time.
- Weekly: You can select specific days in the week on which the ingestion jobs would run at a specified time.
Other than the scheduled ingestion runs, the ingestion jobs may be triggered to run explicitly via the Run now option. To run the ingestion jobs for the entire option, click the Run now menu item menu options next to the Pipeline Status badge. To run the ingestion job for a particular table (object), click the Run now menu item from the menu options in the tasks section.
Please note that the frequency of a Pipeline determines the frequency at which data will be ingested from the Source. It may take slightly longer for the data to be visible in your destination.