Pausing a Log-based Pipeline

Each log has a retention period associated with it which specifies the duration a log is maintained before it is automatically deleted. Logs are purged periodically to prevent them from taking up too much disk space.

Consequences of Pausing a Log-based Pipeline

Pausing a Pipeline pauses the process of ingestion. Pausing a log-based Pipeline for long durations may lead to data loss as a result of the log being deleted due to expiry of its retention period. Therefore, such an action can potentially lead to loss of data as a result of ingestion being halted.

Note: The same applies to individual jobs configured with change tracking in the case of a SQL server Source.

See Also

Last updated on 29 Dec 2020