Cloudwatch logs is an AWS managed service, which helps you to monitor, store and access logs and also run analysis on the logs. You can also use subscriptions to get access to a real-time feed of log events from CloudWatch Logs and have it delivered to other services such as an Amazon Kinesis stream, Amazon Kinesis Data Firehose stream, or AWS Lambda for custom processing, analysis, or loading to other systems of your choice. Read more on cloud watch logs and the features they provide here .
Hevo enables you to push the hevo activity logs corresponding to actions/status-updates/failures happening on hevo pipelines/models/workflows etc to your cloudwatch logs account. The document explains the prerequisites/steps required to integrate hevo with cloudwatch logs
A valid log group needs to be created, where hevo will push the logs. You should also have valid aws credentials(access and secret keys) of an IAM user who has CreateLogStream, DeleteLogStream and PutLogEvents permissions on the log group created.
1. Open Activity Log settings
Go to settings page from hevo dashboard and open Activity log tab.
2. Fill connection details.
Click on enable and fill connection details
- AWS access key
- AWS secret key
- Region: AWS region of the cloud watch logs
- Log Group: Log group where hevo will push the logs
3. Test Connection
Test Connection will let you validate the credentials you have entered.
4. Save credentials
Once test connection is successful, you can go and save the configuration.
Delete/Edit options are also available on the dashboard for you to delete/edit the saved cloudwatch logs settings.