Log Forwarding
Log forwarding is the process of sending log data from your applications and services to a centralized location or a third-party log management provider. While CloudWatch is the primary log management service in AWS, many users choose to forward logs to third-party providers for advanced features like real-time analysis, machine learning insights, and customizable dashboards, or to meet specific compliance requirements.
Stacktape makes it easy to forward logs to the endpoint of your choice.
Forwards logs to a specified destination for monitoring, analysis, or long-term storage.
Log forwarding is handled by an Amazon Kinesis Data Firehose delivery stream. You will incur costs based on the volume of data transferred (approximately $0.03 per GB). For detailed pricing, see the AWS Kinesis Firehose Pricing page.
Supported destinations:
http-endpoint: Delivers logs to any HTTP endpoint that complies with Firehose request and response specifications. Many third-party logging services are compatible out-of-the-box.datadog: Delivers logs to Datadog.highlight: Delivers logs to a Highlight.io project.
For more information, refer to the Stacktape documentation on log forwarding.
If logs fail to be delivered after multiple retries, they are stored in a backup S3 bucket named {stackName}-{resourceName}-logs-{generatedHash}. The retry duration can be configured.
HTTP endpoint forwarding
You can forward logs to any HTTP endpoint that complies with the Firehose request and response specifications. Many third-party vendors are compliant with these specifications out of the box.
resources:myFunction:type: functionproperties:logging:logForwarding:type: http-endpointproperties:endpointUrl: https://my-endpoint.compackaging:type: stacktape-lambda-buildpackproperties:entryfilePath: lambdas/js-lambda.js
Datadog forwarding
Forwards logs to your Datadog account.
resources:myFunction:type: functionproperties:logging:logForwarding:type: datadogproperties:apiKey: your_datadog_api_keypackaging:type: stacktape-lambda-buildpackproperties:entryfilePath: lambdas/js-lambda.js
Highlight forwarding
Forwards logs to your Highlight project.
resources:myFunction:type: functionproperties:logging:logForwarding:type: highlightproperties:projectId: your_highlight_project_idpackaging:type: stacktape-lambda-buildpackproperties:entryfilePath: lambdas/js-lambda.js