Stacktape
Stacktape

Log Forwarding



Log forwarding is the process of sending log data from your applications and services to a centralized location or a third-party log management provider. While CloudWatch is the primary log management service in AWS, many users choose to forward logs to third-party providers for advanced features like real-time analysis, machine learning insights, and customizable dashboards, or to meet specific compliance requirements.

Stacktape makes it easy to forward logs to the endpoint of your choice.

  • Log forwarding is done using Amazon Kinesis Data Firehose delivery stream.
  • When using log forwarding, you will incur costs based on the amount of data being transferred to the destination (~$0.03 per transferred GB). Refer to AWS Kinesis Firehose Pricing page to see details.
  • Currently supported destinations for logs:

Refer to our docs for more information.

Logs that fail to be delivered to the destination even after multiple retries (time spend on retries can be configured) are put into bucket with name {stackName}-{resourceName}-logs-{generatedHash}

HTTP endpoint forwarding

You can forward logs to any HTTP endpoint that complies with the Firehose request and response specifications. Many third-party vendors are compliant with these specifications out of the box.

resources:
  myFunction:
    type: function
    properties:
      logging:
        logForwarding:
          type: http-endpoint
          properties:
            endpointUrl: https://my-endpoint.com
      packaging:
        type: stacktape-lambda-buildpack
        properties:
          entryfilePath: lambdas/js-lambda.js
HttpEndpointLogForwarding  API reference
type
Required
properties.endpointUrl
Required
properties.gzipEncodingEnabled
properties.parameters
properties.retryDuration
properties.accessKey

Datadog forwarding

Forwards logs to your Datadog account.

resources:
  myFunction:
    type: function
    properties:
      logging:
        logForwarding:
          type: datadog
          properties:
            apiKey: your_datadog_api_key
      packaging:
        type: stacktape-lambda-buildpack
        properties:
          entryfilePath: lambdas/js-lambda.js
DatadogLogForwarding  API reference
type
Required
properties.apiKey
Required
properties.endpointUrl
Default: https://aws-kinesis-http-intake.logs.datadoghq.com/v1/input

Highlight forwarding

Forwards logs to your Highlight project.

resources:
  myFunction:
    type: function
    properties:
      logging:
        logForwarding:
          type: highlight
          properties:
            projectId: your_highlight_project_id
      packaging:
        type: stacktape-lambda-buildpack
        properties:
          entryfilePath: lambdas/js-lambda.js
HighlightLogForwarding  API reference
type
Required
properties.projectId
Required
properties.endpointUrl
Default: https://pub.highlight.io/v1/logs/firehose

Contents