Skip to main content

Metrics in Datadog

Application metrics can be sent to Datadog, a third-party observability service for cloud-scale applications.

Prerequisites

  1. An existing Datadog account. If you don't have one, you can sign up for a new Datadog account.
  2. A valid Datadog Organization API key generated in your Datadog organization settings.

Getting started

You will need to have the Owner role to access the necessary platform settings.

  1. Log in to your Conduit Platform dashboard. e.g. https://company.na1.meroxa.net
  2. Click the user menu indicated by the user icon at the top right hand corner of your dashboard.
  3. Click Platform settings in the user menu.
  4. Click the Monitoring tab.
  5. Click the Configure button next to Datadog.
  6. Provide the Datadog Site and API Key in the corresponding configuration fields.
  7. Click the Save configuration button.

The platform will automatically validate your Datadog API key for you.

Datadog Sites

A Datadog site identifies which site your Datadog instance is accessed by. Here is a corresponding list of Datadog sites:

SiteSite URLSite ParameterLocation
US1https://app.datadoghq.comdatadoghq.comUS
US3https://us3.datadoghq.comus3.datadoghq.comUS
US5https://us5.datadoghq.comus5.datadoghq.comUS
EU1https://app.datadoghq.eudatadoghq.euEU (Germany)
US1-FEDhttps://app.ddog-gov.comddog-gov.comUS
AP1https://ap1.datadoghq.comap1.datadoghq.comJapan

Refer to the Datadog documentation on accessing Datadog sites.

Application metrics in Datadog

To view your application metrics in Datadog, use the Metrics Explorer or include them in a Datadog dashboard. Filter your metrics by service:meroxa to search for the following supported metrics:

MetricDescriptionType
conduit_pipelinesNumber of pipelines by status.Gauge
conduit_connectorsNumber of connectors by type.Gauge
conduit_processorsNumber of processors by name and type.Gauge
conduit_connector_bytesNumber of bytes a connector processed by pipeline name, plugin, and type.Histogram
conduit_pipeline_execution_duration_secondsAmount of time records spent in a pipeline.Histogram
conduit_connector_execution_duration_secondsAmount of time spent reading or writing records per pipeline, plugin and connector type.Histogram
conduit_processor_execution_duration_secondsAmount of time spent on processing records per pipeline and processor.Histogram

Note: Type above refers to source or destination.

Metrics Explorer in Datadog

Need other metrics?

Need a metric that isn't available? Let us know. Contact us by email via [email protected] or join our Discord Community.