Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion config/_default/menus/main.en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5128,11 +5128,16 @@ menu:
identifier: data_streams_kafka_setup
parent: data_streams_kafka
weight: 1
- name: Data Collection
url: data_streams/kafka/data_collection
identifier: data_streams_kafka_data_collection
parent: data_streams_kafka
weight: 2
- name: Monitors and Automation
url: data_streams/kafka/monitors_and_automation
identifier: data_streams_kafka_monitors_and_automation
parent: data_streams_kafka
weight: 2
weight: 3
- name: Schema Tracking
url: data_streams/schema_tracking
identifier: data_streams_schema_tracking
Expand Down
27 changes: 27 additions & 0 deletions content/en/data_streams/kafka/data_collection.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
---
title: Data Collection
description: Metrics, configurations, and capabilities collected by Data Streams Monitoring's Kafka Monitoring when cluster monitoring is enabled.
---

Data Streams Monitoring's [Kafka Monitoring][6] uses the [Kafka Consumer integration][1] to collect cluster health data. On top of the integration's defaults, it collects additional data and adds ability to perform actions described in this doc.

## Metrics

To collect the **DSM only** [Kafka Consumer integration metrics][5], set `enable_cluster_monitoring: true`. See [Kafka Monitoring Setup][4] for how to configure the check.
Comment on lines +6 to +10

## Configurations and schemas

- Broker configurations
- Topic configurations
- Schemas from a schema registry

## Capabilities

Enabling cluster monitoring unlocks the ability to [read live messages on topics][3] on demand. See [Enable message inspection][2] for the additional setup steps.

[1]: /integrations/kafka-consumer/?tab=containerized
[2]: /data_streams/kafka/setup/#enable-message-inspection
[3]: /data_streams/kafka/#inspect-topic-schemas-and-messages
[4]: /data_streams/kafka/setup/
[5]: /integrations/kafka-consumer/?tab=containerized#metrics
[6]: /data_streams/kafka/
Loading