Add Kafka Monitoring Data Collection page#36953
Open
shellymat-dd wants to merge 5 commits into
Open
Conversation
Document the metrics, configurations, and capabilities collected by the Kafka Consumer integration when enable_cluster_monitoring is set, and add a side nav entry under Kafka Monitoring. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Contributor
Preview links (active after the
|
- Move Data Collection above Monitors and Automation in the side nav - Rename page from "Kafka Monitoring Data Collection" to "Data Collection" - Link to Kafka Monitoring Setup from the intro - Link "read live messages on topics" to the Kafka Monitoring overview section about schemas and messages - Tighten section openers and remove repetitive references to the enable_cluster_monitoring flag Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Also widen the first column to match the metrics table above. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
After review, replace the inline metrics tables with a pointer to the Kafka Consumer integration's metric list, where Data Streams Monitoring metrics are marked DSM only. Tighten the intro and Configurations section accordingly. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Contributor
There was a problem hiding this comment.
Pull request overview
Adds a new “Data Collection” documentation page under Data Streams Monitoring → Kafka to describe what additional data is collected (and what capabilities are enabled) when enable_cluster_monitoring: true is configured for Kafka Monitoring.
Changes:
- Added a new Kafka Monitoring “Data Collection” page describing metrics/configurations/schemas and message inspection capability.
- Updated the main English navigation menu to include the new page and adjusted existing item weights.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
| content/en/data_streams/kafka/data_collection.md | New Data Collection page for Kafka Monitoring cluster monitoring. |
| config/_default/menus/main.en.yaml | Adds the new page to the Kafka Monitoring left nav and reorders weights accordingly. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
+6
to
+10
| Data Streams Monitoring's [Kafka Monitoring][6] uses the [Kafka Consumer integration][1] to collect cluster health data. On top of the integration's defaults, it collects additional data and adds ability to perform actions described in this doc. | ||
|
|
||
| ## Metrics | ||
|
|
||
| To collect the **DSM only** [Kafka Consumer integration metrics][5], set `enable_cluster_monitoring: true`. See [Kafka Monitoring Setup][4] for how to configure the check. |
piochelepiotr
approved these changes
May 22, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do? What is the motivation?
Adds a new Data Collection page under Data Streams Monitoring's Kafka Monitoring. The page documents the metrics, broker/topic configurations, and capabilities the Kafka Consumer integration collects when
enable_cluster_monitoring: trueis set.Merge instructions
Merge readiness:
Additional notes