feat: reference the synthetic-monitoring-checks agent skill in check authoring surfaces - #1786
Open
markjmeier wants to merge 3 commits into
Open
feat: reference the synthetic-monitoring-checks agent skill in check authoring surfaces#1786markjmeier wants to merge 3 commits into
markjmeier wants to merge 3 commits into
Conversation
…ing surfaces Surfaces the grafana/skills synthetic-monitoring-checks Agent Skill where users author checks: the scripted and browser docs side-panels (full block), and the choose-check-type page and Terraform config tab (collapsible). Adds agent_skill tracking events (viewed on render/expand, link clicked, install command copied), a return-visit feedback ask gated on a prior install-command copy, and hidden Assistant context so Grafana Assistant can recommend the skill to users authoring with AI coding agents. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… framing Reworks the choose-check-type placement into a tool picker (Claude Code / other agents) with install steps and copyable example prompts (from your site / from an API spec), replicates the prompts in the check form docs side-panels, and reframes the Terraform tab copy and prompt around adopting existing checks as code. Adds tool_selected and prompt_copied tracking events, fixes stale copied-state when switching prompts/tools, and standardises copy on 'coding agent' terminology. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Contributor
Author
|
bugbot run |
Script size changes
Totals
|
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit acb459d. Configure here.
Snapshot the install-copied flag at mount so copying an install command does not trigger the 'Did the skill help?' ask in the same session, before the skill has actually been tried. Addresses Cursor Bugbot review on #1786. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Problem
Authoring synthetic monitoring checks — especially k6 scripted and browser checks — has a steep learning curve. Users starting from the blank script editor have to learn SM's execution model, assertion semantics (a bare
check()never failsprobe_success), locator strategies, and deployment options on their own. Meanwhile, a battle-tested Agent Skill (synthetic-monitoring-checksin the public grafana/skills repo) teaches coding agents like Claude Code, Cursor, and Codex to do exactly this — choose the simplest sufficient check type, author and locally validate correct scripts, and deploy via UI, API, or Terraform — but nothing in the app tells users it exists.Solution
References the skill at the moments users need it, framed for each surface:
terraform plan.Measurement
New
agent_skilltracking events (auto-mirrored to Faro, tagged withorg_id/stack_id):section_viewed(on render in docs panels; on first reveal elsewhere, so it measures intent rather than traffic),tool_selected,install_command_copied,prompt_copied(with prompt variant), andlink_clicked— all carrying a per-surfacesourceproperty. Copying an install command sets a local marker; on return visits the existingFeedbackwidget asks "Did the skill help?" to capture qualitative signal from users who actually tried it. Effectiveness funnel:install_command_copied→ scripted/browsercheck_createdon the same stack.The feature ships ungated to measure effectiveness immediately.
🤖 Generated with Claude Code