Skip to content

refactor: replace Reliability Inbox ratings with evidence - #1810

Draft
oleiade wants to merge 3 commits into
agent/reliability-inbox-evidence-prototypefrom
codex/reliability-inbox-evidence-labels
Draft

refactor: replace Reliability Inbox ratings with evidence#1810
oleiade wants to merge 3 commits into
agent/reliability-inbox-evidence-prototypefrom
codex/reliability-inbox-evidence-labels

Conversation

@oleiade

@oleiade oleiade commented Aug 14, 2026

Copy link
Copy Markdown

Summary

  • removes the High value, High confidence, numbered priority, and Ready to review labels
  • presents one review-order cue alongside the observable coverage and traffic evidence
  • treats confidence as an eligibility gate for missing coverage and orders eligible recommendations by technical relevance
  • removes generated business-value rationale because the product only has technical signals
CleanShot 2026-08-14 at 16 59 39

Why

Every item in the Reliability Inbox is intended to be actionable, while the system cannot determine business criticality. Ratings therefore duplicated the queue ordering and asked users to trust unsupported judgments. This change shows what was observed and what coverage matching found instead.

User impact

Users see a simpler review queue with “Recommended next,” “No matching check found,” and recent traffic evidence. The detail view explains that no matching Synthetic Monitoring check was found and keeps the existing “How we checked” limitations. Suggestions without high confidence in missing coverage are not surfaced.

Validation

  • yarn test src/features/reliabilityInbox/ReliabilityInboxPage.test.tsx src/features/reliabilityInbox/model.test.ts src/features/reliabilityInbox/ReliabilityInboxBanner.test.tsx --runInBand
  • yarn typecheck
  • yarn lint (passes with 13 pre-existing no-console warnings)
  • yarn build

Stacked on #1773.

@github-actions github-actions Bot added the refactor Refactoring the code in the application. label Aug 14, 2026
@oleiade
oleiade force-pushed the codex/reliability-inbox-evidence-labels branch from 2761b4b to 6790da6 Compare August 14, 2026 13:43
@oleiade oleiade self-assigned this Aug 14, 2026
@oleiade
oleiade force-pushed the codex/reliability-inbox-evidence-labels branch from 63c97dd to afc9b76 Compare August 14, 2026 15:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

refactor Refactoring the code in the application.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant