[BUG]UBI_JUDGMENT creation fails when using OpenSearch Dashboards sample UBI data

[arunagov]

[BUG] UBI_JUDGMENT creation fails when using OpenSearch Dashboards sample UBI data

What is the bug?

When UBI data is loaded using the OpenSearch Dashboards sample data loader, events are stored in opensearch_dashboards_sample_ubi_events. The Search Relevance plugin hardcodes ubi_events as the expected index name and fails with a 500 error. Creating an alias ubi_events → opensearch_dashboards_sample_ubi_events does not help — the plugin does not resolve aliases.

How can one reproduce the bug?

1. Load sample UBI data via OpenSearch Dashboards (Home → Add sample data) — this creates opensearch_dashboards_sample_ubi_events
2. Run:

PUT _plugins/_search_relevance/judgments
{
  "name": "my-implicit-judgments",
  "clickModel": "coec",
  "type": "UBI_JUDGMENT",
  "maxRank": 20
}

3. Observe:

{"error": {"reason": "UBI events index does not exist"}, "status": 500}

What is the expected behavior?

The plugin should recognize opensearch_dashboards_sample_ubi_events as a valid UBI events source, or support an eventsIndex parameter to specify a custom index name.

What is your host/environment?

• OpenSearch 3.5
• UBI events index: opensearch_dashboards_sample_ubi_events (loaded via Dashboards sample data)

Do you have any additional context?

The UI-based judgment creation in OpenSearch Dashboards works correctly with the same data — only the API path is broken. This blocks any user getting started with SRW using the built-in sample data.

[github-actions]

Possible Duplicate

Found 1 possible duplicate issue(s):

• [FEATURE] Support UBI sample dataset in playground #730

If this is not a duplicate:

• Add a comment on this issue, or
• 👎 this comment to prevent auto-closure

Otherwise, this issue will be automatically closed in 7 days.

[andrross]

@fen-qin Can you take a look at this? Looks like mismatch between expected index names with the sample data?