← Graph

How do you search across millions of events for top items?

question 2 connections

Audience asks how to search for things like 'most attractive items' when state requires processing millions of events. Davydov suggests off-loading search to a dedicated index like Elasticsearch that is updated as events occur; Elasticsearch returns stream IDs, and the system then pulls the full event list or current state only for matching aggregates. He offers this as an idea from his brain rather than the definitive answer.

answer_summary
Maintain a search-optimized read model (e.g. Elasticsearch) updated as events arrive; use it to find stream IDs, then load full state only for matches.
question How do you search across millions of events for top items?
about
Snapshotting concept
Relates to using snapshots/read models for fast search across events.
question How do you search across millions of events for top items?
asked_at
Audience question during the talk's Q&A.

Provenance

Read by
9 extractions