Change Details

**needs grooming**. Spark producers and consumers currently can access Event Platform's Kafka topics via EventGate and EventStream. The goal of this spike is to explore how to standardize producer/consumer APIs and access patterns. == Use cases - Dumps 2.0 reconciliation - Search Update Pipeline and weighted tags for image recommendations: T372912 == Related - {T214430}

**needs grooming**. Spark producers and consumers currently can access Event Platform's Kafka topics via EventGate and EventStream. The goal of this spike is to explore how to standardize producer/consumer APIs and access patterns. == Use cases - Dumps 2.0 reconciliation - Search Update Pipeline and weighted tags for image recommendations: T372912 - WDQS Updater reconcile mechanism (currently uses a simple [[https://gerrit.wikimedia.org/r/plugins/gitiles/wikidata/query/rdf/+/refs/heads/master/rdf-spark-tools/src/main/scala/org/wikidata/query/rdf/updater/reconcile/ReconciliationSender.scala|EventGate client]] from the spark driver) == Related - {T214430}

**needs grooming**. Spark producers and consumers currently can access Event Platform's Kafka topics via EventGate and EventStream. The goal of this spike is to explore how to standardize producer/consumer APIs and access patterns. == Use cases - Dumps 2.0 reconciliation - Search Update Pipeline and weighted tags for image recommendations: T372912 - WDQS Updater reconcile mechanism (currently uses a simple [[https://gerrit.wikimedia.org/r/plugins/gitiles/wikidata/query/rdf/+/refs/heads/master/rdf-spark-tools/src/main/scala/org/wikidata/query/rdf/updater/reconcile/ReconciliationSender.scala|EventGate client]] from the spark driver) == Related - {T214430}