Page MenuHomePhabricator

Add revision tag change update events to Realtime and Realtime Batch APIs
Open, LowPublic21 Estimated Story Points

Description

As a data re-user I want to be able to receive and event in Realtime and Realtime Batch APIs when revision tags change, so that I can keep revision tags for the article up to date.

Acceptance criteria
New tags-change event being emitted when revision tags change.

Notes
This is a problem because tag updates to the revision don't trigger revision create event.

Things to consider

  • We can use Event Stream Revision Tags Change stream
  • More on tags
  • Important thing that this event can't be emitted before the update event for a certain revision
    • There's a possibility that someone creates a revision and then edits tags right away, that way we can't guarantee that our system will process the revision-create event faster than tag-chage

To-Do

  • updates to event-bridge service
    • add new tagschange handler to the event-bridge service that will publish to aws.event-bridge.article-tags-change.v1 topic from Event Stream Revision Tags Change stream
      • make sure that this handler omits events to aws.event-bridge.article-tags-change.v1 topic
      • add new event-bdridge-tagschange handler to the IaC and update CI/CD piepelines
    • update ACLs for the aws.event-bridge.article-tags-change..v1 to allow event-bdridge-tagschange as publisher
  • updates to structured-data service
    • add new articletags handler that will listen to aws.event-bridge.article-tags-change.v1 (do data enrichment TBD)
      • make sure that handler publishes to aws.structured-data.articles.v1 with event.type equal tags-change
      • need to make sure that it does not publish events for the same version.identfier faster than update (aricleupdate handler) events are emitted
      • data enrichment TBD (don't know the schema and values yet)
  • updates to Realtime API
    • just need to update the schema submodule to the latest version if we do any schema changes along the way

Related Objects

Event Timeline

Protsack.stephan created this task.
Protsack.stephan renamed this task from Trigger update event when revision tag changes to Trigger update event when revision tagі change.Apr 11 2023, 3:20 PM
Protsack.stephan renamed this task from Trigger update event when revision tagі change to Trigger update event when revision tags change.Apr 11 2023, 3:47 PM
Protsack.stephan renamed this task from Trigger update event when revision tags change to Add tag change updates events.Apr 11 2023, 6:12 PM
Protsack.stephan renamed this task from Add tag change updates events to Add tag change updates events to APIs.
Protsack.stephan renamed this task from Add tag change updates events to APIs to Add revision tag change update events to APIs.Apr 11 2023, 6:17 PM
Felixejofre set the point value for this task to 21.Apr 12 2023, 2:37 PM
Protsack.stephan renamed this task from Add revision tag change update events to APIs to Add revision tag change update events to Realtime and Realtime Batch APIs.Apr 14 2023, 5:57 PM
JArguello-WMF lowered the priority of this task from Medium to Low.Aug 29 2023, 3:14 PM