Page MenuHomePhabricator

Structured Contents Service
Open, Needs TriagePublic5 Estimated Story Points

Description

As WME Engineer i want to have a service that will read for structured-data output topic and outputs structured contents parsed content into new topics.

Acceptance Criteria

  • Repository created with code and unit tests

TODO

  • Create new repository
  • Enable CI/CD pipeline for repository
  • Enhance repository for code to read from kafka
  • Enhance repository with code to call structured contents parser on update event
  • Enhance repository with code to send thumbstone to compacted topics
  • Enhance repository with cod to send delete event to non compacted topics
  • Enhance repository with necessary unit tests

Additional Info

Message output key example:

{
"identifier": "/enwiki/Santa_Cruz,_California",
"type": "structured"
}