Maniphest T364971

Create Structured Contents service infrastructure
Open, Needs TriagePublic3 Estimated Story Points
Actions

Assigned To

Authored By

	REsquito-WMF
	May 15 2024, 10:09 AM

Tags

Referenced Files

None

Subscribers

Description

As WME Engineer i want to change our infrastructure to deploy 2 structured contents services.

Acceptance Criteria

2 Structured Contents services deployed in dev

TODO

Decide on what topics to ingest from follow below or change it and share with team
Create structured contents service processing service in infra repository
Create structured contents bulk service in infra repository
Configure services accordingly
Deploy to dev

Additional Notes

There will be 2 services deployed based on the same code.

Processing service Will read from topic aws.structured-data.articles.v1 and output to compacted topics and non compacted topic
Bulk service will read from compacted topics, ex: aws.structured-data.enwiki-articles-compacted.v1, and output to compacted topics. Input topics should be configurable as an array

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T362409 Q4 O1.KR2: Machine Readability Service delivered by end of quarter, per Structured Contents ERD
		Open		None	T362319 {Machine Readability} Structured Contents MVP Release
		Open		ROdonnell-WMF	T364971 Create Structured Contents service infrastructure

Event Timeline

REsquito-WMF created this task.May 15 2024, 10:09 AM

REsquito-WMF edited parent tasks, added: T362319: {Machine Readability} Structured Contents MVP Release; removed: T362409: Q4 O1.KR2: Machine Readability Service delivered by end of quarter, per Structured Contents ERD .May 15 2024, 12:48 PM

REsquito-WMF updated the task description. (Show Details)May 15 2024, 1:23 PM

JArguello-WMF moved this task from Incoming to To Be Estimated/To Be Discussed on the Wikimedia Enterprise board.Tue, May 21, 3:04 PM

REsquito-WMF set the point value for this task to 3.Tue, May 21, 3:09 PM

JArguello-WMF moved this task from To Be Estimated/To Be Discussed to Sprint 61 on the Wikimedia Enterprise board.Thu, May 23, 1:09 PM

JArguello-WMF edited projects, added Wikimedia Enterprise (Sprint 61); removed Wikimedia Enterprise.

ROdonnell-WMF claimed this task.Wed, Jun 5, 1:08 PM

ROdonnell-WMF moved this task from Next Up to In Progress on the Wikimedia Enterprise (Sprint 61) board.

ROdonnell-WMF moved this task from In Progress to MR on the Wikimedia Enterprise (Sprint 61) board.Mon, Jun 10, 5:17 PM

ROdonnell-WMF updated the task description. (Show Details)Mon, Jun 10, 5:40 PM

ROdonnell-WMF updated the task description. (Show Details)Tue, Jun 11, 11:05 AM

ROdonnell-WMF moved this task from MR to QA on the Wikimedia Enterprise (Sprint 61) board.Wed, Jun 12, 11:06 AM

ROdonnell-WMF moved this task from QA to MR on the Wikimedia Enterprise (Sprint 61) board.

After a chat with Ricardo and Prabhat, no bulk service (yet). But we need a structured-realtime service for API access.

JArguello-WMF moved this task from MR to Sign Off on the Wikimedia Enterprise (Sprint 61) board.Thu, Jun 13, 1:05 PM

JArguello-WMF edited projects, added Wikimedia Enterprise (Sprint 62); removed Wikimedia Enterprise (Sprint 61).Fri, Jun 14, 1:57 PM

JArguello-WMF moved this task from Next Up to Sign Off on the Wikimedia Enterprise (Sprint 62) board.