[Firehose API} Project and Namespace Filtering to Streaming API
Closed, InvalidPublic
Actions

Assigned To

None

Authored By

	• RBrounley_WMF
	May 11 2021, 3:10 PM

Description

User Story: As a firehoser user, I am able to easily ingest only data from specific projects and namespaces from the api so that I can ensure that the feed I receive is useful to populating my specific knowledge store.

Need to spec this out, but initial ideas are using KSQL or Flink on top of our kafka streams.

Ideal: API endpoints that you can just filter.
Less Ideal: Creating custom streams.

Event Timeline

• RBrounley_WMF created this task.May 11 2021, 3:10 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 11 2021, 3:10 PM

• RBrounley_WMF triaged this task as High priority.May 12 2021, 3:45 PM

• RBrounley_WMF moved this task from Later to Sprint 9 Backlog on the Wikimedia Enterprise board.

• RBrounley_WMF set Due Date to Jul 1 2021, 4:00 AM.May 12 2021, 3:48 PM

• RBrounley_WMF renamed this task from Project and Namespace Filtering to Streaming API to [Firehose API} Project and Namespace Filtering to Streaming API.May 27 2021, 1:52 AM

AnnaMikla edited projects, added Wikimedia Enterprise (Okapi Wikimedia Enterprise); removed Wikimedia Enterprise.Aug 4 2021, 8:47 AM

AnnaMikla moved this task from Default Column to Next on the Wikimedia Enterprise (Okapi Wikimedia Enterprise) board.

@RBrounley_WMF: Hi, the Due Date set for this open task passed a while ago. Could you please either update or reset the Due Date (by clicking Edit Task), or set the status of this task to resolved in case this task is done? Thanks!

AnnaMikla removed Due Date.Oct 10 2021, 3:32 PM

Protsack.stephan closed this task as Invalid.Aug 29 2022, 6:45 PM

[Firehose API} Project and Namespace Filtering to Streaming APIClosed, InvalidPublicActions

Description

Event Timeline

[Firehose API} Project and Namespace Filtering to Streaming API
Closed, InvalidPublic
Actions