Maniphest T323914

Deploy Mediawiki Stream Enrichment on an-launcher1002.
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	gmodena
	Nov 28 2022, 2:09 PM

Tags

Referenced Files

None

Subscribers

Description

In order to be granted a long lived kerberos ticket,
Flink should run as user analytics on an-launcher1002. Jobs should be scheduled in the production queue.

Event Timeline

gmodena created this task.Nov 28 2022, 2:09 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 28 2022, 2:09 PM

gmodena claimed this task.Nov 28 2022, 2:09 PM

Maintenance_bot added a project: Data-Engineering.Nov 28 2022, 2:30 PM

BTullis subscribed.Nov 29 2022, 9:48 AM

gmodena moved this task from In Progress to In Review on the Event-Platform (Sprint 05) board.Nov 29 2022, 10:41 AM

The cluster and mediawiki stream enrichment job are running at https://yarn.wikimedia.org/proxy/application_1663082229270_434209/#/task-manager/container_e50_1663082229270_434209_01_000002/logs

I update the doc at https://www.mediawiki.org/wiki/Platform_Engineering_Team/Event_Platform_Value_Stream/PoC_Mediawiki_Stream_Enrichment
to reflect this change.

Startup scripts:

Download and setup Flink 1.15 https://gitlab.wikimedia.org/-/snippets/45
Start Flink Session cluster and enrichment job (latest release) https://gitlab.wikimedia.org/-/snippets/43#LC5

Nice!

Ottomata moved this task from In Review to Done on the Event-Platform (Sprint 05) board.Nov 30 2022, 4:17 PM

• EChetty edited projects, added Data-Engineering-Planning; removed Data-Engineering.Dec 1 2022, 2:12 PM

JArguello-WMF edited projects, added Event-Platform (Sprint 07); removed Event-Platform (Sprint 05).Jan 9 2023, 2:25 PM

JArguello-WMF moved this task from Next Up to Done on the Event-Platform (Sprint 07) board.

JArguello-WMF closed this task as Resolved.Jan 27 2023, 8:14 PM