Maniphest T219924

Move mobileapps logging to new logging pipeline
Closed, ResolvedPublic
Actions

Description

We need to move #mobileapps to the new logging pipeline. The config should be updated similar to https://gerrit.wikimedia.org/r/#/c/mediawiki/services/change-propagation/deploy/+/500813 and newest node dependencies should be used (newest version of service-runner.

Related Objects
Search...

Status	Assigned	Task
Resolved	herron	T227080 Deprecate all non-Kafka logstash inputs
Invalid	None	T225122 Migrate services using deprecated Gelf logstash input to Kafka enabled logging pipeline
Resolved	herron	T225125 Migrate Elasticsearch from deprecated Gelf logstash input to rsyslog Kafka logging pipeline
Resolved	• Pchelolo	T211125 Move service-runner to new logging infrastructure
Invalid	None	T224602 Fix logging umbrella task
Resolved	fgiunchedi	T219924 Move mobileapps logging to new logging pipeline
Resolved	akosiaris	T239459 service-runner apps running on kubernetes emit logs with log level 50

Event Timeline

• Pchelolo created this task.Apr 2 2019, 7:26 PM

LGoto triaged this task as Medium priority.Apr 3 2019, 3:38 PM

LGoto moved this task from Needs triage to Upcoming on the Product-Infrastructure-Team-Backlog-Deprecated board.

• bearND added a project: Mobile-Content-Service.May 2 2019, 4:27 PM

• Mholloway added a parent task: T224602: Fix logging umbrella task.May 29 2019, 3:56 PM

fgiunchedi added a project: observability.Aug 19 2019, 2:30 PM

• Mholloway subscribed.Dec 17 2019, 4:23 PM

LGoto edited projects, added Product-Infrastructure-Team-Backlog-Deprecated (Kanban); removed Product-Infrastructure-Team-Backlog-Deprecated.Feb 19 2020, 4:49 PM

• Mholloway renamed this task from Move mobile apps logging to new logging pipeline to Move mobileapps logging to new logging pipeline.Mar 5 2020, 4:23 PM

• Mholloway claimed this task.

• Mholloway moved this task from To Do to Doing on the Product-Infrastructure-Team-Backlog-Deprecated (Kanban) board.

Hmm, is this still worth doing if mobileapps is finally moving to k8s soon (T218733)? Same question for Proton (T219925), which is also moving over soon.

• Mholloway edited projects, added Page Content Service; removed Mobile-Content-Service.Mar 5 2020, 8:47 PM

In T219924#5946258, @Mholloway wrote:

Hmm, is this still worth doing if mobileapps is finally moving to k8s soon (T218733)? Same question for Proton (T219925), which is also moving over soon.

Good point re: moving to k8s, in that case then a recent version of service-runner (afaik) and logging to stdout only in the chart's configuration will do the right thing and send logs to the logging pipeline when running in k8s. Ditto for Proton!

What's your expectation on the timeline to move mobileapps + proton to k8s? We (Observability) would like to shut down all non Kafka logstash inputs by end of this fiscal year.

@fgiunchedi This should be finished by April at the latest for both services. AIUI that's when SCB is planned to be decommissioned.

In T219924#5949120, @Mholloway wrote:

@fgiunchedi This should be finished by April at the latest for both services. AIUI that's when SCB is planned to be decommissioned.

Excellent news, thanks for the update. In that case +1 to piggyback logging for mobileapps/proton with the move to k8s. I'm setting the logging tasks to stalled for now.

fgiunchedi mentioned this in T219925: Move proton logging to new logging pipeline.Mar 9 2020, 11:54 AM

• Mholloway removed • Mholloway as the assignee of this task.Mar 10 2020, 1:51 PM

• Mholloway edited projects, added Product-Infrastructure-Team-Backlog-Deprecated; removed Product-Infrastructure-Team-Backlog-Deprecated (Kanban).

• Mholloway moved this task from Upcoming to Backlog on the Product-Infrastructure-Team-Backlog-Deprecated board.

fgiunchedi moved this task from Inbox to Externally blocked on the observability board.Mar 16 2020, 2:23 PM

akosiaris added a subtask: T239459: service-runner apps running on kubernetes emit logs with log level 50 .Apr 15 2020, 4:58 PM