Page MenuHomePhabricator
Create Task
Maniphest T262432

Investigate why mobileapps service times out
Closed, ResolvedPublic
Actions

Description

Since about Sept. 9, 2020, the mobileapps service has significantly elevated latency in various MCS/PCS and the aggregated feed endpoint. Several Icinga alerts due to timeouts have been triggered over the last days.

The mobileapps Kibana dashboard shows many timeouts as well.

Related Objects

Event Timeline

• bearND created this task.Sep 9 2020, 3:33 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 9 2020, 3:33 PM
• bearND added a comment.Sep 9 2020, 3:34 PM

Possibly related to T255876.

LGoto triaged this task as High priority.Sep 9 2020, 3:36 PM
LGoto edited projects, added Product-Infrastructure-Team-Backlog-Deprecated (Kanban); removed Product-Infrastructure-Team-Backlog-Deprecated.
Joe subscribed.Sep 9 2020, 5:03 PM

We had a large restbase/parsoid outage today, so this derives from that. Actually, requests originating from mobileapps caused the issue (to be clear: not a mobileapps bug here - but also unrelated to the transition above).

• Mholloway subscribed.Sep 9 2020, 8:33 PM
• bearND closed this task as Resolved.Sep 10 2020, 2:44 AM
• bearND claimed this task.

Latency has come back down.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits