Page MenuHomePhabricator
Create Task
Maniphest T146933

MCS endpoint checks timing out / flapping in production again
Closed, ResolvedPublic
Actions

Description

It happened at least once yesterday and again just now on scb1001.

I don't see anything else untoward going on so I assume ongoing competition with ORES for memory is the most likely culprit.

History:
T140215: mobileapps service still having memory issues
T139177: Investigate increased memory pressure on scb1001/2

Related Objects

Event Timeline

• Mholloway created this task.Sep 28 2016, 8:07 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 28 2016, 8:07 PM
• Mholloway updated the task description. (Show Details)Sep 28 2016, 8:08 PM
• Mholloway updated the task description. (Show Details)
• Mholloway updated the task description. (Show Details)
• Mholloway renamed this task from Endpoint checks timing out / flapping in production again to MCS endpoint checks timing out / flapping in production again.Sep 28 2016, 8:19 PM
• bearND moved this task from Incoming to Backlog on the Mobile-Content-Service board.Sep 28 2016, 10:06 PM
• bearND moved this task from Backlog to Tracking on the Mobile-Content-Service board.Oct 5 2016, 3:46 AM
• NHarateh_WMF added a project: Product-Infrastructure-Team-Backlog-Deprecated.Apr 25 2017, 12:24 PM
Restricted Application added a project: Machine-Learning-Team. · View Herald TranscriptApr 25 2017, 12:24 PM
• NHarateh_WMF moved this task from Needs triage to Tracking on the Product-Infrastructure-Team-Backlog-Deprecated board.Apr 25 2017, 12:25 PM
• NHarateh_WMF moved this task from Tracking to Backlog on the Mobile-Content-Service board.Apr 25 2017, 4:30 PM
• NHarateh_WMF moved this task from Backlog to Incoming on the Mobile-Content-Service board.Apr 25 2017, 4:37 PM
Halfak edited projects, added Machine-Learning-Team (Active Tasks); removed Machine-Learning-Team.Apr 27 2017, 2:51 PM
Halfak moved this task from Parked to Monitor (long term) on the Machine-Learning-Team (Active Tasks) board.
Halfak edited projects, added Machine-Learning-Team; removed Machine-Learning-Team (Active Tasks).Sep 6 2017, 5:23 PM
awight moved this task from Unsorted to Backlog/Lift Wing on the Machine-Learning-Team board.Sep 6 2017, 5:26 PM
• Mholloway closed this task as Resolved.Dec 8 2017, 5:24 PM
• Mholloway claimed this task.

This seems to have abated since T181567 was fixed.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits