db1228 (m5 master) rebooted itself so this caused a brief unavailability period for this section.
There is nothing on the logs unfortunately.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | BUG REPORT | None | T391259 Cannot login to toolsadmin, password reset link says invalid token at idm | ||
| Resolved | BUG REPORT | SLyngshede-WMF | T391265 IDM Bug-Report: Approving my own pending request causes a 500 | ||
| Resolved | Marostegui | T391237 m5 master db1228 rebooted itself |
Event Timeline
Comment Actions
I am going to close this as fixed, I created it to have a record of this incident/issue.
Comment Actions
I believe the haproxy reload step from https://wikitech.wikimedia.org/wiki/HAProxy#Failover was missed
taavi@dbproxy1029 ~ $ echo "show stat" | socat unix-connect:/run/haproxy/haproxy.sock stdio | grep db1228 mariadb,db1228,0,0,0,406,,10079206,297899045780,207743525583,,0,,291,431,926,28,DOWN 14476/99999999,1,1,0,24,1,22040,22040,,1,2,1,,10078280,,2,0,,336,L7OK,0,1,,,,,,,,,,,17,431,,,,,22040,,,32,95,0,5194218,,,,Layer7 check passed,,99999999,20,14476,,,,,,tcp,,,,,,,,0,10079206,0,,,0,,9004,6017,0,2247576818,0,0,0,0,3,1,,,,-,0,0,0,,,,,,,,,,,,,,,,,,,,,,