Change Details

(No obvious correlation to a particular logstash error.) ##### Impact Spike in Varnish 5xx errors (~ 2k/min) following all-wiki promotion of 1.35.0-wmf.19. https://grafana.wikimedia.org/d/000000503/varnish-http-errors?refresh=1m&orgId=1&from=1581624754466&to=1581626554466 {F31614985} ##### Notes Timeline from SAL: ``` 20:33 marxarelli: rollback to group1 due to 500 spike (2k/min) (T233867) 20:32 dduvall@deploy1001: rebuilt and synchronized wikiversions files: (no justification provided) 20:30 marxarelli: varnish 500 spike. rolling back 20:20 gehel: restarting blazegraph + updater on wdqs2006 20:19 dduvall@deploy1001: rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.19 ```

##### Impact Spike in Varnish 5xx errors (~ 2k/min) following all-wiki promotion of 1.35.0-wmf.19. https://grafana.wikimedia.org/d/000000503/varnish-http-errors?refresh=1m&orgId=1&from=1581624754466&to=1581626554466 {F31614985} ##### Notes Timeline from SAL: ``` 20:33 marxarelli: rollback to group1 due to 500 spike (2k/min) (T233867) 20:32 dduvall@deploy1001: rebuilt and synchronized wikiversions files: (no justification provided) 20:30 marxarelli: varnish 500 spike. rolling back 20:20 gehel: restarting blazegraph + updater on wdqs2006 20:19 dduvall@deploy1001: rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.19 ```

(No obvious correlation to a particular logstash error.) ##### Impact Spike in Varnish 5xx errors (~ 2k/min) following all-wiki promotion of 1.35.0-wmf.19. https://grafana.wikimedia.org/d/000000503/varnish-http-errors?refresh=1m&orgId=1&from=1581624754466&to=1581626554466 {F31614985} ##### Notes Timeline from SAL: ``` 20:33 marxarelli: rollback to group1 due to 500 spike (2k/min) (T233867) 20:32 dduvall@deploy1001: rebuilt and synchronized wikiversions files: (no justification provided) 20:30 marxarelli: varnish 500 spike. rolling back 20:20 gehel: restarting blazegraph + updater on wdqs2006 20:19 dduvall@deploy1001: rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.19 ```