Page MenuHomePhabricator

cirrusSearchCheckerJob spamming logstash, errors on a few wikis?
Closed, ResolvedPublic

Description

Cirrus jobs are failing on a couple of wikis. Not many. There's a tail, but not a terribly long one. The clustering on the top few make me think something's wrong with these indices (mainly names with underscores in it).

Was pulled from this kibana query

Event Timeline

demon created this task.Jul 21 2016, 9:12 PM
Restricted Application added a project: Discovery-Search. · View Herald TranscriptJul 21 2016, 9:12 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 300424 had a related patch set uploaded (by EBernhardson):
Consider retrying a checker job success

https://gerrit.wikimedia.org/r/300424

debt updated the task description. (Show Details)Jul 21 2016, 10:03 PM

Change 300424 merged by jenkins-bot:
Consider retrying a checker job success

https://gerrit.wikimedia.org/r/300424

Change 300436 had a related patch set uploaded (by EBernhardson):
Consider retrying a checker job success

https://gerrit.wikimedia.org/r/300436

Change 300436 merged by jenkins-bot:
Consider retrying a checker job success

https://gerrit.wikimedia.org/r/300436

In the 5 minutes since deploying the fix we've gone from 150/minute to 0. Looks fixed.

debt added a subscriber: debt.Jul 22 2016, 1:15 AM

Woohoo!

demon closed this task as Resolved.Jul 22 2016, 3:55 PM
demon claimed this task.