Page MenuHomePhabricator

Central Notice message groups are slow to index
Open, MediumPublic

Description

See P1968 for log. CN message groups alone about two hours to index, which is more than all other message groups across all sites.

There seems to be something blocking there, because even though I ran with 4 threads, only one of them seemed to be doing something at a time during CN groups. You can see this in the log by having bunch of groups complete (not shown in the log) at the same time, and new threads spawned for new groups at the same time (shown in the log).

Event Timeline

Nikerabbit raised the priority of this task from to Needs Triage.
Nikerabbit updated the task description. (Show Details)
Nikerabbit added subscribers: Nikerabbit, Amire80, greg.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 2 2015, 2:53 PM
greg added a comment.Sep 2 2015, 3:10 PM

You added me to CC so I assume this is High priority at least?

/me is just wondering why he was CC'd :)

Hi Greg, I was planning to send you an email but forgot. To put it short, I had some delay in beginning due to the script refusing to run. After that all went fine except reindexing meta took more than two hours so I went a quite bit of overtime of the allocated window. This issue is not urgent, but if not looked into I might require to ask 4h slot next time ;)

DStrine reassigned this task from AndyRussG to Nikerabbit.Oct 13 2015, 5:22 PM
DStrine triaged this task as Medium priority.
awight added a subscriber: awight.Oct 13 2015, 5:24 PM

Hi @Nikerabbit, thanks for noticing this! We're happy to support your investigation in any way we can, it sounds like there's something wrong with the way we're using message groups, perhaps we're spamming or there's a problem with the index schema? Please let us know whatever you find and if we can do anything.

Nikerabbit removed Nikerabbit as the assignee of this task.Apr 20 2016, 1:01 PM

I am not working on this currently.

mmodell removed a subscriber: awight.Jun 22 2017, 9:40 PM