Page MenuHomePhabricator

Codesearch "Everything" is missing MediaWiki core
Closed, ResolvedPublic

Description

Yikes, the core repo is no longer in the list of of repos searched by default "Everything" preset at https://codesearch.wmflabs.org/.

I assume this was unintentional :)

Event Timeline

The code says that it should be there, the logs says hound couldn't index it:

ladsgroup@codesearch4:~$ sudo service hound-core status
● hound-core.service - hound-core
   Loaded: loaded (/etc/systemd/system/hound-core.service; enabled; vendor preset: enabled)
   Active: active (running) since Sat 2019-12-14 10:38:55 UTC; 13h ago
  Process: 18456 ExecStop=/usr/bin/docker stop hound-core (code=exited, status=0/SUCCESS)
  Process: 18529 ExecStartPre=/usr/bin/docker pull etsy/hound (code=exited, status=0/SUCCESS)
  Process: 18491 ExecStartPre=/usr/bin/docker rm -f hound-core (code=exited, status=0/SUCCESS)
  Process: 18484 ExecStartPre=/usr/bin/docker kill hound-core (code=exited, status=1/FAILURE)
 Main PID: 18536 (docker)
    Tasks: 6 (limit: 4915)
   Memory: 2.5M
      CPU: 377ms
   CGroup: /system.slice/hound-core.service
           └─18536 /usr/bin/docker run -p 6084:6080 --name hound-core -v /srv/hound/hound-core:/data -v /srv/puppet:/operations/puppet etsy/hound

Dec 14 20:53:30 codesearch4 docker[18536]: 2019/12/14 20:53:30 vcs pull error (MediaWiki core - https://gerrit-replica.wikimedia.org/r/mediawiki/core.git): exit status 128
Dec 14 21:55:42 codesearch4 docker[18536]: 2019/12/14 21:55:42 Failed to git fetch /data/data/vcs-e2fbd330d32d7def1f4e586f769b73e7cbd15e92, see output below
Dec 14 21:55:42 codesearch4 docker[18536]: fatal: unable to access 'https://gerrit-replica.wikimedia.org/r/mediawiki/core.git/': The requested URL returned error: 503
Dec 14 21:55:42 codesearch4 docker[18536]: Continuing...
Dec 14 21:55:42 codesearch4 docker[18536]: 2019/12/14 21:55:42 vcs pull error (MediaWiki core - https://gerrit-replica.wikimedia.org/r/mediawiki/core.git): exit status 128

I restart hound but I'm not sure that's the real reason since searching with core returns result.

The config for everything has core:

"MediaWiki core": {
        "ms-between-poll": 3600000,
        "url": "https://gerrit-replica.wikimedia.org/r/mediawiki/core.git",
        "url-pattern": {
                "base-url": "https://gerrit.wikimedia.org/g/mediawiki/core/+/{rev}/{path}{anchor}",
                "anchor": "#{line}"
        }
},

Mentioned in SAL (#wikimedia-cloud) [2019-12-15T00:40:46Z] <Amir1> sudo service hound-search restart (T240776)

Ladsgroup claimed this task.

Fixed now: https://codesearch.wmflabs.org/search/?q=MutableContext&i=nope&files=&repos=

Probably hound for core failed and needed a restart

Mentioned in SAL (#wikimedia-cloud) [2019-12-15T01:30:50Z] <legoktm> rolling restart of all hound instances because of gerrit-replica outage (T240776, T240763)

There was a gerrit-replica outage earlier that most likely caused this. It's reasonable to think other repositories might be missing too, so I did a restart of everything.