Page MenuHomePhabricator

tools.persondata 504's (sockets disabled, connection limit reached)
Closed, ResolvedPublic

Description

16:54 <andre__> Anybody knows why https://tools.wmflabs.org/persondata/ does not load at all?
16:55 <Luke081515> hm, APPER the maintainer is inactive since the 12th march
16:56 <Luke081515> and looks like there were problems at the past too: https://de.wikipedia.org/wiki/Benutzer_Diskussion:APPER#Personensuche-Tool_defekt_2

Seems to be another instance of T104799: lighttpd does not correctly close connections (CLOSE_WAIT)

Event Timeline

Here, applebot seems to be the culprit. I tried to poke around in the process per https://derickrethans.nl/what-is-php-doing.html , but that doesn't seem to work, so I'm not sure what the php processes are doing... they do seem to be handling requests (if I can believe strace), but only about one per second. The processes are not using significant CPU, except for gam_server:

  PID USER                PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 7815 tools.persondata    20   0  151040  46688   1104 S   0.2  0.6  56:00.00 /usr/sbin/lighttpd -f /var/run/lighttpd/persondata.conf -D
12228 tools.persondata    20   0  433384  13300   6124 S   0.8  0.2   0:19.74 /usr/bin/php-cgi
 9031 tools.persondata    20   0  431044  11568   6168 S   0.5  0.1   0:21.39 /usr/bin/php-cgi
16288 tools.persondata    20   0  429220   9452   6028 S   0.6  0.1   0:09.41 /usr/bin/php-cgi
16118 tools.persondata    20   0  429360   8604   5644 S   0.7  0.1   0:09.45 /usr/bin/php-cgi
 7867 tools.persondata    20   0  329344   5896   5240 S   0.0  0.1   0:05.61 /usr/bin/php-cgi
 7863 tools.persondata    20   0  329344   5772   4184 S   0.0  0.1   0:05.37 /usr/bin/php-cgi
 7872 tools.persondata    20   0   15148   1088    824 S   6.1  0.0   1497:34 /usr/lib/gamin/gam_server

iotop shows no significant I/O.

So... slow SQL queries? I'm not entirely sure.

Change 286315 had a related patch set uploaded (by Merlijn van Deen):
robots.txt: disallow /persondata/

https://gerrit.wikimedia.org/r/286315

Change 286315 merged by Yuvipanda:
robots.txt: disallow /persondata/

https://gerrit.wikimedia.org/r/286315

valhallasw claimed this task.

This seems to have resolved the issue!