Page MenuHomePhabricator

tools.anomiebot cannot access wiki replica DBs
Closed, ResolvedPublic

Description

Beginning at around 2023-03-10 13:52:24, AnomieBOT has been getting an access denied error when trying to connect to the replica DBs.

From the command line sql enwiki and the like also fail. But sql toolsdb still works.

Event Timeline

For reference, anomiebot is MySQL user s51055. I can reproduce the connection error with tools.legobot, which is s51043. It appears to affect all slices. But the tool I created on Wednesday, tools.tour-nyc (s55336) is not affected and can connect just fine.

The other two tools I have access to, oauth-hello-world (s51319) and mediawiki-mirror (s52152), both can connect with sql enwiki.

Just tried the following and had no issues (as tools.anomiebot and tools.legobot):

tools.anomiebot@tools-sgebastion-10:~$ id
uid=51055(tools.anomiebot) gid=51055(tools.anomiebot) groups=51055(tools.anomiebot)

tools.anomiebot@tools-sgebastion-10:~$ mysql --defaults-file=$HOME/replica.my.cnf -h enwiki.analytics.db.svc.wikimedia.cloud enwiki

...

tools.anomiebot@tools-sgebastion-10:~$ sql enwiki

MAybe it's already fixed? Can you retry and verify it works? Or paste the command that did not work for you?

Things I did last night when I was too sleepy to remember to log:

(on labstore1004)

maintain-dbusers harvest-replicas
/usr/local/sbin/maintain-dbusers delete tools.anomiebot

at the time it neither command seemed to make a difference.

AnomieBOT is working now. Logs seem to indicate it was fixed sometime after 2023-03-11 04:38:20.

It looks fixed to me as well. OK to close or is more investigation needed?