Page MenuHomePhabricator

Large amount of "DatabaseMysqlBase::lock failed to acquire lock 'wikidatawiki-activeusers'" timeout-errors on wikidata since 2017-01-30 8:05 UTC
Closed, ResolvedPublicPRODUCTION ERROR

Description

I am not sure if this is wikidata or deployment related: https://logstash.wikimedia.org/goto/29bb2ebcf0ccd9e90e4f7773fdc666dd

They are caused by a job, but no deployments or external causes found at the time. They look like this:

{
  "_index": "logstash-2017.01.30",
  "_type": "mediawiki",
  "_id": "AVnvSXzq3-sTQj-LhJL3",
  "_score": null,
  "_source": {
    "message": "DatabaseMysqlBase::lock failed to acquire lock 'wikidatawiki-activeusers'\n",
    "@version": 1,
    "@timestamp": "2017-01-30T12:11:27.000Z",
    "type": "mediawiki",
    "host": "mw1166",
    "level": "WARNING",
    "tags": [
      "syslog",
      "es",
      "es"
    ],
    "channel": "DBQuery",
    "normalized_message": "DatabaseMysqlBase::lock failed to acquire lock 'wikidatawiki-activeusers'\n",
    "url": "/rpc/RunJobs.php?wiki=wikidatawiki&type=recentChangesUpdate&maxtime=60&maxmem=300M",
    "ip": "127.0.0.1",
    "http_method": "POST",
    "server": "127.0.0.1",
    "referrer": null,
    "wiki": "wikidatawiki",
    "mwversion": "1.29.0-wmf.9",
    "reqId": "WI8tbQpAID4AAByFT3UAAABY"
  },
  "fields": {
    "@timestamp": [
      1485778287000
    ]
  },
  "sort": [
    1485778287000
  ]
}

Event Timeline

Change 335203 had a related patch set uploaded (by Hoo man):
Make RecentChangesUpdateJob::updateActiveUsers more robust

https://gerrit.wikimedia.org/r/335203

hoo subscribed.

This is probably due to the large amounts of edits on Wikidata.
Taking.

This is probably due to the large amounts of edits on Wikidata.
Taking.

Thank you!

Change 335203 merged by jenkins-bot:
Make RecentChangesUpdateJob::updateActiveUsers more robust

https://gerrit.wikimedia.org/r/335203

Lydia_Pintscher subscribed.

Resolving as it seems this is all done.

mmodell changed the subtype of this task from "Task" to "Production Error".Aug 28 2019, 11:10 PM