Page MenuHomePhabricator

blazegraph journal on wdqs1005 has doubled in space
Closed, ResolvedPublic

Description

No other wdqs servers have that same behaviour, only wdqs1005. And this means that we are running out of disk space.

Some investigation needs to be done and then probably copy data over from another node.

Event Timeline

Gehel created this task.Mon, Aug 5, 7:50 PM
Restricted Application added a project: Wikidata. · View Herald TranscriptMon, Aug 5, 7:50 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Mentioned in SAL (#wikimedia-operations) [2019-08-05T19:51:12Z] <gehel> depool wdqs1005 - T229876

The journal dump says: There are 755560 commit points.. Probably not a normal situation.

Smalyshev triaged this task as Normal priority.Tue, Aug 6, 5:58 PM

@Gehel I think for now we need to reload the DB from other server and repool it. Let's keep an eye on this problem and see if it ever happens again.

Smalyshev assigned this task to Gehel.Tue, Aug 6, 5:58 PM
Smalyshev closed this task as Resolved.Thu, Aug 15, 6:24 AM