Page MenuHomePhabricator

Tables on frdev1001 not updating
Closed, ResolvedPublic

Description

Updating of the tables on frdev1001 seems to have stopped. Looks like the last entry in pgehres.bannerimpressions was around 2020-06-16 04:29:00, and in civicrm.civicrm_contribution was 2020-06-16 04:46:18. I checked in the Civi interface itself and donations are still coming in there.

There's a load of warnings in IRC
PROBLEM - check_mysql on frdev1001 is CRITICAL: Slave IO: Yes Slave SQL: No Seconds Behind Master: (null)

Going to postpone the India test because of this.

Event Timeline

Pcoombe created this task.Jun 16 2020, 8:52 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 16 2020, 8:52 AM
Pcoombe renamed this task from pgehres.bannerimpressions not updating to Tables on frdev1001 not updating.Jun 16 2020, 9:10 AM
Pcoombe updated the task description. (Show Details)
DStrine triaged this task as Unbreak Now! priority.Jun 16 2020, 3:39 PM
Restricted Application added a subscriber: Liuxinyu970226. · View Herald TranscriptJun 16 2020, 3:39 PM
Jgreen claimed this task.Jun 16 2020, 3:45 PM
Jgreen edited projects, added fundraising-tech-ops; removed Fundraising-Backlog.

This was a replication timeout due to an extremely longrunning query. I restarted replication at about 12:30 UTC and it caught up quickly after that. There shouldn't be any lost data.

Jgreen closed this task as Resolved.Jun 16 2020, 3:57 PM
Jgreen moved this task from Triage to Done on the fundraising-tech-ops board.Jun 16 2020, 7:54 PM