Page MenuHomePhabricator

CopyPatrol not showing up records from Eranbot database
Closed, ResolvedPublic

Description

Eranbot is still collecting copyvio records in s51306__copyright_p but CopyPatrol (and the staging instance, both) are not displaying them. This problem started occurring after the reboots that happened on ToolForge. There isn't any helpful information in the error log. Webservice restarts did not fix the issue.

Triaging this as a high priority.

Event Timeline

Niharika triaged this task as High priority.Jun 7 2018, 6:04 PM
Niharika updated the task description. (Show Details)

I'm not seeing new records being put in the copyright_diffs table:

MariaDB [s51306__copyright_p]> SELECT page_title, diff_timestamp FROM copyright_diffs WHERE lang = 'en' AND project = 'wikipedia' ORDER BY diff_timestamp DESC LIMIT 5;
+------------------------------------------+----------------+
| page_title                               | diff_timestamp |
+------------------------------------------+----------------+
| Malcolm_Richardson                       | 20180606181806 |
| Propaganda_in_Nazi_Germany               | 20180606180731 |
| Track_Marketing_Efforts_With_Clickmagick | 20180606180643 |
| Northern_right_whale_dolphin             | 20180606175010 |
| Maria_Amapola_Cabase                     | 20180606174603 |
+------------------------------------------+----------------+
5 rows in set (0.00 sec)

Those are all from yesterday and have been reviewed https://tools.wmflabs.org/copypatrol/en?filter=all

So I think the issue is with EranBot. I'm looking into that now

MusikAnimal moved this task from Ready to Needs Review/Feedback on the Community-Tech-Sprint board.

I've restarted all of EranBot's gridengine jobs, and looks like it's working now. 1 unreviewed record as of the time of writing: https://tools.wmflabs.org/copypatrol/en

@MusikAnimal Thanks! I saw new records in the table but I now realize they are for Spanish and there's a lot of them. So I imagine the English job stopped working long before the Spanish one.

Yeah I noticed the job for Spanish was restarted today, perhaps automatically after failing. The rest hadn't been restarted since April.

Vvjjkkii renamed this task from CopyPatrol not showing up records from Eranbot database to 6fbaaaaaaa.Jul 1 2018, 1:05 AM
Vvjjkkii reopened this task as Open.
Vvjjkkii removed MusikAnimal as the assignee of this task.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed a subscriber: Aklapper.
CommunityTechBot renamed this task from 6fbaaaaaaa to CopyPatrol not showing up records from Eranbot database.Jul 2 2018, 8:42 AM
CommunityTechBot closed this task as Resolved.
CommunityTechBot assigned this task to MusikAnimal.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot added a subscriber: Aklapper.