Maniphest T223958

move AbuseFilter stats from mysql to hive
Closed, ResolvedPublic
Actions

Description

As a follow-up to T189475, the data storage should be moved from mysql to hive.

Details

	Project	Branch	Lines +/-	Subject
	analytics/reportupdater-queries	master	+68 -57	Update the CX abuse filter statistics script for hive

Customize query in gerrit

Related Objects

Mentioned In: rARPQ55378ef7d8e6: Update the CX abuse filter statistics script for hive
T189475: Identify common abuse filters that affect translations
Mentioned Here: T189475: Identify common abuse filters that affect translations

Event Timeline

Amire80 created this task.May 21 2019, 8:24 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 21 2019, 8:24 AM

Amire80 moved this task from Backlog to Done on the Language-Team (Language-2019-April-June) board.May 21 2019, 8:24 AM

Amire80 moved this task from Done to In Progress on the Language-Team (Language-2019-April-June) board.

Amire80 mentioned this in T189475: Identify common abuse filters that affect translations.

Arrbee triaged this task as Medium priority.May 22 2019, 8:14 AM

Pginer-WMF edited projects, added Language-Team (Language-2019-July-September); removed Language-Team (Language-2019-April-June).Jul 1 2019, 12:33 PM

Pginer-WMF moved this task from Backlog to In Progress on the Language-Team (Language-2019-July-September) board.

Pginer-WMF added a project: Language-analytics.Aug 29 2019, 10:21 AM

Pginer-WMF edited projects, added Language-Team (Language-2019-October-December); removed Language-Team (Language-2019-July-September).Oct 9 2019, 11:52 AM

Pginer-WMF moved this task from Backlog to In Progress on the Language-Team (Language-2019-October-December) board.

abi_ moved this task from In Progress to In Review on the Language-Team (Language-2019-October-December) board.Nov 26 2019, 4:55 PM

abi_ moved this task from In Review to In Progress on the Language-Team (Language-2019-October-December) board.

Pginer-WMF edited projects, added Language-Team (Language-2020-January-March); removed Language-Team (Language-2019-October-December).Jan 2 2020, 8:12 AM

Pginer-WMF moved this task from Backlog to In Progress on the Language-Team (Language-2020-January-March) board.

Arrbee moved this task from In Progress to In Review on the Language-Team (Language-2020-January-March) board.Jan 15 2020, 8:20 AM

Change 579022 had a related patch set uploaded (by Amire80; owner: Amire80):
[analytics/reportupdater-queries@master] WIP Update for hive

https://gerrit.wikimedia.org/r/579022

gerritbot added a project: Patch-For-Review.Mar 11 2020, 6:42 PM

• Rileych edited projects, added Language-Team (Language-2020-Focus-Sprint); removed Language-Team (Language-2020-January-March).Mar 18 2020, 2:04 PM

• Rileych moved this task from Priority Backlog to In Review on the Language-Team (Language-2020-Focus-Sprint) board.

Change 579022 merged by Mforns:
[analytics/reportupdater-queries@master] Update the CX abuse filter statistics script for hive

https://gerrit.wikimedia.org/r/579022

Maintenance_bot removed a project: Patch-For-Review.Apr 30 2020, 8:10 PM

mforns mentioned this in rARPQ55378ef7d8e6: Update the CX abuse filter statistics script for hive.May 1 2020, 12:32 AM

Thanks for deploying the database patch.

I see that the data in hive is valid now. However, the Superset board that uses this data probably has to be reconfigured. Can you please help with that?

Hey @Amire80, I fixed the dashboard. Let me know if it works properly.

In T223958#6116895, @mforns wrote:

Hey @Amire80, I fixed the dashboard. Let me know if it works properly.

Thanks a lot for the help!

This can probably be closed now.

Pginer-WMF closed this task as Resolved.May 14 2020, 1:11 PM