Archive tables to hadoop: MobileWikiAppToCInteraction_10375484_15423246 and Edit_13457736_15423246
Closed, ResolvedPublic5 Estimated Story Points
Actions

Assigned To

Authored By

	• Nuria
	Oct 11 2017, 4:01 PM

Event Timeline

• Nuria created this task.Oct 11 2017, 4:01 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 11 2017, 4:01 PM

elukey subscribed.Oct 11 2017, 4:56 PM

• Nuria closed this task as Resolved.Oct 12 2017, 6:34 PM

• Nuria moved this task from Next Up to In Progress on the Analytics-Kanban board.

• Nuria reopened this task as Open.Oct 12 2017, 7:16 PM

• Nuria claimed this task.Oct 12 2017, 7:20 PM

MobileWikiAppToCInteraction_10375484_15423246 is ready to be dropped, on archive db on hdfs cc @elukey

Sanity check before dropping:

MariaDB [log]> select count(*) from MobileWikiAppToCInteraction_10375484_15423246;
+-----------+
| count(*)  |
+-----------+
| 534982303 |
+-----------+

0: jdbc:hive2://analytics1003.eqiad.wmnet:100> select count(*) from mobilewikiapptocinteraction_10375484_15423246;
INFO  : Compiling command(queryId=hive_20171018092222_120335d3-7902-4b64-bc9f-128048f536ae): select count(*) from mobilewikiapptocinteraction_10375484_15423246
[..]
534982303
1 row selected (100.186 seconds)

Mentioned in SAL (#wikimedia-operations) [2017-10-18T09:30:17Z] <elukey> drop MobileWikiAppToCInteraction_10375484_15423246 from the log database on dbstore1002,db1047,db1046 - T177960

@Nuria thanks a lot for this task, eventlogging_cleaner will be super happy not to clean huge tables like these :)

• Nuria set the point value for this task to 5.Oct 18 2017, 3:11 PM

Edit_13457736_15423246 can also be dropped

Sanity check:

0: jdbc:hive2://analytics1003.eqiad.wmnet:100> select count(*) from edit_13457736_15423246;
INFO  : Compiling command(queryId=hive_20171024151414_0f650c1b-e117-493f-bac4-ac7020fe7945): select count(*) from edit_13457736_15423246
[..]
_c0
276173629

MariaDB [log]> select count(*) from Edit_13457736_15423246;
+-----------+
| count(*)  |
+-----------+
| 276173629 |
+-----------+

All tables dropped!

elukey moved this task from In Progress to Done on the Analytics-Kanban board.Oct 24 2017, 4:26 PM

• Nuria closed this task as Resolved.Oct 24 2017, 11:27 PM

Archive tables to hadoop: MobileWikiAppToCInteraction_10375484_15423246 and Edit_13457736_15423246Closed, ResolvedPublic5 Estimated Story PointsActions

Event Timeline

Archive tables to hadoop: MobileWikiAppToCInteraction_10375484_15423246 and Edit_13457736_15423246
Closed, ResolvedPublic5 Estimated Story Points
Actions