Maniphest T194075

2018-03 snapshot still broken
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	Milimetric
	May 7 2018, 7:12 PM

Description

Last month's mediawiki_history snapshot is known to be broken (see below), we should label it as bad by renaming the snapshot maybe.

select snapshot, event_entity, count(*) from mediawiki_history where snapshot in ('2018-03', '2018-02', '2018-04') group by snapshot, event_entity;

2018-02	page	380400218
2018-03	page	375059982
2018-04	page	387816452
2018-02	revision	3584105448
2018-03	revision	3058000386
2018-04	revision	3661962481
2018-02	user	171245822
2018-03	user	169545580
2018-04	user	174890707

Event Timeline

Milimetric created this task.May 7 2018, 7:12 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 7 2018, 7:12 PM

Milimetric triaged this task as Unbreak Now! priority.May 7 2018, 7:12 PM

Milimetric added a project: Analytics-Kanban.

Restricted Application added subscribers: Liuxinyu970226, TerraCodes. · View Herald TranscriptMay 7 2018, 7:12 PM

Milimetric lowered the priority of this task from Unbreak Now! to High.May 7 2018, 7:12 PM

Milimetric moved this task from Incoming to Operational Excellence on the Analytics board.

Milimetric moved this task from Operational Excellence to Data Quality on the Analytics board.

@Milimetric: we did not redo the snapshot at all, so yes, it is broken. We reindexed data 2018-02 on wikistats

Milimetric updated the task description. (Show Details)May 7 2018, 7:26 PM

Assigning to @JAllemandou to rename snapshot name and swap by good one.

JAllemandou moved this task from Next Up to In Progress on the Analytics-Kanban board.May 8 2018, 3:31 PM

Mentioned in SAL (#wikimedia-analytics) [2018-05-08T17:57:54Z] <joal> Mvoe recomputed 2018-03 history snapshot in place of old one (T194075)

Fixed today.

select snapshot, event_entity, count(*) from mediawiki_history where snapshot in ('2018-03', '2018-02', '2018-04') group by snapshot, event_entity;

snapshot	event_entity	_c2
2018-02	page	380400218
2018-03	page	384443253
2018-04	page	387816452
2018-02	revision	3584105448
2018-03	revision	3627280310
2018-04	revision	3661962481
2018-02	user	171245822
2018-03	user	173007017
2018-04	user	174890707

Old broken snapshot has been moved to /wmf/data/wmf/mediawiki/history/snapshot=2018-03-incorrect (and stats to : /wmf/data/wmf/mediawiki/history_stats/snapshot=2018-03-incorrect).

JAllemandou moved this task from In Progress to Done on the Analytics-Kanban board.May 8 2018, 5:59 PM

• Nuria set the point value for this task to 1.May 8 2018, 10:52 PM

• Nuria closed this task as Resolved.Jun 11 2018, 11:04 PM

Liuxinyu970226 unsubscribed.Jun 15 2018, 3:34 PM

• Vvjjkkii renamed this task from 2018-03 snapshot still broken to cgdaaaaaaa.Jul 1 2018, 1:11 AM

• Vvjjkkii reopened this task as Open.

• Vvjjkkii removed JAllemandou as the assignee of this task.

• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).

• Vvjjkkii updated the task description. (Show Details)

• Vvjjkkii removed the point value for this task.

• Vvjjkkii edited subscribers, added: JAllemandou; removed: Aklapper.

• Community_Tech_bot renamed this task from cgdaaaaaaa to 2018-03 snapshot still broken.Jul 1 2018, 7:11 AM

• Community_Tech_bot closed this task as Resolved.

• Community_Tech_bot assigned this task to JAllemandou.

• Community_Tech_bot set the point value for this task to 1.

• Community_Tech_bot updated the task description. (Show Details)

• Community_Tech_bot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.

• Community_Tech_bot edited subscribers, added: Aklapper; removed: JAllemandou.

2018-03 snapshot still brokenClosed, ResolvedPublic1 Estimated Story PointsActions

Description

Event Timeline

2018-03 snapshot still broken
Closed, ResolvedPublic1 Estimated Story Points
Actions