Maniphest T120224

mobile_apps_uniques_monthly not updating {hawk}
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• Tbayer
	Dec 3 2015, 3:29 PM

Description

If I understand the Oozie configuration correctly, this table should be updated at the beginning of the 1st day of each month (and we need the November numbers today), but it only contains numbers until October right now:

hive (default)> SELECT year, month, unique_count FROM wmf.mobile_apps_uniques_monthly WHERE platform = 'Android';
OK
year	month	unique_count
2015	1	6218069
2015	2	5924051
2015	3	6153423
2015	4	8027334
2015	5	7502407
2015	6	6856558
2015	7	6894875
2015	8	7067688
2015	9	7341140
2015	10	7493920

(In contrast, the corresponding daily table mobile_apps_uniques_daily has data up to Dec 2 right now.)

Event Timeline

• Tbayer created this task.Dec 3 2015, 3:29 PM

• Tbayer raised the priority of this task from to Needs Triage.

• Tbayer updated the task description. (Show Details)

• Tbayer added a project: Analytics-Backlog.

• Tbayer subscribed.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptDec 3 2015, 3:29 PM

• Nuria triaged this task as High priority.Dec 3 2015, 3:57 PM

• Nuria set Security to None.

• Nuria edited projects, added Analytics-Kanban; removed Analytics-Backlog.

Thanks for noticing that !
It actually shown us an error in this job execution: it was launched the 15th of the month instead of the 1st, skewing data half a month late.
This means that October data is not perfect, taking into account the second half of September and the first of October.
The job is now started correctly for November, just need the time to compute.

Milimetric renamed this task from mobile_apps_uniques_monthly not updating to mobile_apps_uniques_monthly not updating {hawk}.Dec 3 2015, 6:07 PM

Milimetric assigned this task to JAllemandou.

Milimetric moved this task from Next Up to In Progress on the Analytics-Kanban board.

Milimetric moved this task from In Progress to Ready to Deploy on the Analytics-Kanban board.

Milimetric moved this task from Ready to Deploy to Done on the Analytics-Kanban board.

Milimetric moved this task from Done to In Progress on the Analytics-Kanban board.

Milimetric moved this task from In Progress to Done on the Analytics-Kanban board.

Please see:

hive (wmf)> SELECT year, month, unique_count FROM wmf.mobile_apps_uniques_monthly WHERE platform = 'Android';
OK
year month unique_count
2015 1 6218069
2015 2 5924051
2015 3 6153423
2015 4 8027334
2015 5 7502407
2015 6 6856558
2015 7 6894875
2015 8 7067688
2015 9 7341140
2015 10 7493920
2015 11 7536786

• Nuria closed this task as Resolved.Dec 4 2015, 6:15 PM

Thanks everyone for addressing this quickly! I already saw the data coming in yesterday afternoon PT and updated https://www.mediawiki.org/wiki/Wikimedia_Product#Reading accordingly, still kind of on time.
I understand that the number for October remains invalid. If it's possible to backfill this with correct data, that would be nice (allowing me to remove the two remaining "N/A"s on the Product page). The main objective here though was to ensure these are generated correctly going forwards.

@Tbayer: it is not possible to fill in October data as we no longer have it. Sorry about that.

mobile_apps_uniques_monthly not updating {hawk}Closed, ResolvedPublicActions

Description

Event Timeline

mobile_apps_uniques_monthly not updating {hawk}
Closed, ResolvedPublic
Actions