Page MenuHomePhabricator

Daily aggregation of page views stats breaks on invalid input (sort error)
Closed, ResolvedPublic

Description

merging of 24 hourly files into one daily file breaks on improperly sorted input

59300000: pl.z Farma_wiatrakowa
59400000: pl.z Gromada_Baniocha

13/04/2014 03:59 Out of sequence on hour 16:

'pl.z I^O' gt
'pl.z I' -> Abort !!!


Version: unspecified
Severity: normal

Details

Reference
bz63884

Event Timeline

bzimport raised the priority of this task from to High.Nov 22 2014, 3:20 AM
bzimport set Reference to bz63884.

bingle-admin wrote:

Prioritization and scheduling of this bug is tracked on Mingle card https://wikimedia.mingle.thoughtworks.com/projects/analytics/cards/cards/1541

On rerun three daily aggregates were generated normally.

I'm now inclined to think was also caused by multiple concurrent run of same script, which no longer happens (flock)

See also https://bugzilla.wikimedia.org/show_bug.cgi?id=63879