Page MenuHomePhabricator
Create Task
Maniphest T85705

About half of the raw webrequest partitions for 2014-12-22T18/8H not marked successful
Closed, ResolvedPublic
Actions

Description

About half of the raw webrequest partitions *) for 2014-12-22T18/8H have not
been marked successful.

What happened?

_________________________________________________________________
qchris@stat1002 // jobs: 0 // time: 14:54:12 // exit code: 0
cwd: ~
~/cluster-scripts/dump_webrequest_status.sh 600
  +------------------+--------+--------+--------+--------+
  | Date             |  bits  | mobile |  text  | upload |
  +------------------+--------+--------+--------+--------+
[...]
  | 2014-12-22T18/1H |    X   |    X   |    X   |    X   |
  | 2014-12-22T19/1H |    X   |    .   |    .   |    .   |
  | 2014-12-22T20/1H |    X   |    X   |    X   |    X   |
  | 2014-12-22T21/1H |    .   |    .   |    .   |    .   |
  | 2014-12-22T22/1H |    X   |    X   |    X   |    X   |
  | 2014-12-22T23/1H |    .   |    X   |    X   |    .   |
  | 2014-12-23T00/1H |    .   |    .   |    .   |    .   |
  | 2014-12-23T01/1H |    X   |    X   |    X   |    X   |
[...]
  +------------------+--------+--------+--------+--------+

Related Objects
Search...

Event Timeline

QChris created this task.Jan 2 2015, 5:41 PM
QChris raised the priority of this task from to Medium.
QChris updated the task description. (Show Details)
QChris added a project: Analytics-Clusters.
QChris added subscribers: Aklapper, Unknown Object (MLST), QChris and 3 others.
QChris closed this task as Resolved.Jan 2 2015, 5:47 PM
QChris claimed this task.

Resources on the cluster went scarce, and the jobs could not launch before they timed out.

I re-started them by manually, and the issues with the mobile, text and upload partitions got resolved thereby *)
(Only three bits partitiotns are still not marked as ok, but that has different reasons.)

The pagecounts-all-sites jobs picked up the partitions and generated the hourly files.

*) After rerunning, the stats look like:

| 2014-12-22T18/1H |    X   |    .   |    .   |    .   |
| 2014-12-22T19/1H |    X   |    .   |    .   |    .   |
| 2014-12-22T20/1H |    X   |    .   |    .   |    .   |
| 2014-12-22T21/1H |    .   |    .   |    .   |    .   |
| 2014-12-22T22/1H |    .   |    .   |    .   |    .   |
| 2014-12-22T23/1H |    .   |    .   |    .   |    .   |
| 2014-12-23T00/1H |    .   |    .   |    .   |    .   |
| 2014-12-23T01/1H |    .   |    .   |    .   |    .   |
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL