Page MenuHomePhabricator
Create Task
Maniphest T193456

Fundraising queues missing prometheus data since 4/26
Closed, ResolvedPublic
Actions

Description

https://grafana.wikimedia.org/dashboard/db/fundraising-overview?orgId=1&panelId=10&fullscreen&from=1524753679965&to=1524759524370&refresh=1m&edit

Related Objects
Search...

Event Timeline

• cwdent created this task.May 1 2018, 1:59 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 1 2018, 1:59 AM
• DStrine moved this task from Triage to FR-Ops on the Fundraising-Backlog board.May 14 2018, 8:12 PM
• cwdent added a subscriber: XenoRyet.May 14 2018, 9:52 PM

Nothing obvious server side except that the numbers aren't there at civi1001:/var/spool/prometheus

I believe they should be written by process-control jobs. There were some edits to localsettings and a deploy around the time the numbers stop on 4/26, though the changes are not obviously related.

@XenoRyet in ejegg's absence you do you think you'd be able to help track down where these numbers are supposed to come from?

Jgreen added a parent task: T197892: fundraising monitoring fixes (EPIC).Jun 21 2018, 6:45 PM
Jgreen added a parent task: T91508: [Epic] overhaul fundraising cluster monitoring.Jun 21 2018, 6:51 PM
• Vvjjkkii renamed this task from Fundraising queues missing prometheus data since 4/26 to jxdaaaaaaa.Jul 1 2018, 1:12 AM
• Vvjjkkii triaged this task as High priority.
• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed a subscriber: Aklapper.
CommunityTechBot updated the task description. (Show Details)Jul 1 2018, 2:01 PM
CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
CommunityTechBot added a subscriber: Aklapper.
Vachovec1 renamed this task from jxdaaaaaaa to Fundraising queues missing prometheus data since 4/26.Jul 1 2018, 3:36 PM
CommunityTechBot raised the priority of this task from High to Needs Triage.Jul 3 2018, 1:52 AM
• cwdent closed this task as Resolved.Sep 4 2018, 3:30 PM
• cwdent claimed this task.

Looks like this was fixed around 7/1

Dwisehaupt moved this task from Triage to Done on the fundraising-tech-ops board.Feb 13 2020, 9:34 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL