Page MenuHomePhabricator
Create Task
Maniphest T175651

Grafana has confusing or wrong scale for "scores errored" graph
Closed, ResolvedPublic
Actions

Description

"Overload errors" are a steady 240 errors/minute on each server, but the "scores errored" graph shows something other than count. Servers are oddly showing different "scores errored" for this interval, when their load was well balanced. The Y values doesn't follow overload errors during windows between tests. What is this graph showing on the Y axis?

Observed during stress testing.

Screen Shot 2017-09-11 at 4.43.20 PM.png (1×1 px, 226 KB)

Related Objects

Event Timeline

awight created this task.Sep 11 2017, 11:47 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 11 2017, 11:47 PM
awight added projects: Machine-Learning-Team, Analytics.Sep 11 2017, 11:47 PM
awight updated the task description. (Show Details)
• fdans removed a project: Analytics.Sep 21 2017, 4:37 PM
Zppix moved this task from Unsorted to Maintenance/cleanup on the Machine-Learning-Team board.Oct 8 2017, 7:21 PM
Halfak subscribed.Oct 9 2017, 9:07 PM

I believe that overload errors don't count as "errored scores" because the score job hasn't started yet. Does this make the data make sense. Maybe we should rename the variable or just add the two together for "scores errored".

awight closed this task as Resolved.Nov 21 2017, 3:54 PM
awight moved this task from Maintenance/cleanup to Active Tasks on the Machine-Learning-Team board.
awight edited projects, added Machine-Learning-Team (Active Tasks); removed Machine-Learning-Team.
awight moved this task from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.
awight added a comment.Nov 21 2017, 4:24 PM

@Halfak I see what you mean. The moving window was my biggest gripe, but we can reopen if the the graphs are hard to interpret the next time we need them.

awight mentioned this in Blog Post: Status Update (January 30, 2018).Jan 30 2018, 7:03 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL