Page MenuHomePhabricator
Create Task
Maniphest T254910

Metrics and dashboards for API Gateway
Closed, ResolvedPublic
Actions

Description

Description
Provide metrics and dashboards to monitor and assess API Gateway

Done Criteria

  • Sufficient metrics are gathered from Envoy instances via Prometheus
  • Dashboard are built and available to provide insight into metrics from Envoy API Gateway

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
api-gateway: Fix syntax in metrics gatheringoperations/deployment-chartsmaster+4 -4
api-gateway: Add mappings for ratelimit serviceoperations/deployment-chartsmaster+24 -61
api-gateway: Use envoyproxy.io annotation for metrics gathering.operations/deployment-chartsmaster+9 -4
api-gateway: expose port for admin interfaceoperations/deployment-chartsmaster+16 -11
api-gateway: Collect metricsoperations/deployment-chartsmaster+30 -4
Customize query in gerrit

Related Objects
Search...

Event Timeline

• WDoranWMF created this task.Jun 9 2020, 4:24 PM
• WDoranWMF triaged this task as Medium priority.Jun 9 2020, 4:44 PM
• WDoranWMF edited projects, added Platform Team Workboards (Green); removed Platform Team Workboards (Epics).
• WDoranWMF moved this task from Backlog to Tasks Ready for Estimation on the Platform Team Workboards (Green) board.Jun 10 2020, 12:21 AM
• eprodromou added a comment.Jun 10 2020, 2:54 PM

Is this for product-level metrics, like how many hits to the service and by whom? Or administrative metrics, like resources used and uptime?

hnowlan added a comment.Jun 29 2020, 10:52 AM

Administrative, so that we can ascertain service health and performance

hnowlan moved this task from Tasks Ready for Estimation to Ready on the Platform Team Workboards (Green) board.Jul 8 2020, 4:13 PM
• WDoranWMF added a project: Platform Team Sprints Board (Sprint 0).Jul 17 2020, 7:45 PM
• WDoranWMF moved this task from Ready to Next Sprint on the Platform Team Workboards (Green) board.Aug 6 2020, 6:06 PM
Naike edited projects, added Platform Team Sprints Board (Sprint 1); removed Platform Team Sprints Board (Sprint 0).Aug 7 2020, 10:35 AM
hnowlan claimed this task.Aug 27 2020, 3:50 PM
hnowlan moved this task from Next Sprint to Ready on the Platform Team Workboards (Green) board.
gerritbot added a comment.Aug 28 2020, 4:11 PM

Change 623012 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/deployment-charts@master] api-gateway: Collect metrics

https://gerrit.wikimedia.org/r/623012

gerritbot added a project: Patch-For-Review.Aug 28 2020, 4:11 PM
gerritbot added a comment.Aug 31 2020, 10:23 AM

Change 623012 merged by jenkins-bot:
[operations/deployment-charts@master] api-gateway: Collect metrics

https://gerrit.wikimedia.org/r/623012

Maintenance_bot removed a project: Patch-For-Review.Aug 31 2020, 11:11 AM
gerritbot added a comment.Aug 31 2020, 2:57 PM

Change 623399 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/deployment-charts@master] api-gateway: expose port for admin interface

https://gerrit.wikimedia.org/r/623399

gerritbot added a project: Patch-For-Review.Aug 31 2020, 2:57 PM
gerritbot added a comment.Aug 31 2020, 4:53 PM

Change 623399 merged by jenkins-bot:
[operations/deployment-charts@master] api-gateway: expose port for admin interface

https://gerrit.wikimedia.org/r/623399

Maintenance_bot removed a project: Patch-For-Review.Aug 31 2020, 5:11 PM
gerritbot added a comment.Sep 1 2020, 10:29 AM

Change 623568 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/deployment-charts@master] api-gateway: Use envoyproxy.io annotation for metrics gathering.

https://gerrit.wikimedia.org/r/623568

gerritbot added a project: Patch-For-Review.Sep 1 2020, 10:29 AM
gerritbot added a comment.Sep 1 2020, 10:33 AM

Change 623568 merged by jenkins-bot:
[operations/deployment-charts@master] api-gateway: Use envoyproxy.io annotation for metrics gathering.

https://gerrit.wikimedia.org/r/623568

Maintenance_bot removed a project: Patch-For-Review.Sep 1 2020, 11:11 AM
gerritbot added a comment.Sep 1 2020, 5:54 PM

Change 623624 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/deployment-charts@master] api-gateway: Add mappings for ratelimit service

https://gerrit.wikimedia.org/r/623624

gerritbot added a project: Patch-For-Review.Sep 1 2020, 5:54 PM
• WDoranWMF moved this task from Ready to Doing on the Platform Team Workboards (Green) board.Sep 2 2020, 3:36 PM
gerritbot added a comment.Sep 3 2020, 9:15 AM

Change 623624 merged by jenkins-bot:
[operations/deployment-charts@master] api-gateway: Add mappings for ratelimit service

https://gerrit.wikimedia.org/r/623624

Maintenance_bot removed a project: Patch-For-Review.Sep 3 2020, 10:11 AM
gerritbot added a comment.Sep 3 2020, 10:22 AM

Change 624006 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/deployment-charts@master] api-gateway: Fix syntax in metrics gathering

https://gerrit.wikimedia.org/r/624006

gerritbot added a project: Patch-For-Review.Sep 3 2020, 10:22 AM
gerritbot added a comment.Sep 3 2020, 10:31 AM

Change 624006 merged by jenkins-bot:
[operations/deployment-charts@master] api-gateway: Fix syntax in metrics gathering

https://gerrit.wikimedia.org/r/624006

Maintenance_bot removed a project: Patch-For-Review.Sep 3 2020, 11:10 AM
hnowlan added a comment.Sep 3 2020, 1:25 PM

Dashboard is at https://grafana.wikimedia.org/d/UOH-5IDMz/api-gateway?orgId=1&refresh=30s

hnowlan added a comment.Sep 7 2020, 3:01 PM

Dashboard is looking okay, this is 90% done. Moving to blocked until T235277 is unblocked - can't graph non-anonymous keys until we have actual usage metrics.

hnowlan moved this task from Doing to Blocked on the Platform Team Workboards (Green) board.Sep 7 2020, 3:01 PM
hnowlan updated the task description. (Show Details)Sep 14 2020, 9:34 AM
hnowlan moved this task from Blocked to Waiting for Review on the Platform Team Workboards (Green) board.
hnowlan closed this task as Resolved.Sep 14 2020, 10:14 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits