Page MenuHomePhabricator

Grant Access to OIT to store time series data in Graphite and Access Graphana Dashboards
Closed, DeclinedPublic

Description

IT has been prototyping storing some time series data in graphite with some handy dashboards in graphana (<100 metrics, <10 dashboards)
I did this myself for a short while, and then moved to a hosted service (hostedgraphite) for more prototyping.

I'd like to ask if graphite can be setup as a service for other departments looking to use it.

Cheers,

Joel Krauska

Event Timeline

JKrauska raised the priority of this task from to Needs Triage.
JKrauska updated the task description. (Show Details)
JKrauska added a project: acl*sre-team.
JKrauska added a subscriber: JKrauska.
Restricted Application added subscribers: Matanya, Aklapper. · View Herald TranscriptAug 14 2015, 12:43 AM
Krenair added a project: SRE-Access-Requests.
Krenair added a subscriber: Krenair.
faidon closed this task as Declined.Aug 14 2015, 11:17 AM
faidon claimed this task.
faidon added a subscriber: faidon.

I think there are good reasons to keep the production and OIT infrastructures separate. Such moves create unnecessary ties in my opinion and we should avoid it. (For similar reasons, Labs has its own Graphite install and does not use production's).

Setting up Graphite/Grafana in the OIT domain shouldn't be too hard. You can reuse our puppet manifests if you want, although these may be an overkill for your use case :)

Thanks for the quick response.

It's much simpler for IT to continue using the hosted solution. We will keep doing that.

I am hopeful that Ops Infrastructure will consider modeling future systems in more of a service-oriented direction for all teams/departments.

Best,

Joel

Krenair added a comment.EditedAug 14 2015, 5:16 PM

Are there any servers owned by WMF that aren't either in production datacentres or run by Office IT in SF? It sounds like almost everyone working on technical things at WMF has access (or can easily get access after approval and agreement of ops etc.) to production graphite already.

@Krenair : I'm not aware of other 'WMF' servers.
One concern is perhaps access to current stats vs being able to create new stats and dashboards on the fly? I certainly want to have our own stats and dashboards for our own metric tracking.

@faidon: Krenair says 'almost anyone' can have access. :)

@faidon: Krenair says 'almost anyone' can have access. :)

@faidon has actual authority over this sort of thing, I do not. I'm just puzzled by your "I am hopeful that Ops Infrastructure will consider modeling future systems in more of a service-oriented direction for all teams/departments." comment.
My understanding is that things in production infrastructure should be able to access production graphite, and it seems very easy for people in WMF to get their code into production where they could take advantage of this, so I don't see an issue.