Currently if you want to see what is pooled and what is not (and what are the percentages), you'd have to know the service's name and then go to somewhere like https://config-master.wikimedia.org/pybal/eqiad/appservers-https to see how many are pooled/depooled. Providing a json output for all services of a datacenter makes it easier to build a simple GUI app which could be quite beneficial during outages (like https://wikitech.wikimedia.org/wiki/Incidents/2023-02-22_wiki_outage)
Description
Description
Details
Details
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| profile::configmaster: dump a json data structure of the pools | operations/puppet | production | +105 -0 |
Related Objects
Related Objects
- Mentioned Here
- T327300: Cookbook for rack depool
Event Timeline
Comment Actions
I wonder if it's possible to do the same for dbctl too while it's not in config-master (or I couldn't find it)
Comment Actions
This would also be useful if we were looking to create automation to depool / pool certain racks or rows for maintenance, an idea that's been discussed in T327300.
Comment Actions
@Ladsgroup what do you need besides
$ confctl select 'dc=codfw' get which you can then pipe to jq to get whatever you want?
Declining for now, feel free to add more specific requests if you have any.
Comment Actions
That is great and sorta exactly what I need but I need it publicly or half-publicly accessible in https://config-master.wikimedia.org. Something like https://config-master.wikimedia.org/pybal/codfw.json. Then I can build a gui in toolforge to show you all services with their health status as an overview, so you'd quickly be able to spot a service is mistakenly fully depooled or if depooling of all services in a rack/row has led to a service being dangerously low capacity.
Comment Actions
After talking to Joe, we decided to reopen it. We need something in web to build data visualizations.
Comment Actions
Change 921692 had a related patch set uploaded (by Giuseppe Lavagetto; author: Giuseppe Lavagetto):
[operations/puppet@production] profile::configmaster: dump a json data structure of the pools
Comment Actions
Change 921692 merged by Giuseppe Lavagetto:
[operations/puppet@production] profile::configmaster: dump a json data structure of the pools