Page MenuHomePhabricator

Rollout prometheus-node-exporter 0.14 in labs
Closed, ResolvedPublic

Description

We've got prometheus-node-exporter 0.14.0~git20170523-0 deployed in production that fixes a number of issues (lvs ipv6, qdisc collector, etc). It'd be nice to have it upgraded in labs / tools too, similarly as what was done in T152580: rollout prometheus-node-exporter 0.13

Event Timeline

• chasemp subscribed.

sounds good to me, let us know when you hit the Tools road block with aptly and one of us can untangle (i.e. this)

thanks! I think the version in aptly has been removed so we should be set for tools too, what's the best way I can run a command on all labs + tools ?

thanks! I think the version in aptly has been removed so we should be set for tools too, what's the best way I can run a command on all labs + tools ?

There is vanilla clush on tools-puppetmaster-02.tools.eqiad.wmflabs you can do something like clush -f 10 -g all 'foo' and for all of labs it's still salt on labcontrol1001 or a labs wide root running something from local atm. If salt seems to be missing too much @Andrew or I can do a root pass (his is better as a few weird edge instances may still only have his).

Did this ever happen? Mostly just curious :)

No it didn't happen, though if someone wants to pick it up please do!

fgiunchedi moved this task from Backlog to Doing on the User-fgiunchedi board.

I'll take care of this since we'll need some new collectors from node-exporter 0.14 as part of T177196

Mentioned in SAL (#wikimedia-operations) [2017-10-05T13:15:02Z] <godog> test upgrade node-exporter in thumbor/swift/services/puppet3-diffs/monitoring projects - T166561

All done! I've ran the upgrade with cumin, using the command below (see also
https://wikitech.wikimedia.org/wiki/Cumin#Upgrade_Debian_packages)

cumin -b 40 'A:all' 'DEBIAN_FRONTEND=noninteractive apt-get -q -y --assume-no -o DPkg::Options::="--force-confdef" -o DPkg::Options::="--force-confold" install prometheus-node-exporter