Page MenuHomePhabricator
Create Task
Maniphest T191994

Move coal and navtiming out of puppet
Closed, ResolvedPublic
Actions

Description

It's a PITA having to go through the puppet merge process in order to deploy changes to our utilities. We should move them out of puppet, and make them deployable on their own.

Details

SubjectRepoBranchLines +/-
navtiming: bulk up docs a tiny bit, also fix a log messageperformance/navtimingmaster+10 -1
navtiming: try reading config from an ini fileperformance/navtimingmaster+78 -19
navtiming: Add etcd code, allowing us to run only in the master dcperformance/navtimingmaster+78 -3
coal: remove files that aren't needed any longeroperations/puppetproduction+0 -641
graphite: allow data requests from performance.wikimedia.orgoperations/puppetproduction+2 -1
coal: revert coal-web back to what it wasperformance/coalmaster+99 -105
coal: Point systemd and uwsgi config to scap-deployed versionoperations/puppetproduction+28 -22
coal: incorporate etcd to test for master datacenterperformance/coalmaster+83 -2
coal: restart the coal website process as wellperformance/coalmaster+1 -1
graphite: add a specific retention rule for coal metricsoperations/puppetproduction+6 -0
navtiming: Actually rename READMEperformance/navtimingmaster+5 -4
navtiming: Rename README, create a manifest file so that things workperformance/navtimingmaster+3 -3
coal: actually rename READMEperformance/coalmaster+5 -4
navtiming: Move README, add linksperformance/navtimingmaster+4 -2
coal: move README to README.md, add link to contributor infoperformance/coalmaster+4 -3
coal: Forgot to change the import after moving thingsperformance/coalmaster+1 -1
coal: add a run file, slight refactor to simplify runperformance/coalmaster+486 -502
navtiming.py: now deployed via scapoperations/puppetproduction+2 -2
navtiming: Refactor for testing, operabilityperformance/navtimingmaster+609 -581
navtiming: null edit to verify scap deployperformance/navtimingmaster+2 -1
coal: add scap dir and configperformance/coalmaster+8 -0
navtiming: don't typo the repo nameperformance/navtimingmaster+1 -1
navtiming: add scap.cfgperformance/navtimingmaster+7 -0
webperf and coal: add scap_target stanzasoperations/puppetproduction+10 -0
integration/config: add new perf repos to zuul layoutintegration/configmaster+8 -0
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

• Imarlier created this task.Apr 11 2018, 3:59 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 11 2018, 3:59 PM
• Imarlier moved this task from Inbox, needs triage to Doing (old) on the Performance-Team board.Apr 11 2018, 3:59 PM
gerritbot subscribed.Apr 11 2018, 3:59 PM

Change 425551 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[integration/config@master] integration/config: add new perf repos to zuul layout

https://gerrit.wikimedia.org/r/425551

gerritbot added a project: Patch-For-Review.Apr 11 2018, 3:59 PM
Krinkle added a parent task: T158837: Consolidate performance website and related software.Apr 11 2018, 4:08 PM
gerritbot added a comment.Apr 11 2018, 4:34 PM

Change 425551 merged by jenkins-bot:
[integration/config@master] integration/config: add new perf repos to zuul layout

https://gerrit.wikimedia.org/r/425551

gerritbot added a comment.Apr 13 2018, 4:35 PM

Change 426107 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: add scap.cfg

https://gerrit.wikimedia.org/r/426107

gerritbot added a comment.Apr 13 2018, 4:47 PM

Change 426112 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[operations/puppet@production] webperf and coal: add scap_target stanzas

https://gerrit.wikimedia.org/r/426112

• Imarlier triaged this task as Medium priority.Apr 13 2018, 4:56 PM
gerritbot added a comment.Apr 13 2018, 5:49 PM

Change 426112 merged by Dzahn:
[operations/puppet@production] webperf and coal: add scap_target stanzas

https://gerrit.wikimedia.org/r/426112

gerritbot added a comment.Apr 13 2018, 6:10 PM

Change 426107 merged by jenkins-bot:
[performance/navtiming@master] navtiming: add scap.cfg

https://gerrit.wikimedia.org/r/426107

gerritbot added a comment.Apr 13 2018, 6:15 PM

Change 426128 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: don't typo the repo name

https://gerrit.wikimedia.org/r/426128

gerritbot added a comment.Apr 13 2018, 6:16 PM

Change 426128 merged by jenkins-bot:
[performance/navtiming@master] navtiming: don't typo the repo name

https://gerrit.wikimedia.org/r/426128

gerritbot added a comment.Apr 13 2018, 6:27 PM

Change 426131 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: add scap dir and config

https://gerrit.wikimedia.org/r/426131

gerritbot added a comment.Apr 13 2018, 6:31 PM

Change 426131 merged by jenkins-bot:
[performance/coal@master] coal: add scap dir and config

https://gerrit.wikimedia.org/r/426131

gerritbot added a comment.Apr 13 2018, 8:49 PM

Change 426236 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: null edit to verify scap deploy

https://gerrit.wikimedia.org/r/426236

gerritbot added a comment.Apr 13 2018, 8:51 PM

Change 426236 merged by jenkins-bot:
[performance/navtiming@master] navtiming: null edit to verify scap deploy

https://gerrit.wikimedia.org/r/426236

fgiunchedi subscribed.Apr 16 2018, 8:17 AM
gerritbot added a comment.Apr 16 2018, 6:01 PM

Change 426961 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: Refactor for testing, operability

https://gerrit.wikimedia.org/r/426961

gerritbot added a comment.Apr 17 2018, 5:47 PM

Change 426961 merged by jenkins-bot:
[performance/navtiming@master] navtiming: Refactor for testing, operability

https://gerrit.wikimedia.org/r/426961

gerritbot added a comment.Apr 17 2018, 7:12 PM

Change 427192 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[operations/puppet@production] navtiming.py: now deployed via scap

https://gerrit.wikimedia.org/r/427192

gerritbot added a comment.Apr 17 2018, 11:52 PM

Change 427192 merged by Dzahn:
[operations/puppet@production] navtiming.py: now deployed via scap

https://gerrit.wikimedia.org/r/427192

gerritbot added a comment.Apr 18 2018, 5:51 PM

Change 427456 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: add a run file, slight refactor to simplify run

https://gerrit.wikimedia.org/r/427456

gerritbot added a comment.Apr 18 2018, 6:14 PM

Change 427456 merged by jenkins-bot:
[performance/coal@master] coal: add a run file, slight refactor to simplify run

https://gerrit.wikimedia.org/r/427456

gerritbot added a comment.Apr 18 2018, 6:20 PM

Change 427461 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: Forgot to change the import after moving things

https://gerrit.wikimedia.org/r/427461

gerritbot added a comment.Apr 18 2018, 6:24 PM

Change 427461 merged by jenkins-bot:
[performance/coal@master] coal: Forgot to change the import after moving things

https://gerrit.wikimedia.org/r/427461

Krinkle subscribed.Apr 18 2018, 7:06 PM

I've enabled GitHub replication:

This made me look at the original repo viewer in Gerrit, and noticed we're missing a README currently. Actually, it seems it does exist, but needs to be renamed to .md for Gerrit and GitHub to render them.

Also while at it, we should make sure to include a link to https://www.mediawiki.org/wiki/Developer_access and https://phabricator.wikimedia.org/tag/performance-team/.

gerritbot added a comment.Apr 18 2018, 8:12 PM

Change 427529 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: move README to README.md, add link to contributor info

https://gerrit.wikimedia.org/r/427529

gerritbot added a comment.Apr 18 2018, 8:15 PM

Change 427530 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: Move README, add links

https://gerrit.wikimedia.org/r/427530

gerritbot added a comment.Apr 18 2018, 8:36 PM

Change 427529 merged by jenkins-bot:
[performance/coal@master] coal: move README to README.md, add link to contributor info

https://gerrit.wikimedia.org/r/427529

gerritbot added a comment.Apr 18 2018, 8:40 PM

Change 427537 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: actually rename README

https://gerrit.wikimedia.org/r/427537

gerritbot added a comment.Apr 18 2018, 8:41 PM

Change 427530 merged by jenkins-bot:
[performance/navtiming@master] navtiming: Move README, add links

https://gerrit.wikimedia.org/r/427530

gerritbot added a comment.Apr 18 2018, 8:47 PM

Change 427539 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: Actually rename README

https://gerrit.wikimedia.org/r/427539

gerritbot added a comment.Apr 18 2018, 8:47 PM

Change 427540 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: Rename README, create a manifest file so that things work

https://gerrit.wikimedia.org/r/427540

gerritbot added a comment.Apr 18 2018, 8:48 PM

Change 427537 merged by jenkins-bot:
[performance/coal@master] coal: actually rename README

https://gerrit.wikimedia.org/r/427537

gerritbot added a comment.Apr 18 2018, 8:50 PM

Change 427540 abandoned by Imarlier:
navtiming: Rename README, create a manifest file so that things work

Reason:
didn't squash commits

https://gerrit.wikimedia.org/r/427540

gerritbot added a comment.Apr 18 2018, 8:54 PM

Change 427539 merged by jenkins-bot:
[performance/navtiming@master] navtiming: Actually rename README

https://gerrit.wikimedia.org/r/427539

gerritbot added a comment.Apr 20 2018, 6:17 PM

Change 427945 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[operations/puppet@production] graphite: add a specific retention rule for coal metrics

https://gerrit.wikimedia.org/r/427945

gerritbot added a comment.Apr 20 2018, 6:27 PM

Change 427945 merged by Dzahn:
[operations/puppet@production] graphite: add a specific retention rule for coal metrics

https://gerrit.wikimedia.org/r/427945

gerritbot added a comment.Apr 20 2018, 7:49 PM

Change 427958 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: incorporate etcd to test for master datacenter

https://gerrit.wikimedia.org/r/427958

gerritbot added a comment.Apr 20 2018, 8:09 PM

Change 427962 had a related patch set uploaded (by Krinkle; owner: Krinkle):
[performance/navtiming@master] docs: Add install/test instructions to the README

https://gerrit.wikimedia.org/r/427962

gerritbot added a comment.Apr 24 2018, 3:03 PM

Change 428659 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[operations/puppet@production] coal: Point systemd and uwsgi config to scap-deployed version

https://gerrit.wikimedia.org/r/428659

gerritbot added a comment.Apr 24 2018, 3:49 PM

Change 428668 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: restart the coal website process as well

https://gerrit.wikimedia.org/r/428668

gerritbot added a comment.Apr 24 2018, 3:54 PM

Change 428668 merged by jenkins-bot:
[performance/coal@master] coal: restart the coal website process as well

https://gerrit.wikimedia.org/r/428668

gerritbot added a comment.Apr 24 2018, 9:18 PM

Change 428836 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[operations/puppet@production] graphite: allow data requests from performance.wikimedia.org

https://gerrit.wikimedia.org/r/428836

gerritbot added a comment.Apr 25 2018, 1:00 AM

Change 427958 merged by jenkins-bot:
[performance/coal@master] coal: incorporate etcd to test for master datacenter

https://gerrit.wikimedia.org/r/427958

gerritbot added a comment.Apr 25 2018, 6:08 PM

Change 428659 merged by Herron:
[operations/puppet@production] coal: Point systemd and uwsgi config to scap-deployed version

https://gerrit.wikimedia.org/r/428659

gerritbot added a comment.Apr 25 2018, 6:48 PM

Change 428978 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: revert coal-web back to what it was

https://gerrit.wikimedia.org/r/428978

gerritbot added a comment.Apr 25 2018, 6:53 PM

Change 428978 merged by jenkins-bot:
[performance/coal@master] coal: revert coal-web back to what it was

https://gerrit.wikimedia.org/r/428978

gerritbot added a comment.Apr 25 2018, 7:01 PM

Change 428980 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[operations/puppet@production] coal: remove files that aren't needed any longer

https://gerrit.wikimedia.org/r/428980

gerritbot added a comment.Apr 25 2018, 7:39 PM

Change 428836 merged by Ottomata:
[operations/puppet@production] graphite: allow data requests from performance.wikimedia.org

https://gerrit.wikimedia.org/r/428836

gerritbot added a comment.Apr 26 2018, 7:21 PM

Change 429263 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: Add etcd code, allowing us to run only in the master dc

https://gerrit.wikimedia.org/r/429263

gerritbot added a comment.Apr 26 2018, 11:38 PM

Change 428980 merged by Dzahn:
[operations/puppet@production] coal: remove files that aren't needed any longer

https://gerrit.wikimedia.org/r/428980

gerritbot added a comment.Apr 27 2018, 3:18 PM

Change 429263 merged by jenkins-bot:
[performance/navtiming@master] navtiming: Add etcd code, allowing us to run only in the master dc

https://gerrit.wikimedia.org/r/429263

gerritbot added a comment.Apr 27 2018, 4:04 PM

Change 429445 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: try reading config from an ini file

https://gerrit.wikimedia.org/r/429445

gerritbot added a comment.Apr 27 2018, 4:12 PM

Change 429445 merged by jenkins-bot:
[performance/navtiming@master] navtiming: try reading config from an ini file

https://gerrit.wikimedia.org/r/429445

gerritbot added a comment.Apr 27 2018, 5:51 PM

Change 429459 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/navtiming@master] navtiming: bulk up docs a tiny bit, also fix a log message

https://gerrit.wikimedia.org/r/429459

gerritbot added a comment.Apr 27 2018, 6:10 PM

Change 429462 had a related patch set uploaded (by Imarlier; owner: Imarlier):
[performance/coal@master] coal: use an ini config file stored in the repo

https://gerrit.wikimedia.org/r/429462

gerritbot added a comment.Apr 27 2018, 6:22 PM

Change 429459 merged by jenkins-bot:
[performance/navtiming@master] navtiming: bulk up docs a tiny bit, also fix a log message

https://gerrit.wikimedia.org/r/429459

• Imarlier closed this task as Resolved.Apr 30 2018, 7:17 PM

Opening a new task to track adding ini settings

Krinkle mentioned this in T193570: Why did first paint/fully loaded time drop (in a good way!) on mobile?.May 3 2018, 8:41 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits