Page MenuHomePhabricator
Create Task
Maniphest T265990

orchestrator: Puppetize
Closed, ResolvedPublic
Actions

Description

Orchestrator should be running in a ganeti VM with access to production database hosts. The install should be fully managed by puppet.

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
idp: Allow wmf or nda have access to orchestratorLadsgroupoperations/puppetproduction+2 -0
alerting: Disable screen/tmux monitoring on orchestrator hostsJcrespooperations/puppetproduction+1 -0
orchestrator.conf: Add PromotionIgnoreHostnameFiltersMarosteguioperations/puppetproduction+7 -0
orchestrator.conf: Decrease ReasonableMaintenanceReplicationLagSecondsMarosteguioperations/puppetproduction+1 -0
orchestrator.conf: Enable Audit messages to syslog.Marosteguioperations/puppetproduction+1 -0
orchestrator: Search both eqiad and codfw dnsKormatoperations/puppetproduction+3 -0
orchestrator: Install mariadb clientKormatoperations/puppetproduction+1 -0
orchestrator.conf: Change RecoveryPeriodBlockSeconds defaultMarosteguioperations/puppetproduction+2 -1
orchestrator.conf.json: Add some failover optionsMarosteguioperations/puppetproduction+4 -1
orchestrator: Add topology querying config.Marosteguioperations/puppetproduction+24 -2
hiera: Add fake db topology password for orchestratorKormatlabs/privatemaster+1 -0
orchestrator.conf: Add a bunch of optionsMarosteguioperations/puppetproduction+9 -1
dborch1001.yaml: Clarify what this host isMarosteguioperations/puppetproduction+1 -0
orchestrator.conf.json.erb: Do not listen on localhostMarosteguioperations/puppetproduction+1 -1
orchestrator: Set ReadOnlyKormatoperations/puppetproduction+1 -0
orchestrator: Fix credentials config pathKormatoperations/puppetproduction+1 -1
orchestrator: Drop trailing commaKormatoperations/puppetproduction+1 -1
mariadb: Document orchestrator backend db grantsKormatoperations/puppetproduction+4 -0
orchestrator: Add basic configKormatoperations/puppetproduction+53 -3
hiera: move orchestrator.yaml to correct dir.Kormatlabs/privatemaster+0 -0
hiera: Add fake db backend password for orchestratorKormatlabs/privatemaster+1 -0
orchestrator: Add very basic role/profile/module.Kormatoperations/puppetproduction+28 -1
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

• Kormat created this task.Oct 20 2020, 10:53 AM
• Kormat triaged this task as Medium priority.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 20 2020, 10:53 AM
• Kormat added a subtask: T265982: eqiad: New ganeti instance for orchestrator installation.Oct 20 2020, 10:54 AM
• Kormat renamed this task from Puppetize orchestrator to orchestrator: Puppetize .Oct 20 2020, 12:56 PM
LSobanski moved this task from Triage to Refine on the DBA board.Oct 20 2020, 1:19 PM
Marostegui closed subtask T265982: eqiad: New ganeti instance for orchestrator installation as Resolved.Oct 21 2020, 10:46 AM
Marostegui mentioned this in T265982: eqiad: New ganeti instance for orchestrator installation.
gerritbot added a comment.Oct 23 2020, 10:11 AM

Change 635988 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] orchestrator: Add very basic role/profile/module.

https://gerrit.wikimedia.org/r/635988

gerritbot added a project: Patch-For-Review.Oct 23 2020, 10:11 AM
gerritbot added a comment.Oct 23 2020, 10:25 AM

Change 635988 merged by Kormat:
[operations/puppet@production] orchestrator: Add very basic role/profile/module.

https://gerrit.wikimedia.org/r/635988

Maintenance_bot removed a project: Patch-For-Review.Oct 23 2020, 11:10 AM
gerritbot added a comment.Oct 23 2020, 1:11 PM

Change 636014 had a related patch set uploaded (by Kormat; owner: Kormat):
[labs/private@master] hiera: Add fake db backend password for orchestrator

https://gerrit.wikimedia.org/r/636014

gerritbot added a project: Patch-For-Review.Oct 23 2020, 1:11 PM
gerritbot added a comment.Oct 23 2020, 1:13 PM

Change 636015 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] orchestrator: Add basic config

https://gerrit.wikimedia.org/r/636015

gerritbot added a comment.Oct 23 2020, 1:16 PM

Change 636014 merged by Kormat:
[labs/private@master] hiera: Add fake db backend password for orchestrator

https://gerrit.wikimedia.org/r/636014

• Kormat mentioned this in rLPRI6a051289b1cc: hiera: Add fake db backend password for orchestrator.Oct 23 2020, 1:21 PM
gerritbot added a comment.Oct 23 2020, 1:28 PM

Change 636019 had a related patch set uploaded (by Kormat; owner: Kormat):
[labs/private@master] hiera: move orchestrator.yaml to correct dir.

https://gerrit.wikimedia.org/r/636019

gerritbot added a comment.Oct 23 2020, 1:33 PM

Change 636019 merged by Kormat:
[labs/private@master] hiera: move orchestrator.yaml to correct dir.

https://gerrit.wikimedia.org/r/636019

• Kormat mentioned this in rLPRI95f2ff48f555: hiera: move orchestrator.yaml to correct dir..Oct 23 2020, 1:35 PM
gerritbot added a comment.Oct 23 2020, 1:48 PM

Change 636015 merged by Kormat:
[operations/puppet@production] orchestrator: Add basic config

https://gerrit.wikimedia.org/r/636015

gerritbot added a comment.Oct 23 2020, 2:06 PM

Change 636031 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] mariadb: Document orchestrator backend db grants

https://gerrit.wikimedia.org/r/636031

gerritbot added a comment.Oct 23 2020, 2:12 PM

Change 636031 merged by Kormat:
[operations/puppet@production] mariadb: Document orchestrator backend db grants

https://gerrit.wikimedia.org/r/636031

gerritbot added a comment.Oct 23 2020, 2:15 PM

Change 636035 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] orchestrator: Drop trailing comma

https://gerrit.wikimedia.org/r/636035

gerritbot added a comment.Oct 23 2020, 2:15 PM

Change 636035 merged by Kormat:
[operations/puppet@production] orchestrator: Drop trailing comma

https://gerrit.wikimedia.org/r/636035

gerritbot added a comment.Oct 23 2020, 2:18 PM

Change 636036 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] orchestrator: Fix credentials config path

https://gerrit.wikimedia.org/r/636036

gerritbot added a comment.Oct 23 2020, 2:19 PM

Change 636036 merged by Kormat:
[operations/puppet@production] orchestrator: Fix credentials config path

https://gerrit.wikimedia.org/r/636036

gerritbot added a comment.Oct 23 2020, 2:35 PM

Change 636039 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] orchestrator: Set ReadOnly

https://gerrit.wikimedia.org/r/636039

gerritbot added a comment.Oct 23 2020, 2:37 PM

Change 636039 merged by Kormat:
[operations/puppet@production] orchestrator: Set ReadOnly

https://gerrit.wikimedia.org/r/636039

gerritbot added a comment.Oct 23 2020, 2:41 PM

Change 636041 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.conf.json.erb: Do not listen on localhost

https://gerrit.wikimedia.org/r/636041

gerritbot added a comment.Oct 23 2020, 2:55 PM

Change 636041 abandoned by Marostegui:
[operations/puppet@production] orchestrator.conf.json.erb: Do not listen on localhost

Reason:
PEBCAK

https://gerrit.wikimedia.org/r/636041

gerritbot added a comment.Oct 23 2020, 3:06 PM

Change 636052 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.sql: Track orchestrator grants for topology discovery

https://gerrit.wikimedia.org/r/636052

gerritbot added a comment.Oct 26 2020, 6:19 AM

Change 636233 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.conf: Add a bunch of options

https://gerrit.wikimedia.org/r/636233

gerritbot added a comment.Oct 26 2020, 6:32 AM

Change 636234 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dborch1001.yaml: Clarify what this host is

https://gerrit.wikimedia.org/r/636234

gerritbot added a comment.Oct 26 2020, 6:34 AM

Change 636234 merged by Marostegui:
[operations/puppet@production] dborch1001.yaml: Clarify what this host is

https://gerrit.wikimedia.org/r/636234

gerritbot added a comment.Oct 26 2020, 10:22 AM

Change 636233 merged by Marostegui:
[operations/puppet@production] orchestrator.conf: Add a bunch of options

https://gerrit.wikimedia.org/r/636233

gerritbot added a comment.Oct 26 2020, 10:37 AM

Change 636387 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.conf.json: Add some failover options

https://gerrit.wikimedia.org/r/636387

gerritbot added a comment.Oct 26 2020, 2:07 PM

Change 636422 had a related patch set uploaded (by Kormat; owner: Kormat):
[labs/private@master] hiera: Add fake db topology password for orchestrator

https://gerrit.wikimedia.org/r/636422

gerritbot added a comment.Oct 26 2020, 2:22 PM

Change 636422 merged by Kormat:
[labs/private@master] hiera: Add fake db topology password for orchestrator

https://gerrit.wikimedia.org/r/636422

• Kormat mentioned this in rLPRI4088f170c38c: hiera: Add fake db topology password for orchestrator.Oct 26 2020, 2:32 PM
gerritbot added a comment.Oct 26 2020, 2:39 PM

Change 636052 merged by Kormat:
[operations/puppet@production] orchestrator: Add topology querying config.

https://gerrit.wikimedia.org/r/636052

gerritbot added a comment.Oct 26 2020, 2:42 PM

Change 636387 merged by Marostegui:
[operations/puppet@production] orchestrator.conf.json: Add some failover options

https://gerrit.wikimedia.org/r/636387

gerritbot added a comment.Oct 27 2020, 7:01 AM

Change 636558 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.conf: Change RecoveryPeriodBlockSeconds default

https://gerrit.wikimedia.org/r/636558

gerritbot added a comment.Oct 27 2020, 8:34 AM

Change 636558 merged by Marostegui:
[operations/puppet@production] orchestrator.conf: Change RecoveryPeriodBlockSeconds default

https://gerrit.wikimedia.org/r/636558

gerritbot added a comment.Oct 27 2020, 9:15 AM

Change 636613 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] orchestrator: Search both eqiad and codfw dns

https://gerrit.wikimedia.org/r/636613

gerritbot added a comment.Oct 27 2020, 9:23 AM

Change 636616 had a related patch set uploaded (by Kormat; owner: Kormat):
[operations/puppet@production] orchestrator: Install mariadb client

https://gerrit.wikimedia.org/r/636616

Marostegui closed subtask T266023: orchestrator: Get packages into WMF apt as Resolved.Oct 28 2020, 8:50 AM
Marostegui added a project: Orchestrator.Oct 28 2020, 9:17 AM
gerritbot added a comment.Oct 28 2020, 9:29 AM

Change 636616 merged by Kormat:
[operations/puppet@production] orchestrator: Install mariadb client

https://gerrit.wikimedia.org/r/636616

gerritbot added a comment.Oct 28 2020, 9:29 AM

Change 636613 merged by Kormat:
[operations/puppet@production] orchestrator: Search both eqiad and codfw dns

https://gerrit.wikimedia.org/r/636613

gerritbot added a comment.Oct 30 2020, 6:15 AM

Change 637596 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.conf: Enable Audit messages to syslog.

https://gerrit.wikimedia.org/r/637596

gerritbot added a comment.Oct 30 2020, 9:05 AM

Change 637596 merged by Marostegui:
[operations/puppet@production] orchestrator.conf: Enable Audit messages to syslog.

https://gerrit.wikimedia.org/r/637596

Marostegui closed subtask T266003: orchestrator: Select backend database solution as Resolved.Oct 30 2020, 11:21 AM
• Kormat closed subtask T267113: Orchestrator binary needs version embedded as Resolved.Nov 3 2020, 1:14 PM
gerritbot added a comment.Nov 6 2020, 7:12 AM

Change 639670 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.conf: Add PromotionIgnoreHostnameFilters

https://gerrit.wikimedia.org/r/639670

gerritbot added a comment.Nov 6 2020, 10:17 AM

Change 639739 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] orchestrator.conf: Decrease ReasonableMaintenanceReplicationLagSeconds

https://gerrit.wikimedia.org/r/639739

gerritbot added a comment.Nov 6 2020, 12:31 PM

Change 639739 merged by Marostegui:
[operations/puppet@production] orchestrator.conf: Decrease ReasonableMaintenanceReplicationLagSeconds

https://gerrit.wikimedia.org/r/639739

gerritbot added a comment.Nov 6 2020, 12:44 PM

Change 639670 merged by Marostegui:
[operations/puppet@production] orchestrator.conf: Add PromotionIgnoreHostnameFilters

https://gerrit.wikimedia.org/r/639670

Marostegui moved this task from Refine to Meta/Epic on the DBA board.Nov 10 2020, 2:53 PM
gerritbot added a comment.Dec 9 2020, 5:41 PM

Change 647319 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] alerting: Disable screen/tmux monitoring on orchestrator hosts

https://gerrit.wikimedia.org/r/647319

gerritbot added a comment.Dec 10 2020, 9:41 AM

Change 647319 merged by Kormat:
[operations/puppet@production] alerting: Disable screen/tmux monitoring on orchestrator hosts

https://gerrit.wikimedia.org/r/647319

• Kormat closed subtask T266106: orchestrator: Support SSO as Resolved.Jan 19 2021, 4:18 PM
Marostegui removed a project: SRE.May 24 2021, 12:24 PM
Marostegui closed subtask T266338: orchestrator: Add service monitoring as Resolved.Jun 4 2021, 5:34 AM
gerritbot added a comment.Nov 10 2021, 2:51 PM

Change 737926 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/puppet@production] idp: Allow wmf or nda have access to orchestrator

https://gerrit.wikimedia.org/r/737926

gerritbot added a comment.Nov 11 2021, 2:28 PM

Change 737926 merged by Ladsgroup:

[operations/puppet@production] idp: Allow wmf or nda have access to orchestrator

https://gerrit.wikimedia.org/r/737926

Pppery removed a project: Patch-For-Review.Nov 10 2025, 5:03 AM
Marostegui added subscribers: FCeratto-WMF, Marostegui.Feb 27 2026, 3:01 PM

@FCeratto-WMF when setting up dborch1002 and dborch1003 did you find something that wasn't automatically done by puppet? I don't mean the grants or things like that but the orchestrator host itself.

Marostegui closed this task as Resolved.Mar 2 2026, 1:13 PM
Marostegui claimed this task.

We discussed this and this can be closed.
The only pending thing to puppetize would be grants, but for obvious reasons we don't do that automatically.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits