rebuild deployment-bastion on trusty
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	thcipriani
	Feb 10 2016, 9:35 PM

Description

Now that all deployment hosts have been updated to Trusty and deployment-bastion is lagging on Precise, it's time to rebuild.

P2597 set up deployment-tin.eqiad.wmflabs

1	cd /srv/mediawiki-staging/php-master/
2	rm -rf extensions
3	git clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions
4	cd extensions
5	git submodule update --init --recursive
6	cd ../
7	rm -rf skins
8	git clone https://gerrit.wikimedia.org/r/p/mediawiki/skins
9	git submodule update --init --recursive
10	mv /srv /mnt/srv
11	ln -s /mnt/srv /srv

Details

	Subject	Repo	Branch	Lines +/-
	Beta: Move deployment server	operations/puppet	production	+26 -21

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	thcipriani	T126573 Beta Cluster updates broken due to php incompatibilities
Resolved	thcipriani	T126537 rebuild deployment-bastion on trusty
Resolved	• chasemp	T126568 New labs instance fails running `block-for-project-export` before running mount

Event Timeline

thcipriani created this task.Feb 10 2016, 9:35 PM

thcipriani raised the priority of this task from to Needs Triage.

thcipriani updated the task description. (Show Details)

thcipriani added a project: Beta-Cluster-Infrastructure.

thcipriani added subscribers: thcipriani, hashar, Paladox and 2 others.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptFeb 10 2016, 9:35 PM

This is also causing breakage for the beta-scap-eqiad-job https://phabricator.wikimedia.org/P2588

Luke081515 subscribed.Feb 10 2016, 10:28 PM

• mmodell updated the task description. (Show Details)Feb 11 2016, 7:10 PM

• mmodell set Security to None.

• dduvall added a subtask: T115194: Some labs instances IP have multiple PTR entries in DNS.Feb 11 2016, 8:25 PM

greg added a parent task: T126573: Beta Cluster updates broken due to php incompatibilities.Feb 11 2016, 10:07 PM

greg added a subtask: T126568: New labs instance fails running `block-for-project-export` before running mount.

• dduvall removed a subtask: T115194: Some labs instances IP have multiple PTR entries in DNS.Feb 12 2016, 6:09 PM

Change 270343 had a related patch set uploaded (by Thcipriani):
Beta: Move bastion server

https://gerrit.wikimedia.org/r/270343

gerritbot added a project: Patch-For-Review.Feb 12 2016, 7:20 PM

• mmodell merged a task: T117504: Rebuild deployment master.Feb 12 2016, 7:31 PM

What we did

Updates to puppet

Replace all instances where deployment-bastion was hard-coded with deployment-tin
- same for IP (10.68.16.58 → 10.68.17.240)
Update deployment::redis to start on the public interface, not as a slave
Create a hiera file that only applies to deployment-tin to avoid mounting /data/project
- since it refused to mount: T126568
Change all git::clone titles for beta::autoupdater
- not sure how long they've been conflicting with scap::l10nupdate
- this prevented clean puppet runs on deployment-tin, initially

Other

Additional /srv/mediawiki wrangling in P2597
git-deploy remotes don't seem to update their git remote.origin.url before fetch, meaning all trebuchet deployments failed
- fixed via new deploy method sudo salt '*' deploy.fixurl (thanks @Joe!)

Looks like this task is a success. The Jenkins jobs updating the beta cluster seems to be working more or less properly.

Looks all fine now.

Change 270343 merged by Filippo Giunchedi:
Beta: Move deployment server