Page MenuHomePhabricator
Create Task
Maniphest T125027

upgrade dbproxy1001/1002 to jessie
Closed, ResolvedPublic
Actions

Description

dbproxy1001.eqiad.wmnet: True
dbproxy1002.eqiad.wmnet: True

these servers are on precise, but should become jessie

Details

SubjectRepoBranchLines +/-
Swithchover via dns dbproxy1001 (m1-master) to dbproxy1006operations/dnsmaster+1 -1
Install jessie by default on all dbproxiesoperations/puppetproduction+0 -8
Repool db1001 as m1 secondary (passive) hostoperations/puppetproduction+2 -2
Regenerate haproxy defaults on reload, in addition to on startoperations/puppetproduction+1 -0
Fixing typo on systemd haproxy unit (extra newline)operations/puppetproduction+1 -2
Update haproxy default file, as it cannot be dynamic in jessieoperations/puppetproduction+70 -10
Customize query in gerrit

Related Objects
Search...

Event Timeline

Dzahn created this task.Jan 28 2016, 12:53 AM
Dzahn raised the priority of this task from to Needs Triage.
Dzahn updated the task description. (Show Details)
Dzahn added projects: SRE, DBA.
Dzahn added subscribers: Krenair, Ricordisamoa, hashar and 4 others.
hashar unsubscribed.Feb 1 2016, 1:21 PM
jcrespo moved this task from Triage to Backlog on the DBA board.Feb 25 2016, 7:40 AM
jcrespo claimed this task.Feb 29 2016, 7:21 PM
jcrespo triaged this task as Medium priority.
jcrespo moved this task from Backlog to In progress on the DBA board.
gerritbot subscribed.Feb 29 2016, 7:23 PM

Change 273958 had a related patch set uploaded (by Jcrespo):
[WIP]Update haproxy default file, as it cannot be dynamic in jessie

https://gerrit.wikimedia.org/r/273958

gerritbot added a project: Patch-For-Review.Feb 29 2016, 7:23 PM
jcrespo moved this task from In progress to Backlog on the DBA board.Mar 9 2016, 11:09 AM
jcrespo changed the task status from Open to Stalled.May 2 2016, 9:58 AM
jcrespo removed jcrespo as the assignee of this task.
jcrespo subscribed.
Dzahn added a comment.May 2 2016, 1:55 PM

@jcrespo sorry, this is like the other upgrade ticket. it should have been just "shutdown or upgrade precise" not necessarily "jessie". Should i rename it?

jcrespo added a comment.May 2 2016, 2:36 PM

No, proxies will be jessie. They are not databases, completely different scenario. Still blocked by reviews on https://gerrit.wikimedia.org/r/273958

jcrespo mentioned this in T138460: Upgrade m3 (phabricator) db servers.Jul 14 2016, 11:25 PM
jcrespo mentioned this in rOPUP35ae0a792df3: Update haproxy default file, as it cannot be dynamic in jessie.Jul 19 2016, 9:55 AM
jcrespo mentioned this in rOPUP3ad7a5fe1bdc: Update haproxy default file, as it cannot be dynamic in jessie.Jul 19 2016, 10:03 AM
jcrespo mentioned this in rOPUP066b93d874a2: Update haproxy default file, as it cannot be dynamic in jessie.Jul 19 2016, 10:07 AM
jcrespo changed the task status from Stalled to Open.Jul 19 2016, 10:19 AM
jcrespo claimed this task.
jcrespo moved this task from Backlog to In progress on the DBA board.
jcrespo added a parent task: T138460: Upgrade m3 (phabricator) db servers.
jcrespo mentioned this in rOPUPa1af1ef15635: Update haproxy default file, as it cannot be dynamic in jessie.Jul 19 2016, 10:22 AM
jcrespo mentioned this in rOPUPcb72a7a406d4: Update haproxy default file, as it cannot be dynamic in jessie.Jul 19 2016, 10:26 AM
jcrespo mentioned this in rOPUP134a2d3a9699: Update haproxy default file, as it cannot be dynamic in jessie.Jul 19 2016, 10:57 AM
gerritbot added a comment.Jul 19 2016, 11:06 AM

Change 273958 merged by Jcrespo:
Update haproxy default file, as it cannot be dynamic in jessie

https://gerrit.wikimedia.org/r/273958

jcrespo mentioned this in rOPUP4fbcf2ee4111: Update haproxy default file, as it cannot be dynamic in jessie.Jul 19 2016, 11:08 AM
gerritbot added a comment.Jul 19 2016, 11:10 AM

Change 299736 had a related patch set uploaded (by Jcrespo):
Fixing typo on systemd haproxy unit (extra newline)

https://gerrit.wikimedia.org/r/299736

gerritbot added a comment.Jul 19 2016, 11:11 AM

Change 299736 merged by Jcrespo:
Fixing typo on systemd haproxy unit (extra newline)

https://gerrit.wikimedia.org/r/299736

jcrespo mentioned this in rOPUP766c1834c77e: Fixing typo on systemd haproxy unit (extra newline).Jul 19 2016, 11:13 AM
jcrespo mentioned this in rOPUP3953ac128843: Fixing typo on systemd haproxy unit (extra newline).
gerritbot added a comment.Jul 19 2016, 11:20 AM

Change 299738 had a related patch set uploaded (by Jcrespo):
Regenerate haproxy defaults on reload, in addition to on start

https://gerrit.wikimedia.org/r/299738

gerritbot added a comment.Jul 19 2016, 11:22 AM

Change 299738 merged by Jcrespo:
Regenerate haproxy defaults on reload, in addition to on start

https://gerrit.wikimedia.org/r/299738

jcrespo mentioned this in rOPUP1364f20e870f: Regenerate haproxy defaults on reload, in addition to on start.Jul 19 2016, 11:24 AM
gerritbot added a comment.Jul 19 2016, 1:17 PM

Change 299746 had a related patch set uploaded (by Jcrespo):
Repool db1001 as m1 secondary (passive) host

https://gerrit.wikimedia.org/r/299746

gerritbot added a comment.Jul 19 2016, 1:19 PM

Change 299747 had a related patch set uploaded (by Jcrespo):
Install jessie by default on all dbproxies

https://gerrit.wikimedia.org/r/299747

jcrespo mentioned this in rOPUPcc9950e1009f: Repool db1001 as m1 secondary (passive) host.Jul 19 2016, 1:22 PM
jcrespo mentioned this in rOPUPe7ae69d36f7a: Install jessie by default on all dbproxies.
jcrespo mentioned this in rOPUP990ef09d0584: Repool db1001 as m1 secondary (passive) host.Jul 19 2016, 1:25 PM
gerritbot added a comment.Jul 19 2016, 1:38 PM

Change 299746 merged by Jcrespo:
Repool db1001 as m1 secondary (passive) host

https://gerrit.wikimedia.org/r/299746

gerritbot added a comment.Jul 19 2016, 1:39 PM

Change 299747 merged by Jcrespo:
Install jessie by default on all dbproxies

https://gerrit.wikimedia.org/r/299747

jcrespo mentioned this in rOPUP97e929c1d2c6: Install jessie by default on all dbproxies.Jul 19 2016, 1:41 PM
Stashbot subscribed.Jul 19 2016, 2:10 PM

Mentioned in SAL [2016-07-19T14:10:57Z] <jynus> reboot and reimage dbproxy1003 to jessie T125027 T138460

jcrespo moved this task from In progress to Pending comment on the DBA board.Jul 20 2016, 11:03 AM
jcrespo added a comment.Jul 21 2016, 9:01 PM

It seems dbproxy1002 was "accidentally" upgraded to jessie today: T140983

jcrespo removed a parent task: T138460: Upgrade m3 (phabricator) db servers.Jul 21 2016, 9:08 PM
gerritbot added a comment.Jul 27 2016, 7:38 AM

Change 301330 had a related patch set uploaded (by Jcrespo):
Swithchover via dns dbproxy1001 (m1-master) to dbproxy1006

https://gerrit.wikimedia.org/r/301330

gerritbot added a comment.Jul 27 2016, 7:48 AM

Change 301330 merged by Jcrespo:
Swithchover via dns dbproxy1001 (m1-master) to dbproxy1006

https://gerrit.wikimedia.org/r/301330

jcrespo moved this task from Pending comment to In progress on the DBA board.Jul 27 2016, 10:48 AM

All clients are using now dbproxy1006; except bacula. I will wait for backup jobs to finish to restart it before reimaging dbproxy1001.

jcrespo added a subscriber: akosiaris.Jul 28 2016, 4:29 PM

@akosiaris I think now should be a safe time to restart bacula, but I will block on you giving an ok for that/confirming there are no ongoing jobs running.

akosiaris added a comment.Jul 28 2016, 4:33 PM

It is. Let's do it. I already did a restart, everything is fine.

jcrespo added a comment.Jul 28 2016, 4:35 PM

Oh, thank you a lot! I see bacula already from the new ip! Thank you again!

jcrespo closed this task as Resolved.Jul 28 2016, 5:29 PM

Both servers are now in jessie. The only remaining trusty servers is dbproxy1002 and dbproxy1004, which will be upgraded to jessie when we perform maintenance on the respective dbs.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL