Upgrade Labs Compute nodes to Trusty
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Andrew
	Feb 26 2015, 12:22 AM

Description

I just now tested an in-place upgrade of virt1005:

Created a test instance on virt1005
apt-get upgrade
Turn off puppet
Remove the cloud archive from /etc/apt/sources.list.d/
s/precise/trusty/g in /etc/apt/sources.list
apt-get update
apt-get upgrade, and selected defaults for all interactive options.
puppet agent -tv

After that, the test instance was still running without interruption

Puppet on virt1005 failed at this point, with:

E: Couldn't find any package by regex 'linux-tools-3.2.0-70-generic'

After a reboot of virt1005, puppet ran without complaints.

Related Objects
Search...

Status	Assigned	Task
Open	None	T138150 Purge stale data from LDAP
Resolved	Andrew	T148781 Clean up ldap host entries and references
Resolved	Krenair	T108625 Remove reliance on ldap $::projectid from shinkengen
Resolved	Andrew	T42022 Add icinga checks for all nova, glance, and keystone related services
Open	None	T90784 Monitor nova-scheduler log for lost contact with compute nodes
Resolved	Andrew	T104575 Don't rely on wikitech API for production services
Resolved	Andrew	T104588 Give 'novaobserver' keystone account rights to read everything, everywhere, write or change nothing
Resolved	Andrew	T104586 upgrade to Openstack Kilo
Resolved	Andrew	T104587 Upgrade Labs to Openstack Juno
Resolved	yuvipanda	T105720 Labs team reliability goal for Q1 2015/16
Resolved	Andrew	T106144 Make an evacuation plan for labs instances
Declined	None	T106146 Get instance block-migration working reliably; script and document
Resolved	Andrew	T90821 Upgrade labs cluster to Trusty
Resolved	Andrew	T90822 Upgrade Labs Compute nodes to Trusty

Event Timeline

Andrew created this task.Feb 26 2015, 12:22 AM

Andrew claimed this task.

Andrew raised the priority of this task from to Medium.

Andrew updated the task description. (Show Details)

Andrew added a project: Cloud-Services.

Andrew added subscribers: Aklapper, Andrew.

Before upgrade, virt1005 was running icehouse:

ii nova-compute 1:2014.1.3-0ubuntu1~cloud0

post upgrade, still icehouse:

ii nova-compute 1:2014.1.3-0ubuntu2

And I'm still able to create instances on virt1005. Icehouse is the default version of Openstack on Trusty. There's a patch in place in puppet to adopt the cloud-archive when we upgrade away from Icehouse: https://gerrit.wikimedia.org/r/#/c/174971/

So, the only pain point here is the reboot, which necessitates a reboot of labs instances as well. Is it possible to avoid or defer this reboot?

1012 is running Trusty now -- the upgrade was mostly painless although it did require a reboot.

This is going to happen via migration to newly-imaged boxes.

labvirt1001-1006 are already running trusty. Virt1011 is empty and ready to be re-imaged as Trusty.

Next I'll cold-migrate everything from virt1010 and virt1012 to labvirt* and reimage them as well. After all this we should be able to dump the ciscos entirely.

Andrew closed this task as Resolved.May 11 2015, 2:16 PM

Upgrade Labs Compute nodes to TrustyClosed, ResolvedPublicActions

Description

Related ObjectsSearch...

Event Timeline

Upgrade Labs Compute nodes to Trusty
Closed, ResolvedPublic
Actions

Related Objects
Search...