+ @Andrew

NodePool has support to store key/values in OpenStack metadata service from http://ci.openstack.org/nodepool/configuration.html?highlight=region#images

images:
  - name: precise
    base-image: 'Precise'
    min-ram: 8192
    name-filter: 'm1.medium'
    setup: prepare_node.sh
    reset: reset_node.sh
    username: jenkins
    private-key: /var/lib/jenkins/.ssh/id_rsa
    vvvvvvvvvvvvvvv
    meta:
        key: value
        key2: value
    ^^^^^^^^^^^^^^^

I gave it a try but apparently the meta informations are not published, or at least they do not show up in the Horizon dashboard.

Anyway, the PuppetVar and PuppetClasses are populated by OpenStackManager and I don't think it is a good idea to duplicate them in NodePool configuration file. Instead I am wondering whether we could have OpenStackManager publish the metadata information and adjust firstboot.sh to fetch them via the http://169.254.169.254/openstack/latest/meta_data.json interface. Tough it yields json :(

From our wikitech.php we have:

$wgOpenStackManagerPuppetOptions = array(
    'enabled' => true,
    'defaultclasses' => array( 'base', 'role::labs::instance' ),
    'defaultvariables' => array( 'realm' => 'labs', 'use_dnsmasq' => 'true' ),
);

I'm in the process of moving the ldap record creation out of openstackmanager and into a designate callback -- after that's done instances created on the commandline will work the same as those created by the gui. Many of the pieces of that are already in place; I'll try to pick up the pace a bit.

For now, only the CI isolation project is going to spawn instances directly via the OpenStack API. In firstboot.sh, the only line relying on puppetVar is:

project=`ldapsearch -x -D ${binddn} -w ${bindpw} -b ${hostsou} "dc=${idfqdn}" puppetvar | grep 'instanceproject' | sed 's/.*=//'`

Which is merely fetch from ldap the puppetvar fields to get the labs project name. For CI isolation we are going to use custom images. We could teach firstboot.sh to source a file that contains environment variables and hardcode the project to contintcloud. Something like:

firstboot.env

WMFLABS_INSTANCE_PROJECT="contintcloud

firstboot.sh

[ -f firstboot.env ] && . firstboot.env

project_from_ldap=`ldapsearch -x -D ${binddn} -w ${bindpw} -b ${hostsou} "dc=${idfqdn}" puppetvar | grep 'instanceproject' | sed 's/.*=//'`
project={WMFLABS_INSTANCE_PROJECT:-$project_from_ldap}

This way we can override the ldapsearch in the CI custom images.

Change 210032 had a related patch set uploaded (by Hashar):
labs: support injecting tenant in firstboot.sh

https://gerrit.wikimedia.org/r/210032

That task is the reason instances booted on labs by nodepool do not manage to first boot.

Change 210032 abandoned by Hashar:
labs: support injecting tenant in firstboot.sh

Reason:
Probably not needed anymore

https://gerrit.wikimedia.org/r/210032