Page MenuHomePhabricator

Add ceph user and group to queens openstack hosts
Closed, ResolvedPublic

Description

Starting in the Queens release, nova-common requires the ceph-common package which installs a Ceph user and group outside of our service account range.

/etc/passwd:ceph:x:64045:64045:Ceph storage service:/var/lib/ceph:/bin/false
/etc/group:ceph:x:64045:

The enforce-users-groups-cleanup process then deletes this service and group account. We already manage the Ceph user and group in the ceph module that will be used for future cloudvirts, maybe we can split that up and use it here too.

Related Objects

Event Timeline

The missing user is currently causing the systemd-tmpfiles-clean service to fail. The ceph-common package is currently not logging anything, so as a quick fix and temporary work around I've removed the logging configuration until the service account is added.

sudo cumin 'P{R:Class = role::wmcs::openstack::eqiad1::virt}' 'rm /usr/lib/tmpfiles.d/ceph.conf && systemctl restart systemd-tmpfiles-clean'
/usr/lib/tmpfiles.d/ceph.conf
d /run/ceph 0770 ceph ceph

Change 583964 had a related patch set uploaded (by Jhedden; owner: Jhedden):
[operations/puppet@production] ceph: refactor ceph-common for clients with no configuration

https://gerrit.wikimedia.org/r/583964

Change 583964 merged by Jhedden:
[operations/puppet@production] ceph: refactor ceph-common for clients with no configuration

https://gerrit.wikimedia.org/r/583964

Change 584022 had a related patch set uploaded (by Jhedden; owner: Jhedden):
[operations/puppet@production] openstack: add ceph common profile to virt nodes

https://gerrit.wikimedia.org/r/584022

Ceph-common package requirements

$ apt-cache rdepends --no-{suggests,conflicts,breaks,replaces,enhances} --installed --recurse ceph-common
ceph-common
Reverse Depends:
  python3-cephfs
  python-cephfs
python3-cephfs
Reverse Depends:
  python3-ceph
  python3-ceph
python-cephfs
Reverse Depends:
  ceph-common
  ceph-common
python3-ceph
Reverse Depends:
  python3-nova
python3-nova
Reverse Depends:
  nova-common
nova-common
Reverse Depends:
  nova-compute-kvm
  nova-compute-kvm
  nova-compute
  nova-compute-kvm
  nova-compute
nova-compute-kvm
Reverse Depends:
 |nova-compute
 |nova-compute
nova-compute
Reverse Depends:
  nova-compute-kvm
  nova-compute-kvm
  nova-compute-kvm

Change 584022 merged by Jhedden:
[operations/puppet@production] openstack: add ceph common profile to control and virt nodes

https://gerrit.wikimedia.org/r/584022

Change 584043 had a related patch set uploaded (by Jhedden; owner: Jhedden):
[operations/puppet@production] openstack: codfw1dev add ceph common profile to control and virt roles

https://gerrit.wikimedia.org/r/584043

Change 584043 merged by Jhedden:
[operations/puppet@production] openstack: codfw1dev add ceph common profile to control and virt roles

https://gerrit.wikimedia.org/r/584043

JHedden claimed this task.

The missing user is currently causing the systemd-tmpfiles-clean service to fail. The ceph-common package is currently not logging anything, so as a quick fix and temporary work around I've removed the logging configuration until the service account is added.

sudo cumin 'P{R:Class = role::wmcs::openstack::eqiad1::virt}' 'rm /usr/lib/tmpfiles.d/ceph.conf && systemctl restart systemd-tmpfiles-clean'
/usr/lib/tmpfiles.d/ceph.conf
d /run/ceph 0770 ceph ceph

That ^ change has been reverted and all the hosts with nova-common are using profile::ceph::common now. That should take care of the file cleanup and cron spam.