Page MenuHomePhabricator
Create Task
Maniphest T265965

Ceph dev cluster in codfw1dev
Closed, ResolvedPublic
Actions

Description

I'm pleased to notice that we have three smallish servers (cloudceph200[1-3]-dev) racked in codfw1dev dedicated to Ceph development. Let's get them up and running and backing the -dev nova and glance services.

Either we can make each node a combined mon and osd node, or we can repurpose labtestpuppetmaster2001 (T258103) as a single mon node. Let's try the former unless applying the two puppet roles in combination causes trouble.

Right now those nodes are on public IPs. In order to replicate eqiad1 we need to create a cluster network for the backplane and then rebuild these nodes on the VM vlan (probably cloud-hosts1-b-codfw).

Details

SubjectRepoBranchLines +/-
nova compute: make live_migration_uri dc-specificoperations/puppetproduction+1 -1
Fake keydata for cinder ceph clientlabs/privatemaster+2 -0
Ceph: allow controller nodes to be specified per DCoperations/puppetproduction+12 -2
Glance: enable rbd for glance in codfw1devoperations/puppetproduction+2 -0
Cloudvirt2001-dev make a ceph-backed hypervisoroperations/puppetproduction+2 -6
nova compute: make live_migration_uri dc-specificoperations/puppetproduction+1 -1
Make cloudvirt2002-dev ceph-enabledoperations/puppetproduction+3 -3
cloudvirt2003-dev: move to ceph-enabled virt role, add ceph hiera elsewhereoperations/puppetproduction+63 -4
Ceph/codfw: added some missing hiera valuesoperations/puppetproduction+3 -0
Roles and hiera for codfw1dev ceph clusteroperations/puppetproduction+45 -2
Customize query in gerrit

Related Objects
Search...

Event Timeline

Andrew created this task.Oct 20 2020, 2:14 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 20 2020, 2:14 AM
Andrew added a subtask: Unknown Object (Task).Oct 20 2020, 2:16 AM
Andrew added a subscriber: ayounsi.Oct 20 2020, 2:19 AM

@aborrero and @ayounsi, how much work is involved in preparing vlans and configuring these hosts to talk to codfw1-dev VMs? Is it something we can do soon or should we set this aside for a future quarter?

ayounsi added a comment.Oct 20 2020, 6:16 AM

I'd say next Q but DCops can maybe help here as well, at least to move the primary interface to the cloud-hosts vlan/re-image/etc.

• nskaggs triaged this task as Medium priority.Oct 20 2020, 4:19 PM
aborrero assigned this task to dcaro.Nov 4 2020, 10:59 AM
aborrero added a parent task: T229441: CloudVPS: codfw1dev: missing bits.
aborrero moved this task from Inbox to Soon! on the cloud-services-team (Kanban) board.Nov 4 2020, 11:14 AM
gerritbot added a comment.Nov 24 2020, 5:34 PM

Change 643316 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Roles and hiera for codfw1dev ceph cluster

https://gerrit.wikimedia.org/r/643316

gerritbot added a project: Patch-For-Review.Nov 24 2020, 5:34 PM
gerritbot added a comment.Nov 30 2020, 2:53 PM

Change 643316 merged by Andrew Bogott:
[operations/puppet@production] Roles and hiera for codfw1dev ceph cluster

https://gerrit.wikimedia.org/r/643316

Maintenance_bot removed a project: Patch-For-Review.Nov 30 2020, 3:10 PM
gerritbot added a comment.Nov 30 2020, 3:29 PM

Change 644257 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Ceph/codfw: added some missing hiera values

https://gerrit.wikimedia.org/r/644257

gerritbot added a project: Patch-For-Review.Nov 30 2020, 3:29 PM

Change 644257 merged by Andrew Bogott:
[operations/puppet@production] Ceph/codfw: added some missing hiera values

https://gerrit.wikimedia.org/r/644257

Maintenance_bot removed a project: Patch-For-Review.Nov 30 2020, 4:11 PM
gerritbot added a comment.Dec 1 2020, 6:29 PM

Change 644584 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] cloudvirt2003-dev: move to ceph-enabled virt role

https://gerrit.wikimedia.org/r/644584

gerritbot added a project: Patch-For-Review.Dec 1 2020, 6:29 PM
gerritbot added a comment.Dec 1 2020, 6:56 PM

Change 644584 merged by Andrew Bogott:
[operations/puppet@production] cloudvirt2003-dev: move to ceph-enabled virt role, add ceph hiera elsewhere

https://gerrit.wikimedia.org/r/644584

Maintenance_bot removed a project: Patch-For-Review.Dec 1 2020, 7:10 PM
gerritbot added a comment.Dec 4 2020, 12:47 AM

Change 645213 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Make cloudvirt2002-dev ceph-enabled

https://gerrit.wikimedia.org/r/645213

gerritbot added a project: Patch-For-Review.Dec 4 2020, 12:47 AM
gerritbot added a comment.Dec 4 2020, 1:25 AM

Change 645213 merged by Andrew Bogott:
[operations/puppet@production] Make cloudvirt2002-dev ceph-enabled

https://gerrit.wikimedia.org/r/645213

Maintenance_bot removed a project: Patch-For-Review.Dec 4 2020, 2:10 AM
Andrew closed subtask T266257: Three ceph mon nodes for codfw1dev as Resolved.Dec 4 2020, 2:39 AM
Andrew closed subtask T266261: rearrange networking for cloudceph200[1-3]-dev and rename as Resolved.

I have a few more bumps to iron out but I have VMs hosted on the codfw1dev ceph cluster now.

gerritbot added a comment.Dec 4 2020, 4:43 AM

Change 645223 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] nova compute: make live_migration_uri dc-specific

https://gerrit.wikimedia.org/r/645223

gerritbot added a project: Patch-For-Review.Dec 4 2020, 4:43 AM
gerritbot added a comment.Dec 4 2020, 4:46 AM

Change 645223 merged by Andrew Bogott:
[operations/puppet@production] nova compute: make live_migration_uri dc-specific

https://gerrit.wikimedia.org/r/645223

gerritbot added a comment.Dec 4 2020, 4:53 AM

Change 645224 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cloudvirt2001-dev make a ceph-backed hypervisor

https://gerrit.wikimedia.org/r/645224

gerritbot added a comment.Dec 4 2020, 3:28 PM

Change 645224 merged by Andrew Bogott:
[operations/puppet@production] Cloudvirt2001-dev make a ceph-backed hypervisor

https://gerrit.wikimedia.org/r/645224

ayounsi unsubscribed.Dec 4 2020, 3:35 PM
gerritbot added a comment.Dec 4 2020, 4:50 PM

Change 645399 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Glance: enable rbd for glance in codfw1dev

https://gerrit.wikimedia.org/r/645399

gerritbot added a comment.Dec 4 2020, 4:51 PM

Change 645399 merged by Andrew Bogott:
[operations/puppet@production] Glance: enable rbd for glance in codfw1dev

https://gerrit.wikimedia.org/r/645399

Andrew claimed this task.Dec 4 2020, 5:23 PM
Andrew added a subscriber: dcaro.
ayounsi closed subtask T269457: Permit traffic between cloudcontrol2001/2003/2004 and cloudcephmon200[1-3]-dev as Resolved.Dec 8 2020, 10:44 PM
gerritbot added a comment.Dec 8 2020, 11:20 PM

Change 647107 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Ceph: allow controller nodes to be specified per DC

https://gerrit.wikimedia.org/r/647107

gerritbot added a comment.Dec 8 2020, 11:22 PM

Change 647107 merged by Andrew Bogott:
[operations/puppet@production] Ceph: allow controller nodes to be specified per DC

https://gerrit.wikimedia.org/r/647107

gerritbot added a comment.Dec 9 2020, 5:51 PM

Change 647321 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[labs/private@master] Fake keydata for cinder ceph client

https://gerrit.wikimedia.org/r/647321

gerritbot added a comment.Dec 9 2020, 6:03 PM

Change 647321 merged by Andrew Bogott:
[labs/private@master] Fake keydata for cinder ceph client

https://gerrit.wikimedia.org/r/647321

Andrew mentioned this in rLPRI587091847360: Fake keydata for cinder ceph client.Dec 9 2020, 6:16 PM
Andrew closed this task as Resolved.Dec 13 2020, 12:20 AM

This is built and working.

aborrero awarded a token.Dec 14 2020, 10:47 AM
gerritbot added a comment.Mar 2 2021, 7:18 PM

Change 667920 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] nova compute: make live_migration_uri dc-specific

https://gerrit.wikimedia.org/r/667920

gerritbot added a comment.Mar 2 2021, 8:20 PM

Change 667920 merged by Andrew Bogott:
[operations/puppet@production] nova compute: make live_migration_uri dc-specific

https://gerrit.wikimedia.org/r/667920

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits