Page MenuHomePhabricator

RobH (Rob Halsell)
Senior Data Center EngineerAdministrator

Projects (18)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Nov 24 2014, 1:43 PM (461 w, 3 d)
Roles
Administrator
Availability
Available
IRC Nick
RobH
LDAP User
RobH
MediaWiki User
RobH [ Global Accounts ]

My GPG Key fingerprint = CB1F C7E7 0FF8 5DB2 6820 9C7E 75ED 14C7 0245 D22A

I am an Senior Data Center Engineer on Wikimedia's Data Center SRE Team.

Please note that private message via phabricator is not my preferred contact means. Please feel free to contact me (robh) directly via irc/freenode, or email my @wikimedia.org email address.

Recent Activity

Yesterday

RobH added a comment to T342291: Q1:rack/setup/install an-master100[3-4].

@RobH I'm sorry to have to be a pain, but is there any chance that we can increase the RAM in these two servers, before they come into service?

I know I should have worked on any change of specs in T341264, but we didn't know at the time how our HDFS files usage was going to grow so rapidly. In fact, the Data-Engineering team have been working on bringing the number of files on HDFS down significantly. Unfortunaltey, it hasn't work out yet so now we're facing an increase in stability issues with the HDFS namenode services.

These two servers new servers (an-master100[3-4]) have got the same 128 GB of RAM as the servers they're replacing, but if these is any way we could increase it to, say 256 GB each, that would really help us out.
If it's not feasible, let us know and we will see if there are any alternative approaches. Thanks.

Thu, Sep 28, 4:19 PM · SRE, Data-Platform-SRE, Data-Engineering, ops-eqiad, DC-Ops
RobH added a subtask for T342291: Q1:rack/setup/install an-master100[3-4]: Unknown Object (Task).
Thu, Sep 28, 4:09 PM · SRE, Data-Platform-SRE, Data-Engineering, ops-eqiad, DC-Ops

Wed, Sep 27

RobH closed T342374: Q1:rack/setup/install lists1004.eqiad.wmnet as Resolved.

OS imaged, system ready for service owners.

Wed, Sep 27, 7:19 PM · SRE, Data-Persistence, ops-eqiad, DC-Ops
RobH updated the task description for T342374: Q1:rack/setup/install lists1004.eqiad.wmnet.
Wed, Sep 27, 7:19 PM · SRE, Data-Persistence, ops-eqiad, DC-Ops
RobH reassigned T342374: Q1:rack/setup/install lists1004.eqiad.wmnet from RobH to Jclark-ctr.
Wed, Sep 27, 6:13 PM · SRE, Data-Persistence, ops-eqiad, DC-Ops
RobH added a comment to T342374: Q1:rack/setup/install lists1004.eqiad.wmnet.

Found error in partitioning, discussing with John.

Wed, Sep 27, 6:06 PM · SRE, Data-Persistence, ops-eqiad, DC-Ops
RobH changed the status of T342374: Q1:rack/setup/install lists1004.eqiad.wmnet from Open to In Progress.
Wed, Sep 27, 5:59 PM · SRE, Data-Persistence, ops-eqiad, DC-Ops

Tue, Sep 26

RobH closed T342674: Q1:rack/setup/install moss-be200[34] as Resolved.

@Jhancock.wm I think (from netbox) that moss-be2003 is a PowerEdge R740xd2 - ConfigJ 202107 system. We have a number of these nodes which are set up as JBOD in use in the ms-cluster - ms-be107[2-5]. There's also ms-be20[70-73], though those are PowerEdge R740xd2 systems (I'm not clear on the distinction). So I'd hope it was possible to make moss-be2003 do JBOD?

Tue, Sep 26, 2:29 PM · SRE, Data-Persistence, SRE-swift-storage, ops-codfw, DC-Ops
RobH reopened T342674: Q1:rack/setup/install moss-be200[34] as "Open".
Tue, Sep 26, 2:28 PM · SRE, Data-Persistence, SRE-swift-storage, ops-codfw, DC-Ops
RobH added a comment to T342674: Q1:rack/setup/install moss-be200[34].

I was trying to make it work and I consulted with @RobH. He said it wasn't going to work on this machine because of limitations of the hardware.

Tue, Sep 26, 2:28 PM · SRE, Data-Persistence, SRE-swift-storage, ops-codfw, DC-Ops

Tue, Sep 19

RobH renamed ops-esams from ops-knams to ops-esams.
Tue, Sep 19, 7:05 PM
RobH updated subscribers of T324998: Q3:rack/setup/install cloudcephosd10(3[5-9]|40).
Tue, Sep 19, 3:04 PM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
RobH added a comment to T324998: Q3:rack/setup/install cloudcephosd10(3[5-9]|40).

IRC update: Chatted with Moritz in IRC and we're no where near supporting UEFI mode anytime in near to mid term. We should likely return these.

Tue, Sep 19, 3:04 PM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
RobH updated subscribers of T324998: Q3:rack/setup/install cloudcephosd10(3[5-9]|40).

So this system only supported UEFI mode, which we've not supported installing within WMF.

Tue, Sep 19, 3:03 PM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops

Thu, Sep 14

RobH closed T346368: datacenter ops group right addition: sre.puppet.sync-netbox-hiera cookbook as Resolved.
Thu, Sep 14, 5:04 PM · SRE, SRE-Access-Requests
RobH added a comment to T336000: Update Acoustic Unsubscribe landing page domain to be served by a secure wikimedia.org domain.

I was just pinged about this via irc by @Dwisehaupt, so to get an SSL certificate for this there are a few items to address:

Thu, Sep 14, 5:03 PM · fundraising-tech-ops, FR-Email
RobH triaged T346368: datacenter ops group right addition: sre.puppet.sync-netbox-hiera cookbook as Medium priority.
Thu, Sep 14, 4:10 PM · SRE, SRE-Access-Requests
RobH created T346368: datacenter ops group right addition: sre.puppet.sync-netbox-hiera cookbook.
Thu, Sep 14, 4:09 PM · SRE, SRE-Access-Requests
RobH added a comment to T346326: markmonitor update: refresh ns0.openstack.eqiad1.wikimediacloud.org glue A record to point to 185.15.56.162.

Email sent, cc'd @aborrero so they can stay apprised of progress. If this follows the same cadence, our MM rep will work on this within 24 hours.

Thu, Sep 14, 3:27 PM · cloud-services-team (FY2023/2024-Q1), SRE, ops-eqiad, User-aborrero

Tue, Sep 12

RobH added a comment to T346177: Certain systems failing to resolve DNS entries under toolforge.org, wmcloud.org, wmflabs.org, toolserver.org.

Update,

It turns out the other nameserver was migrated previously with no IP update either, so its currently incorrect on the MarkMonitor/registar side due to our lack of update to you.
ns0.openstack.eqiad1.wikimediacloud.org to 208.80.154.148
ns1.openstack.eqiad1.wikimediacloud.org to 185.15.56.163

Please let us know when you receive this request as it now turns out this domain is offline until we update this and it propagates out, thank you!

Tue, Sep 12, 6:43 PM · User-aborrero, Cloud-VPS, SRE
RobH added a comment to T346177: Certain systems failing to resolve DNS entries under toolforge.org, wmcloud.org, wmflabs.org, toolserver.org.

Naoya,

We're juggling around some nameservers in our cloud environment over here, and need to update one of them:

ns1.openstack.eqiad1.wikimediacloud.org to 185.15.56.163

Please let me know what authorizations are needed to make this happen and implement as soon as you can. Our sub-team over here already re-allocated that IP to the nameserver without realizing we had to let you know to update on your end.

Thanks!

Tue, Sep 12, 6:30 PM · User-aborrero, Cloud-VPS, SRE
RobH added a comment to T346177: Certain systems failing to resolve DNS entries under toolforge.org, wmcloud.org, wmflabs.org, toolserver.org.

@RobH if we can ask the registrar to change the IP they have for ns1.openstack.eqiad1.wikimediacloud.org to 185.15.56.163 I think it should solve it.

Tue, Sep 12, 6:25 PM · User-aborrero, Cloud-VPS, SRE
RobH closed T346077: Requesting access to shell/dcops for VRiley as Resolved.
Tue, Sep 12, 3:44 PM · SRE, SRE-Access-Requests

Mon, Sep 11

RobH renamed T346077: Requesting access to shell/dcops for VRiley from Requesting access to RESOURCE for VRiley to Requesting access to sehll/dcops for VRiley.
Mon, Sep 11, 5:25 PM · SRE, SRE-Access-Requests
RobH updated the task description for T346077: Requesting access to shell/dcops for VRiley.
Mon, Sep 11, 5:25 PM · SRE, SRE-Access-Requests

Thu, Sep 7

RobH closed Unknown Object (Task), a subtask of T329219: Main Tracking Task for ESAMS Migration to KNAMS, as Resolved.
Thu, Sep 7, 7:21 PM · Patch-For-Review, SRE, ops-esams, DC-Ops

Tue, Sep 5

RobH changed the status of Unknown Object (Task), a subtask of T296966: eqiad: Master Tracking Ticket for eqiad expansion cage, from Open to In Progress.
Tue, Sep 5, 5:02 PM · SRE, ops-eqiad, DC-Ops

Wed, Aug 30

RobH closed Unknown Object (Task), a subtask of T344259: hw troubleshooting: Failing SSD for restbase1030.eqiad.wmnet, as Resolved.
Wed, Aug 30, 8:29 PM · SRE, ops-eqiad, DC-Ops

Aug 23 2023

RobH added a project to T344598: Decommission thumbor100[12]: decommission-hardware.
Aug 23 2023, 4:11 PM · decommission-hardware, SRE, ops-eqiad, serviceops

Aug 22 2023

RobH added a subtask for T344259: hw troubleshooting: Failing SSD for restbase1030.eqiad.wmnet: Unknown Object (Task).
Aug 22 2023, 7:16 PM · SRE, ops-eqiad, DC-Ops
RobH added a member for acl*sre-team: VRiley-WMF.
Aug 22 2023, 3:15 PM

Aug 17 2023

RobH closed Unknown Object (Task), a subtask of T329219: Main Tracking Task for ESAMS Migration to KNAMS, as Resolved.
Aug 17 2023, 6:28 PM · Patch-For-Review, SRE, ops-esams, DC-Ops

Aug 16 2023

RobH reopened Unknown Object (Task), a subtask of T329219: Main Tracking Task for ESAMS Migration to KNAMS, as Open.
Aug 16 2023, 4:12 PM · Patch-For-Review, SRE, ops-esams, DC-Ops

Aug 15 2023

RobH updated the task description for T334280: Q4:knams: PDU installation.
Aug 15 2023, 9:37 PM · SRE, ops-esams, DC-Ops
RobH updated the task description for T344174: Q1:rack/setup/install new esams/knams hosts.
Aug 15 2023, 5:08 PM · SRE, Traffic, ops-esams, DC-Ops
RobH closed T344135: ManagementSSHDown as Declined.
Aug 15 2023, 5:06 PM · ops-esams
RobH created P50587 (An Untitled Masterwork).
Aug 15 2023, 3:41 PM

Aug 14 2023

RobH updated the task description for T344174: Q1:rack/setup/install new esams/knams hosts.
Aug 14 2023, 10:26 PM · SRE, Traffic, ops-esams, DC-Ops
RobH updated the task description for T344174: Q1:rack/setup/install new esams/knams hosts.
Aug 14 2023, 7:54 PM · SRE, Traffic, ops-esams, DC-Ops
RobH updated the task description for T344174: Q1:rack/setup/install new esams/knams hosts.
Aug 14 2023, 7:47 PM · SRE, Traffic, ops-esams, DC-Ops
RobH updated the task description for T344174: Q1:rack/setup/install new esams/knams hosts.
Aug 14 2023, 4:50 PM · SRE, Traffic, ops-esams, DC-Ops
RobH created T344174: Q1:rack/setup/install new esams/knams hosts.
Aug 14 2023, 4:48 PM · SRE, Traffic, ops-esams, DC-Ops

Aug 10 2023

RobH added a comment to T342159: Q1:rack/setup/install cp11[00-15].

Please note parent task 341588 has the range of cp1[090-105] however, cp1090 is already live/in use. Additionally, we have 4 cp hosts from eqsin to use for CP in eqiad (so cp109[1-4], and another 4 coming from ulsfo cp109[5-8).

Also no racking info has been provided for these. Should they be distributed in any particular way for traffics needs/redundancy?

Assigning to @ssingh for followup on racking details and to clarify hostnames (and ensure the 8 old CP hosts from ulsfo/eqsin are still expected to be used.)

Hi @RobH,

Trying to get some context here and it's possible I am forgetting something: which old hosts are these? Also, the newer configuration in eqiad has dual NVMe disks for both text and upload whereas eqsin/ulsfo have just for upload, so if we are using some servers from there, we should keep that in mind.

Aug 10 2023, 2:31 PM · SRE, ops-eqiad, Traffic, DC-Ops

Aug 9 2023

RobH added a comment to P50370 (An Untitled Masterwork).

wikibooks.org
wikidata.org
wikimedia.org
wikimediafoundation.org
wikinews.org
wikipedia.org
wikiquote.org
wikisource.org
wikiversity.org
wikivoyage.org
wiktionary.org
wmfusercontent.org
mediawiki.org
wikifunctions.org

Aug 9 2023, 9:50 PM

Aug 8 2023

RobH moved T342198: Relocate one of the mx480 from esams to knams from Backlog to Racking Tasks on the ops-esams board.
Aug 8 2023, 3:35 PM · SRE, ops-esams, DC-Ops
RobH closed Unknown Object (Task), a subtask of T329219: Main Tracking Task for ESAMS Migration to KNAMS, as Resolved.
Aug 8 2023, 12:17 PM · Patch-For-Review, SRE, ops-esams, DC-Ops
RobH closed Unknown Object (Task), a subtask of T329219: Main Tracking Task for ESAMS Migration to KNAMS, as Resolved.
Aug 8 2023, 12:01 PM · Patch-For-Review, SRE, ops-esams, DC-Ops

Aug 7 2023

RobH closed Unknown Object (Task), a subtask of T329219: Main Tracking Task for ESAMS Migration to KNAMS, as Resolved.
Aug 7 2023, 7:35 PM · Patch-For-Review, SRE, ops-esams, DC-Ops
RobH added a subtask for T329219: Main Tracking Task for ESAMS Migration to KNAMS: Unknown Object (Task).
Aug 7 2023, 5:32 PM · Patch-For-Review, SRE, ops-esams, DC-Ops
RobH awarded T331519: Should we have two versions of the Juniper QFX5120-48Y in Netbox? a Like token.
Aug 7 2023, 1:51 PM · Infrastructure-Foundations, netbox
RobH added a comment to T336623: Netbox device's platform field inconsistency.

Agreed, I don't think there's any need to continue using "platform" in Netbox, especially since more than half the devices don't have it currently filled out. @Papaul, @RobH, @Jclark-ctr, @Jhancock.wm - feel free to chime in if you have any other thoughts.

Thanks,
Willy

@wiki_willy what's DCOps's position on this? Those are the current platform used: https://netbox.wikimedia.org/dcim/platforms/

Aug 7 2023, 1:25 PM · Infrastructure-Foundations, DC-Ops, netbox
RobH added a comment to T305366: Update SRE Procurement Request template.

I think we perhaps have to find a compromise on the single versus multi line.

Aug 7 2023, 12:47 PM · Phabricator, DC-Ops

Aug 3 2023

RobH added a comment to T343254: codfw: es2025 lost System Board Fan6.

@RobH Yes, let's order the fan. Thank you!

Aug 3 2023, 5:09 PM · SRE, ops-codfw, DBA
RobH added a subtask for T343254: codfw: es2025 lost System Board Fan6: Unknown Object (Task).
Aug 3 2023, 5:07 PM · SRE, ops-codfw, DBA
RobH added a comment to T343254: codfw: es2025 lost System Board Fan6.

@RobH you right it is not the fan that has the issue it is the board i will have @Jhancock.wm check if it is the daughter board or if it is the mainboard the fan is plugged in tomorrow when she is on site since i am still doing some firmware upgrade on the server.

Thaks

Aug 3 2023, 4:24 PM · SRE, ops-codfw, DBA

Aug 2 2023

RobH added a comment to T343254: codfw: es2025 lost System Board Fan6.

@Papaul: Before I order a new fan, I want to confirm that it is indeed the fan and not the fan slot?

Aug 2 2023, 4:15 PM · SRE, ops-codfw, DBA

Jul 27 2023

RobH added a parent task for T342534: Q1:rack/setup/install kubernetes20[25-53]: Unknown Object (Task).
Jul 27 2023, 8:18 PM · SRE, ops-codfw, serviceops, DC-Ops
RobH moved T342892: Q1:rack/setup/install pki1002 from Backlog to Racking Tasks on the ops-eqiad board.
Jul 27 2023, 2:15 PM · SRE, Infrastructure-Foundations, ops-eqiad, DC-Ops
RobH added a parent task for T342892: Q1:rack/setup/install pki1002: Unknown Object (Task).
Jul 27 2023, 2:15 PM · SRE, Infrastructure-Foundations, ops-eqiad, DC-Ops
RobH renamed T342892: Q1:rack/setup/install pki1002 from Q1:rack/setup/install X to Q1:rack/setup/install pki1002.
Jul 27 2023, 2:14 PM · SRE, Infrastructure-Foundations, ops-eqiad, DC-Ops
RobH created T342892: Q1:rack/setup/install pki1002.
Jul 27 2023, 2:14 PM · SRE, Infrastructure-Foundations, ops-eqiad, DC-Ops
RobH added a parent task for T342862: Q1:rack/setup/install dbstore100[89]: Unknown Object (Task).
Jul 27 2023, 12:38 PM · SRE, Data-Engineering, Data-Platform-SRE, ops-eqiad, DC-Ops
RobH moved T342862: Q1:rack/setup/install dbstore100[89] from Backlog to Racking Tasks on the ops-eqiad board.
Jul 27 2023, 12:37 PM · SRE, Data-Engineering, Data-Platform-SRE, ops-eqiad, DC-Ops
RobH created T342862: Q1:rack/setup/install dbstore100[89].
Jul 27 2023, 12:37 PM · SRE, Data-Engineering, Data-Platform-SRE, ops-eqiad, DC-Ops

Jul 26 2023

RobH moved T342749: Q1:rack/setup/install wdqs102[0-4] from Backlog to Racking Tasks on the ops-eqiad board.
Jul 26 2023, 11:51 AM · SRE, Data-Platform-SRE, ops-eqiad, DC-Ops
RobH added a parent task for T342749: Q1:rack/setup/install wdqs102[0-4]: Unknown Object (Task).
Jul 26 2023, 11:51 AM · SRE, Data-Platform-SRE, ops-eqiad, DC-Ops
RobH created T342749: Q1:rack/setup/install wdqs102[0-4].
Jul 26 2023, 11:51 AM · SRE, Data-Platform-SRE, ops-eqiad, DC-Ops

Jul 25 2023

RobH moved T342675: Q1:rack/setup/install moss-be1003 from Backlog to Racking Tasks on the ops-eqiad board.
Jul 25 2023, 4:35 PM · SRE, SRE-swift-storage, Data-Persistence, ops-eqiad, DC-Ops
RobH added a parent task for T342675: Q1:rack/setup/install moss-be1003: Unknown Object (Task).
Jul 25 2023, 4:35 PM · SRE, SRE-swift-storage, Data-Persistence, ops-eqiad, DC-Ops
RobH created T342675: Q1:rack/setup/install moss-be1003.
Jul 25 2023, 4:35 PM · SRE, SRE-swift-storage, Data-Persistence, ops-eqiad, DC-Ops
RobH moved T342674: Q1:rack/setup/install moss-be200[34] from Backlog to Racking Tasks on the ops-codfw board.
Jul 25 2023, 4:33 PM · SRE, Data-Persistence, SRE-swift-storage, ops-codfw, DC-Ops
RobH added a parent task for T342674: Q1:rack/setup/install moss-be200[34]: Unknown Object (Task).
Jul 25 2023, 4:33 PM · SRE, Data-Persistence, SRE-swift-storage, ops-codfw, DC-Ops
RobH created T342674: Q1:rack/setup/install moss-be200[34].
Jul 25 2023, 4:33 PM · SRE, Data-Persistence, SRE-swift-storage, ops-codfw, DC-Ops
RobH moved T342660: Q1:rack/setup/install wdqs101[789] from Backlog to Racking Tasks on the ops-eqiad board.
Jul 25 2023, 2:50 PM · Data-Platform-SRE, ops-eqiad, SRE
RobH added a parent task for T342660: Q1:rack/setup/install wdqs101[789]: Unknown Object (Task).
Jul 25 2023, 2:49 PM · Data-Platform-SRE, ops-eqiad, SRE
RobH created T342660: Q1:rack/setup/install wdqs101[789].
Jul 25 2023, 2:49 PM · Data-Platform-SRE, ops-eqiad, SRE
RobH moved T342659: Q1:rack/setup/install wdqs20[23-25].codfw.wmnet from Backlog to Racking Tasks on the ops-codfw board.
Jul 25 2023, 2:41 PM · SRE, Data-Platform-SRE, ops-codfw, DC-Ops
RobH added a parent task for T342659: Q1:rack/setup/install wdqs20[23-25].codfw.wmnet: Unknown Object (Task).
Jul 25 2023, 2:41 PM · SRE, Data-Platform-SRE, ops-codfw, DC-Ops
RobH created T342659: Q1:rack/setup/install wdqs20[23-25].codfw.wmnet.
Jul 25 2023, 2:41 PM · SRE, Data-Platform-SRE, ops-codfw, DC-Ops

Jul 24 2023

RobH added a parent task for T342538: Q1:rack/setup/install cloudelastic10[07-10].wikimedia.org: Unknown Object (Task).
Jul 24 2023, 12:59 PM · Data-Platform-SRE, SRE, ops-eqiad, cloud-services-team (Hardware), DC-Ops
RobH moved T342538: Q1:rack/setup/install cloudelastic10[07-10].wikimedia.org from Backlog to Racking Tasks on the ops-eqiad board.
Jul 24 2023, 12:59 PM · Data-Platform-SRE, SRE, ops-eqiad, cloud-services-team (Hardware), DC-Ops
RobH created T342538: Q1:rack/setup/install cloudelastic10[07-10].wikimedia.org.
Jul 24 2023, 12:59 PM · Data-Platform-SRE, SRE, ops-eqiad, cloud-services-team (Hardware), DC-Ops
RobH moved T342537: Q1:rack/setup/install cloudvirt10[62-67] from Backlog to Racking Tasks on the ops-eqiad board.
Jul 24 2023, 12:55 PM · SRE, ops-eqiad, cloud-services-team (Hardware), DC-Ops
RobH added a parent task for T342537: Q1:rack/setup/install cloudvirt10[62-67]: Unknown Object (Task).
Jul 24 2023, 12:55 PM · SRE, ops-eqiad, cloud-services-team (Hardware), DC-Ops
RobH created T342537: Q1:rack/setup/install cloudvirt10[62-67].
Jul 24 2023, 12:55 PM · SRE, ops-eqiad, cloud-services-team (Hardware), DC-Ops
RobH moved T342534: Q1:rack/setup/install kubernetes20[25-53] from Backlog to Racking Tasks on the ops-codfw board.
Jul 24 2023, 12:22 PM · SRE, ops-codfw, serviceops, DC-Ops
RobH added a parent task for T342534: Q1:rack/setup/install kubernetes20[25-53]: Unknown Object (Task).
Jul 24 2023, 12:21 PM · SRE, ops-codfw, serviceops, DC-Ops
RobH created T342534: Q1:rack/setup/install kubernetes20[25-53].
Jul 24 2023, 12:21 PM · SRE, ops-codfw, serviceops, DC-Ops
RobH added a parent task for T342533: Q1:rack/setup/install kubernetes10[27-56]: Unknown Object (Task).
Jul 24 2023, 12:15 PM · SRE, serviceops, ops-eqiad, DC-Ops
RobH moved T342533: Q1:rack/setup/install kubernetes10[27-56] from Backlog to Racking Tasks on the ops-eqiad board.
Jul 24 2023, 12:15 PM · SRE, serviceops, ops-eqiad, DC-Ops
RobH created T342533: Q1:rack/setup/install kubernetes10[27-56].
Jul 24 2023, 12:15 PM · SRE, serviceops, ops-eqiad, DC-Ops

Jul 21 2023

RobH added a parent task for T342459: Q1:rack/setup/install cloudvirt200[4-6]-dev: Unknown Object (Task).
Jul 21 2023, 6:12 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
RobH moved T342459: Q1:rack/setup/install cloudvirt200[4-6]-dev from Backlog to Racking Tasks on the ops-codfw board.
Jul 21 2023, 6:11 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
RobH created T342459: Q1:rack/setup/install cloudvirt200[4-6]-dev.
Jul 21 2023, 6:11 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
RobH moved T342456: Q1:rack/setup/install cloudcontrol200[6-8]-dev, cloudnet200[7-8]-dev from Backlog to Racking Tasks on the ops-codfw board.
Jul 21 2023, 6:00 PM · User-aborrero, SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
RobH added a parent task for T342456: Q1:rack/setup/install cloudcontrol200[6-8]-dev, cloudnet200[7-8]-dev: Unknown Object (Task).
Jul 21 2023, 5:59 PM · User-aborrero, SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
RobH created T342456: Q1:rack/setup/install cloudcontrol200[6-8]-dev, cloudnet200[7-8]-dev.
Jul 21 2023, 5:59 PM · User-aborrero, SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
RobH moved T342455: Q1:rack/setup/install cloudcontrol100[8-10]-dev cloudnet100[7-8]-dev from Backlog to Racking Tasks on the ops-eqiad board.
Jul 21 2023, 5:47 PM · User-aborrero, SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
RobH added a parent task for T342455: Q1:rack/setup/install cloudcontrol100[8-10]-dev cloudnet100[7-8]-dev: Unknown Object (Task).
Jul 21 2023, 5:46 PM · User-aborrero, SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
RobH created T342455: Q1:rack/setup/install cloudcontrol100[8-10]-dev cloudnet100[7-8]-dev.
Jul 21 2023, 5:46 PM · User-aborrero, SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops