Page MenuHomePhabricator

Jclark-ctr (John Clark)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Jul 24 2019, 8:11 PM (8 w, 4 d)
Availability
Available
LDAP User
Jclark-ctr
MediaWiki User
Jclark-ctr [ Global Accounts ]

Recent Activity

Thu, Sep 19

jcrespo awarded T232882: backup1001 failed disk (degraded RAID) a Love token.
Thu, Sep 19, 7:41 AM · Operations, ops-eqiad

Wed, Sep 18

Jclark-ctr added a comment to T232882: backup1001 failed disk (degraded RAID).

@jcrespo all Disk show connection light can you please reverify

Wed, Sep 18, 10:00 PM · Operations, ops-eqiad

Tue, Sep 17

Jclark-ctr added a comment to T227025: (Need By: August 31) rack/setup/install (3) new zookeeper nodes.

@elukey Will be on site tomorrow morning 7:30 et questions regarding host in concern an-coord1001 or an-conf1001. Sent message on IRC to follow up

Tue, Sep 17, 8:40 PM · User-Elukey, Operations, ops-eqiad
jcrespo awarded T232882: backup1001 failed disk (degraded RAID) a Love token.
Tue, Sep 17, 8:35 PM · Operations, ops-eqiad
Jclark-ctr closed Unknown Object (Task), a subtask of T227314: eqiad+codfw: 6x hardware request for swift backend (each site), as Resolved.
Tue, Sep 17, 8:15 PM · hardware-requests, Operations
Jclark-ctr closed T232882: backup1001 failed disk (degraded RAID), a subtask of T229209: Strengthen backup infrastructure and support, as Resolved.
Tue, Sep 17, 8:08 PM · Patch-For-Review, Goal, DBA, serviceops, Operations
Jclark-ctr closed T232882: backup1001 failed disk (degraded RAID) as Resolved.
Tue, Sep 17, 8:08 PM · Operations, ops-eqiad
Jclark-ctr added a comment to T232882: backup1001 failed disk (degraded RAID).

@jcrespo Drive arrived early Replaced failed drive

Tue, Sep 17, 8:07 PM · Operations, ops-eqiad
Jclark-ctr added a comment to T227539: b3-eqiad pdu refresh (Tuesday 9/17 @11am UTC).

Finished swapping pdu reassigned to @RobH

Tue, Sep 17, 6:00 PM · DC-Ops, Operations, ops-eqiad
Jclark-ctr reassigned T227539: b3-eqiad pdu refresh (Tuesday 9/17 @11am UTC) from Cmjohnson to RobH.
Tue, Sep 17, 5:59 PM · DC-Ops, Operations, ops-eqiad

Mon, Sep 16

Jclark-ctr added a comment to T232882: backup1001 failed disk (degraded RAID).

@Jclark-ctr @jcrespo SR# 997901435 . DPS# 717467224, and it is setup to arrive during normal business hours on Wednesday. Disk will be replaced Wednesday

Mon, Sep 16, 10:13 PM · Operations, ops-eqiad

Fri, Sep 13

Jclark-ctr added a comment to T232882: backup1001 failed disk (degraded RAID).

contacted dell regarding failed drive will update with response

Fri, Sep 13, 9:02 PM · Operations, ops-eqiad
Jclark-ctr added a comment to T227335: backup1001 can't address the disk shelf's drives.

@jcrespo Support ticket did not include disk. it was only a cable issue. No other tickets open.

Fri, Sep 13, 1:05 PM · ops-eqiad, Operations, DC-Ops

Thu, Sep 12

Jclark-ctr added a comment to T227335: backup1001 can't address the disk shelf's drives.

Opened Dell Support Ticket

Thu, Sep 12, 11:14 PM · ops-eqiad, Operations, DC-Ops

Wed, Sep 11

Jclark-ctr added a comment to T232591: helium array has slot 3 disk failed.

swapped drive slot 3 @Cmjohnson

Wed, Sep 11, 2:25 PM · ops-eqiad, Operations
Jclark-ctr reassigned T228926: rack/setup/instal (4) CI ganeti nodes from Jclark-ctr to Cmjohnson.
Wed, Sep 11, 12:48 PM · ops-eqiad, Operations
Jclark-ctr reassigned T224188: rack/setup/install (3) new osd ceph nodes from Jclark-ctr to Cmjohnson.
Wed, Sep 11, 12:38 PM · ops-eqiad, Operations, cloud-services-team (Kanban), Cloud-Services

Tue, Sep 10

Jclark-ctr reassigned T228102: rack/setup/install cloudcephmon100[123] from Jclark-ctr to Cmjohnson.
Tue, Sep 10, 8:33 PM · cloud-services-team (Kanban), Operations, Cloud-Services, ops-eqiad

Mon, Sep 9

Jclark-ctr added a comment to T224188: rack/setup/install (3) new osd ceph nodes.

host row unit port
cloudcephosd1001 b7 27 39/25
cloudcephosd1002 b4 12 43/42
cloudcephosd1003 b2 12 35/13

Mon, Sep 9, 1:38 PM · ops-eqiad, Operations, cloud-services-team (Kanban), Cloud-Services

Wed, Sep 4

Jclark-ctr added a comment to T228924: rack/setup/install ganeti10([09]|1[0-8[).eqiad.wmnet.

@Cmjohnson Idrac and bios settings finished

Wed, Sep 4, 10:12 PM · ops-eqiad, vm-requests, Operations
Jclark-ctr added a comment to T225128: Move cloudvirtan* hardware out of CloudVPS back into production Analytics VLAN..

@Cmjohnson removed 2nd dac cable yes it plugged into d7 xe-7/0/2

Wed, Sep 4, 1:17 PM · Analytics-Kanban, ops-eqiad, Operations, netops, Analytics

Fri, Aug 30

Jclark-ctr added a comment to T228102: rack/setup/install cloudcephmon100[123].
host                         	row	unit
cloudcephmon1001	b7	26
cloudcephmon1002	b4	11
cloudcephmon1003	b2	11
Fri, Aug 30, 10:18 PM · cloud-services-team (Kanban), Operations, Cloud-Services, ops-eqiad
Jclark-ctr added a comment to T224188: rack/setup/install (3) new osd ceph nodes.
host	                              row	unit
cloudcephosd1001	b7	27
cloudcephosd1002	b4	12
cloudcephosd1003	b2	12
Fri, Aug 30, 10:17 PM · ops-eqiad, Operations, cloud-services-team (Kanban), Cloud-Services
Jclark-ctr added a comment to T229873: relocate/reimage cloudvirt1021 with 10G interfaces.

This host is already located in rack b4 and already have 10g DAC cables connected

Fri, Aug 30, 9:28 PM · ops-eqiad, DC-Ops, Operations, Epic, cloud-services-team (Kanban)
Jclark-ctr added a comment to T229872: relocate/reimage cloudvirt1022 with 10G interfaces.
This host is already located in rack b7 and already have 10g DAC cables connected
Fri, Aug 30, 9:27 PM · ops-eqiad, DC-Ops, Operations, Epic, cloud-services-team (Kanban)

Wed, Aug 28

Jclark-ctr reassigned T225128: Move cloudvirtan* hardware out of CloudVPS back into production Analytics VLAN. from Jclark-ctr to Cmjohnson.
Wed, Aug 28, 10:30 PM · Analytics-Kanban, ops-eqiad, Operations, netops, Analytics
Jclark-ctr added a comment to T225128: Move cloudvirtan* hardware out of CloudVPS back into production Analytics VLAN..

Host moved cmjohnson. advised to move out if row B in to 10G racks leave 1 in B

Wed, Aug 28, 10:14 PM · Analytics-Kanban, ops-eqiad, Operations, netops, Analytics
Jclark-ctr closed T224794: Degraded RAID on helium, a subtask of T229209: Strengthen backup infrastructure and support, as Resolved.
Wed, Aug 28, 12:16 PM · Patch-For-Review, Goal, DBA, serviceops, Operations
Jclark-ctr closed T224794: Degraded RAID on helium as Resolved.
Wed, Aug 28, 12:16 PM · ops-eqiad, Operations

Mon, Aug 26

Jclark-ctr added a comment to T228926: rack/setup/instal (4) CI ganeti nodes.

entered ip addresses in IDRAC and set password ganeti10[19...22]

Mon, Aug 26, 10:27 PM · ops-eqiad, Operations
Jclark-ctr added a comment to T228924: rack/setup/install ganeti10([09]|1[0-8[).eqiad.wmnet.

entered ip addresses in IDRAC and set password ganeti10([09]|1[0-8[)

Mon, Aug 26, 10:22 PM · ops-eqiad, vm-requests, Operations

Aug 23 2019

Jclark-ctr closed T231047: apply hostname label for wmf5176/gerrit1001, a subtask of T231046: setup/install gerrit1001, as Resolved.
Aug 23 2019, 4:54 PM · Gerrit, Operations
Jclark-ctr closed T231047: apply hostname label for wmf5176/gerrit1001 as Resolved.

host labeled with gerrit1001

Aug 23 2019, 4:54 PM · Operations

Aug 22 2019

Jclark-ctr added a comment to T220853: VMs on cloudvirt1015 crashing - bad mainboard/memory.

motherboard replaced set idrac and password

Aug 22 2019, 10:03 PM · Operations, ops-eqiad, DC-Ops, User-Zppix, cloud-services-team (Kanban)
Jclark-ctr reassigned T217556: Decommission old eqiad logstash hardware hosts logstash100[456] from Jclark-ctr to Cmjohnson.
Aug 22 2019, 7:49 PM · observability, decommission, DC-Ops, ops-eqiad, User-herron, Operations, Wikimedia-Logstash
Jclark-ctr reassigned T221818: Decommission labnet1001 & labnet1002 from Jclark-ctr to Cmjohnson.
Aug 22 2019, 5:17 PM · Patch-For-Review, ops-eqiad, decommission, Operations
Jclark-ctr added a comment to T221818: Decommission labnet1001 & labnet1002.

wiped disk on labnet1002 removed from netbox and racks.

Aug 22 2019, 5:15 PM · Patch-For-Review, ops-eqiad, decommission, Operations
Jclark-ctr updated the task description for T221818: Decommission labnet1001 & labnet1002.
Aug 22 2019, 5:10 PM · Patch-For-Review, ops-eqiad, decommission, Operations
Jclark-ctr assigned T189921: decom californium to Cmjohnson.
Aug 22 2019, 4:35 PM · Patch-For-Review, ops-eqiad, decommission, DC-Ops, Operations
Jclark-ctr added a comment to T189921: decom californium.

Disk wiped, Removed host from Netbox and racks placed in storage.

Aug 22 2019, 4:34 PM · Patch-For-Review, ops-eqiad, decommission, DC-Ops, Operations
Jclark-ctr placed T189921: decom californium up for grabs.
Aug 22 2019, 4:32 PM · Patch-For-Review, ops-eqiad, decommission, DC-Ops, Operations

Aug 21 2019

Jclark-ctr updated the task description for T221857: Decommission labservices1001 & labservices1002.
Aug 21 2019, 6:00 PM · Patch-For-Review, ops-eqiad, decommission, Operations
Jclark-ctr updated the task description for T220590: Decom ms-be101[345].
Aug 21 2019, 5:59 PM · Patch-For-Review, ops-eqiad, decommission, User-fgiunchedi, media-storage, Operations
Jclark-ctr updated the task description for T209181: Decommission rdb1001, rdb1002, rdb1003, rdb1004, rdb1007, rdb1008.
Aug 21 2019, 5:58 PM · ops-eqiad, decommission, User-jijiki, Operations
Jclark-ctr added a comment to T230442: Degraded RAID on cloudvirt1024 -- Filesystem mounted read-only.

Received replacement SSD 1.9t

Aug 21 2019, 4:30 PM · ops-eqiad, Operations

Aug 20 2019

Jclark-ctr reassigned T228102: rack/setup/install cloudcephmon100[123] from Jclark-ctr to RobH.
Aug 20 2019, 7:48 PM · cloud-services-team (Kanban), Operations, Cloud-Services, ops-eqiad
Jclark-ctr added a comment to T224188: rack/setup/install (3) new osd ceph nodes.

added asset tags updated Netbox

Aug 20 2019, 7:23 PM · ops-eqiad, Operations, cloud-services-team (Kanban), Cloud-Services
Jclark-ctr claimed T228102: rack/setup/install cloudcephmon100[123].
Aug 20 2019, 7:11 PM · cloud-services-team (Kanban), Operations, Cloud-Services, ops-eqiad
Jclark-ctr added a comment to T217556: Decommission old eqiad logstash hardware hosts logstash100[456].

@Cmjohnson Finished wiping i will be removing from rack shortly

Aug 20 2019, 6:46 PM · observability, decommission, DC-Ops, ops-eqiad, User-herron, Operations, Wikimedia-Logstash
Jclark-ctr added a comment to T228102: rack/setup/install cloudcephmon100[123].

asset tagged and added to Netbox

Aug 20 2019, 6:33 PM · cloud-services-team (Kanban), Operations, Cloud-Services, ops-eqiad
Jclark-ctr reassigned T228102: rack/setup/install cloudcephmon100[123] from Jclark-ctr to RobH.
Aug 20 2019, 6:33 PM · cloud-services-team (Kanban), Operations, Cloud-Services, ops-eqiad

Aug 14 2019

Jclark-ctr closed T230458: hw troubleshooting: power supply for db1129 as Resolved.

Found Power cable not fully seated . Reseated cable.

Aug 14 2019, 3:23 PM · DBA, Operations, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T228926: rack/setup/instal (4) CI ganeti nodes.
Aug 14 2019, 1:50 PM · ops-eqiad, Operations
Jclark-ctr updated the task description for T228924: rack/setup/install ganeti10([09]|1[0-8[).eqiad.wmnet.
Aug 14 2019, 1:47 PM · ops-eqiad, vm-requests, Operations

Aug 9 2019

Jclark-ctr updated the task description for T217556: Decommission old eqiad logstash hardware hosts logstash100[456].
Aug 9 2019, 9:34 PM · observability, decommission, DC-Ops, ops-eqiad, User-herron, Operations, Wikimedia-Logstash

Aug 8 2019

Jclark-ctr added a comment to T224794: Degraded RAID on helium.

Replaced the disk at slot 11

Aug 8 2019, 9:54 PM · ops-eqiad, Operations

Aug 1 2019

Jclark-ctr updated the task description for T209181: Decommission rdb1001, rdb1002, rdb1003, rdb1004, rdb1007, rdb1008.
Aug 1 2019, 4:46 PM · ops-eqiad, decommission, User-jijiki, Operations
Jclark-ctr updated the task description for T220590: Decom ms-be101[345].
Aug 1 2019, 4:45 PM · Patch-For-Review, ops-eqiad, decommission, User-fgiunchedi, media-storage, Operations
Jclark-ctr updated the task description for T209181: Decommission rdb1001, rdb1002, rdb1003, rdb1004, rdb1007, rdb1008.
Aug 1 2019, 3:34 PM · ops-eqiad, decommission, User-jijiki, Operations

Jul 31 2019

Jclark-ctr added a comment to T229453: elastic1031 - PSU status critical.

inspected elastic1031 both PSU green inspected cables verified fully seated into recently replaced PDU. no physical faults found

Jul 31 2019, 6:40 PM · ops-eqiad, Discovery-Search (Current work), Operations
Jclark-ctr closed Unknown Object (Task), a subtask of T224794: Degraded RAID on helium, as Resolved.
Jul 31 2019, 6:09 PM · ops-eqiad, Operations
Jclark-ctr updated the task description for T221857: Decommission labservices1001 & labservices1002.
Jul 31 2019, 4:52 PM · Patch-For-Review, ops-eqiad, decommission, Operations
Jclark-ctr updated the task description for T221857: Decommission labservices1001 & labservices1002.
Jul 31 2019, 4:49 PM · Patch-For-Review, ops-eqiad, decommission, Operations
Jclark-ctr updated the task description for T220590: Decom ms-be101[345].
Jul 31 2019, 3:57 PM · Patch-For-Review, ops-eqiad, decommission, User-fgiunchedi, media-storage, Operations

Jul 30 2019

Jclark-ctr updated the task description for T229284: add all remaining new pdus to netbox.
Jul 30 2019, 4:57 PM · DC-Ops, Operations, ops-eqiad

Jul 26 2019

Jclark-ctr reassigned T229124: add jclark to datacenter-ops group from Jclark-ctr to wiki_willy.

ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+1duGbT11VE4IV3KKFzdmHhSl2fAA0CkL93edalw2yqroMxzHjah7GwKB5csjrrbqhn+po0478jsU8OG8hgJBRKSq2cG04ryQk8MVSIy6gnqQ75/5gC4U6wJ50y8MKeMyZCHzMsjs+4xdh9WvJH4cfliPRWYp1JBJpE6E22KE+HK07HYX0TkvyfMf2cLaA0pz1Ovbll8gWb9L9vyKDRmv8+NkaJcLTuKoqSFpxz/UCjVGyBJckDyJbX9FEUyjjMclg+c6C8s2aNgfe3gMKmkKxSEfEqbXuNWfJEVAqJ667MhtsGV92pp6rSWdtAgm6IqGE19hUNFqAy3XiX8vEQY3 jclark@LoanerWMF1953

Jul 26 2019, 3:48 PM · Operations, SRE-Access-Requests