Page MenuHomePhabricator
Feed Advanced Search

Yesterday

Jclark-ctr updated the task description for T267666: (Need By: TBD) rack/setup/install logstash-be103[345].
Thu, Jan 21, 12:07 AM · ops-eqiad, DC-Ops, SRE
Jclark-ctr added a comment to T267666: (Need By: TBD) rack/setup/install logstash-be103[345].

@Cmjohnson all host racked and cabled netbox updated
host port
logstash-be1033 39
logstash-be1034 21
logstash-be1035 7

Thu, Jan 21, 12:06 AM · ops-eqiad, DC-Ops, SRE

Wed, Jan 20

Jclark-ctr added a comment to T267414: (Need By: TBD) rack/setup/install aqs101[0-5].

@Cmjohnson. host are racked and cabled netbox is updated
host , port
aqs1010 7
aqs1011 23
aqs1012 36
aqs1013 31
aqs1014 6
aqs1015 14

Wed, Jan 20, 11:10 PM · SRE, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T267414: (Need By: TBD) rack/setup/install aqs101[0-5].
Wed, Jan 20, 11:09 PM · SRE, ops-eqiad, DC-Ops

Tue, Jan 19

Jclark-ctr updated the task description for T267043: (Need By: 2020-11-29) rack/setup/install db11[51-76].
Tue, Jan 19, 10:15 PM · DBA, ops-eqiad, SRE, DC-Ops
Jclark-ctr added a comment to T267043: (Need By: 2020-11-29) rack/setup/install db11[51-76].

DYT7773 is correct ST for db1156 located last DB server racked in D3 U12

Tue, Jan 19, 10:14 PM · DBA, ops-eqiad, SRE, DC-Ops

Thu, Jan 14

Jclark-ctr updated subscribers of T267043: (Need By: 2020-11-29) rack/setup/install db11[51-76].

@RobH @Cmjohnson DYV8773 is the ST not in netbox right now

Thu, Jan 14, 9:24 PM · DBA, ops-eqiad, SRE, DC-Ops

Mon, Jan 11

Jclark-ctr added a comment to T267043: (Need By: 2020-11-29) rack/setup/install db11[51-76].

@LSobanski I will be working on these this week. As long as nothing comes up urgent it should not be that long

Mon, Jan 11, 1:22 PM · DBA, ops-eqiad, SRE, DC-Ops

Fri, Jan 8

Jclark-ctr added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

host configured and racked

Fri, Jan 8, 2:56 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr updated the task description for T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].
Fri, Jan 8, 2:56 PM · ops-eqiad, SRE, DC-Ops

Wed, Jan 6

Jclark-ctr added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

Host racked ,working on cabling, netbox updated.
host port rack
ml-serve1001 12 a1
ml-serve1002 36 b5
ml-serve1003 5 c3
ml-serve1004 27 d8

Wed, Jan 6, 11:19 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

Gpu dose not fit.

Wed, Jan 6, 5:24 PM · ops-eqiad, SRE, DC-Ops

Tue, Jan 5

Jclark-ctr added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

Tue, Jan 5, 9:50 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].
Tue, Jan 5, 9:48 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

@RobH @wiki_willy
Attached 3 photos Unfortunately large cooling fins have fitment issues in dell case. Any future gpu can not extend past backplane bracket

Tue, Jan 5, 9:47 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr updated the task description for T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].
Tue, Jan 5, 9:16 PM · ops-eqiad, SRE, DC-Ops

Dec 12 2020

Jclark-ctr closed Unknown Object (Task), a subtask of T212129: Move MainStash out of Redis to a simpler multi-dc aware solution, as Resolved.
Dec 12 2020, 11:08 PM · Performance-Team, Sustainability (MediaWiki-MultiDC), MediaWiki-General, serviceops-radar, User-mobrovac, User-jijiki, SRE
Jclark-ctr closed Unknown Object (Task), a subtask of T266192: Connect cloudstore1008 and cloudstore1009 directly via second 10G interface similar to labstore1004/5, as Resolved.
Dec 12 2020, 11:01 PM · cloud-services-team (Hardware), ops-eqiad, Data-Services, SRE

Dec 11 2020

Jclark-ctr added a comment to T268285: update RAID controller firmware on labstore1006, 1007.

labstore1006 has firmware 6.6 for smart array controller

Dec 11 2020, 12:00 PM · ops-eqiad, cloud-services-team (Kanban), SRE
Jclark-ctr updated the task description for T267414: (Need By: TBD) rack/setup/install aqs101[0-5].
Dec 11 2020, 11:57 AM · SRE, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T267414: (Need By: TBD) rack/setup/install aqs101[0-5].

@Cmjohnson Those came in with that large shipment of 8 8 6
S01720435 - 8 boxes on 1 pallet - T264584_PO1016
S01719765 - 8 boxes on 1 pallet - T264584_PO1016
S01720518 - 6 boxes on 1 pallet - T264336_PO1025

Dec 11 2020, 11:57 AM · SRE, ops-eqiad, DC-Ops

Dec 9 2020

Jclark-ctr closed T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27 as Resolved.
Dec 9 2020, 9:37 PM · SRE, DBA, ops-eqiad
Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

Replaced more Dimms per HP no errors at this

Dec 9 2020, 9:26 PM · SRE, DBA, ops-eqiad
Jclark-ctr added a comment to T268285: update RAID controller firmware on labstore1006, 1007.

@Bstorm thanks I can take care of this today around 4:30pm est

Dec 9 2020, 6:22 PM · ops-eqiad, cloud-services-team (Kanban), SRE

Dec 8 2020

Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

HP sent 2 more Dimms requesting to be changed. just arrived will change tomorrow

Dec 8 2020, 11:53 PM · SRE, DBA, ops-eqiad

Dec 4 2020

Jclark-ctr closed Unknown Object (Task), a subtask of T257244: 2020-2021 fundraising hardware refresh and capex, as Resolved.
Dec 4 2020, 12:00 AM · fundraising-tech-ops

Dec 3 2020

Dzahn awarded T269050: mw1304.mgmt down a Like token.
Dec 3 2020, 2:43 PM · ops-eqiad, SRE
Jclark-ctr closed T269050: mw1304.mgmt down as Resolved.

replaced mgmt cable. error cleared in icinga

Dec 3 2020, 12:11 PM · ops-eqiad, SRE
Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

downloaded and sent log again to hp.

Dec 3 2020, 12:04 PM · SRE, DBA, ops-eqiad

Dec 1 2020

Jclark-ctr added a comment to T268804: Replace asw2-c-eqiad VC cable.

updated netbox with cable info.

Dec 1 2020, 2:15 PM · ops-eqiad, SRE
Jclark-ctr added a comment to T268808: Replace asw2-d-eqiad VC cable.

updated netbox with cable info.

Dec 1 2020, 2:15 PM · SRE, ops-eqiad
Jclark-ctr added a comment to T268808: Replace asw2-d-eqiad VC cable.

replaced qsfp+ on D2, Cleaned both fiber ends will leave ticket open while monitoring

Dec 1 2020, 2:15 PM · SRE, ops-eqiad
Jclark-ctr added a comment to T268804: Replace asw2-c-eqiad VC cable.

Cleaned both fiber ends will leave ticket open for now while monitoring.

Dec 1 2020, 2:14 PM · ops-eqiad, SRE

Nov 30 2020

Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

reseated dimm`s errors persisted following up with HP

Nov 30 2020, 7:40 PM · SRE, DBA, ops-eqiad

Nov 26 2020

Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

@LSobanski I will be on site Monday

Nov 26 2020, 12:22 PM · SRE, DBA, ops-eqiad

Nov 25 2020

Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

@jcrespo just heard back from HP they want to remap dimm again

Nov 25 2020, 8:57 PM · SRE, DBA, ops-eqiad

Nov 19 2020

Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

@jcrespo Replaced Dimms per hp.

Nov 19 2020, 8:21 PM · SRE, DBA, ops-eqiad
Jclark-ctr added a comment to T267065: eqiad: Server moves to free up space on 10g racks.

@Cmjohnson would you be able to do switch ports?
A4 stat1004 A5 U32 Port32
A4 analytics1070 A5 U37 port37
A4 aqs1004 A3. U13 port12
A4 druid1001

Nov 19 2020, 12:04 AM · Platform Team Workboards (Green), ops-eqiad, DC-Ops, SRE

Nov 17 2020

Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

@jcrespo. replacement dimms should arrive Thursday. Unsure what time they will arrive we can shoot for Thursday. If they arrive late it will not be till Friday.

Nov 17 2020, 10:56 PM · SRE, DBA, ops-eqiad
Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

@jcrespo will need downtime for host to remap dimms per HPE

Nov 17 2020, 5:57 PM · SRE, DBA, ops-eqiad

Nov 16 2020

Jclark-ctr closed Unknown Object (Task), a subtask of T266016: Refresh and expand Swift hardware capacity, as Resolved.
Nov 16 2020, 10:34 PM · User-fgiunchedi, SRE-swift-storage
Jclark-ctr closed Unknown Object (Task), a subtask of T257244: 2020-2021 fundraising hardware refresh and capex, as Resolved.
Nov 16 2020, 10:33 PM · fundraising-tech-ops

Nov 10 2020

Jclark-ctr added a comment to T267065: eqiad: Server moves to free up space on 10g racks.

@elukey Please Review the racks i have recommended let me know if anything needs to change
@Cmjohnson Will wait for after Luca gives the ok to configure ports

Nov 10 2020, 3:29 PM · Platform Team Workboards (Green), ops-eqiad, DC-Ops, SRE

Nov 6 2020

Jclark-ctr added a comment to T267065: eqiad: Server moves to free up space on 10g racks.

@elukey Hey when you get a chance can you let me know best day i can schedule with you some movies next week?

Nov 6 2020, 2:57 PM · Platform Team Workboards (Green), ops-eqiad, DC-Ops, SRE

Nov 5 2020

Jclark-ctr updated the task description for T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.
Nov 5 2020, 6:17 PM · SRE, DBA, ops-eqiad
Jclark-ctr closed T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27 as Resolved.
Nov 5 2020, 6:16 PM · SRE, DBA, ops-eqiad
Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

@jcrespo mainboard replaced server is powered on

Nov 5 2020, 6:10 PM · SRE, DBA, ops-eqiad

Nov 4 2020

Jclark-ctr added a comment to T267242: Network blip for mw hosts in rack C3 (eqiad).

@ayounsi I was working in C2 earlier i did remove old pdu possible i bumped a DAC cable then. it would of been 2-3 hours prior to this ticket/

Nov 4 2020, 5:37 PM · ops-eqiad, SRE, netops
Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

@jcrespo thanks please have host down will change mainboard tomorrow

Nov 4 2020, 3:07 PM · SRE, DBA, ops-eqiad

Oct 29 2020

Jclark-ctr closed Unknown Object (Task), a subtask of T255145: Analytics Hardware for Fiscal Year 2020/2021, as Resolved.
Oct 29 2020, 10:57 PM · Analytics-Kanban
Jclark-ctr reassigned T260269: (Need By: TBD) rack/setup/install maps10[05-10].eqiad.wmnet from Jclark-ctr to RobH.
Oct 29 2020, 6:42 PM · Maps, ops-eqiad, DC-Ops, SRE

Sep 25 2020

Jclark-ctr closed Unknown Object (Task), a subtask of T255146: Put 24 Hadoop worker nodes in service (cluster expansion), as Resolved.
Sep 25 2020, 2:59 PM · Analytics-Clusters

Sep 21 2020

Jclark-ctr closed Unknown Object (Task), a subtask of T257242: frdb1001 hardware refresh, as Resolved.
Sep 21 2020, 12:50 AM · fundraising-tech-ops

Sep 8 2020

Jclark-ctr updated the task description for T261452: Tue, Sept 8 PDU Upgrade 12pm-4pm UTC- Racks D3 and D4.
Sep 8 2020, 3:33 PM · SRE, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T261452: Tue, Sept 8 PDU Upgrade 12pm-4pm UTC- Racks D3 and D4.
Sep 8 2020, 3:33 PM · SRE, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T261452: Tue, Sept 8 PDU Upgrade 12pm-4pm UTC- Racks D3 and D4.

starting maintenance do not expect any outages will be disconnecting pdu`s in about 1 hour

Sep 8 2020, 12:20 PM · SRE, ops-eqiad, DC-Ops

Sep 7 2020

Jclark-ctr added a comment to T261405: db1139 memory errors on boot (issue continues after board change) 2020-08-27.

Hello John,

Sep 7 2020, 2:43 PM · SRE, DBA, ops-eqiad
Jclark-ctr closed Unknown Object (Task), a subtask of T257551: Expand database provisioning/backup service to accomodate for growing capacity and high availability needs, as Resolved.
Sep 7 2020, 1:27 PM · Patch-For-Review, Goal, DBA
Jclark-ctr closed Unknown Object (Task), a subtask of T257245: procure and deploy new frmail server role, as Resolved.
Sep 7 2020, 1:21 PM · fundraising-tech-ops

Sep 2 2020

Jclark-ctr added a comment to T261348: (Need By: TBD) install new controller into frdb1001 OR add to spares.

received raid controller

Sep 2 2020, 8:09 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr updated the task description for T261348: (Need By: TBD) install new controller into frdb1001 OR add to spares.
Sep 2 2020, 8:08 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr closed Unknown Object (Task), a subtask of T261221: RAID controller failing on frdb1002.frack.eqiad.wmnet, as Resolved.
Sep 2 2020, 8:08 PM · ops-eqiad, fundraising-tech-ops, DC-Ops, SRE

Aug 31 2020

Jclark-ctr added a comment to T260448: (Need By: 2020-09-15) upgrade/replace memory in stat100[58].

received memory placed in storage room

Aug 31 2020, 11:30 PM · Analytics-Clusters, SRE, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T260448: (Need By: 2020-09-15) upgrade/replace memory in stat100[58].
Aug 31 2020, 11:30 PM · Analytics-Clusters, SRE, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T259909: (Need By: TBD) install memory upgrades in ores100[1-9].

Received memory. placed in storage room

Aug 31 2020, 11:27 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr updated the task description for T259909: (Need By: TBD) install memory upgrades in ores100[1-9].
Aug 31 2020, 11:27 PM · ops-eqiad, SRE, DC-Ops
Jclark-ctr added a comment to T236327: replace onboard NIC in kafka-jumbo100[1-6].

@elukey will these host be part of the fail over?

Aug 31 2020, 8:37 PM · Analytics-Clusters, ops-eqiad, SRE, User-Elukey

Aug 25 2020

Jclark-ctr updated the task description for T260817: (Need By: 2020-09-15) rack/setup/install db1150 (see note on hostname).
Aug 25 2020, 8:22 PM · SRE, DBA, ops-eqiad, DC-Ops
Jclark-ctr updated the task description for T260817: (Need By: 2020-09-15) rack/setup/install db1150 (see note on hostname).
Aug 25 2020, 8:20 PM · SRE, DBA, ops-eqiad, DC-Ops
Jclark-ctr added a comment to T258747: (Need By: TBD) rack/setup/install kubernetes1017.eqiad.wmnet.

Racked and cabled host

Aug 25 2020, 8:19 PM · serviceops, ops-eqiad, SRE, DC-Ops
Jclark-ctr reassigned T258747: (Need By: TBD) rack/setup/install kubernetes1017.eqiad.wmnet from Jclark-ctr to Cmjohnson.
Aug 25 2020, 8:19 PM · serviceops, ops-eqiad, SRE, DC-Ops

Aug 24 2020

Jclark-ctr added a comment to T245161: Track down and replace very old HW.

located samarium removed from racks corrected netbox error

Aug 24 2020, 11:02 PM · Patch-For-Review, DC-Ops
Jclark-ctr closed T260772: Check samarium status in Netbox as Resolved.

https://phabricator.wikimedia.org/T197630. corrected netbox removed host from rack

Aug 24 2020, 11:01 PM · SRE, ops-eqiad, DC-Ops
Jclark-ctr closed T197630: decommission samarium.frack.eqiad.wmnet as Resolved.
Aug 24 2020, 11:00 PM · DC-Ops, ops-eqiad, SRE
Jclark-ctr added a comment to T197630: decommission samarium.frack.eqiad.wmnet.

removed from rack updated netbox Resolving ticket previous comments list ports already removed

Aug 24 2020, 11:00 PM · DC-Ops, ops-eqiad, SRE

Aug 19 2020

Jclark-ctr closed Unknown Object (Task), a subtask of T257551: Expand database provisioning/backup service to accomodate for growing capacity and high availability needs, as Resolved.
Aug 19 2020, 12:57 AM · Patch-For-Review, Goal, DBA
Jclark-ctr added a comment to T259162: (Need By: TBD) upgrade ram in an-master100[12].

@elukey. ram has arrived how long will it take to drain host? and how long can they be down?

Aug 19 2020, 12:54 AM · SRE, Analytics-Clusters, ops-eqiad

Aug 17 2020

Jclark-ctr reassigned T252797: asw2-d1-eqiad:VCP failure from Jclark-ctr to ayounsi.
Aug 17 2020, 6:37 PM · SRE, netops, ops-eqiad

Jul 30 2020

Jclark-ctr reassigned T259071: (Need By: TBD) rack/setup/install an-worker11[02-17] from Jclark-ctr to Cmjohnson.

name rack position asset_tag switchport
an-worker1102 A4 39 WMF5406 38
an-worker1103 A7 39 WMF5407 25
an-worker1104 C2 34 WMF5408 34
an-worker1105 C4 18 WMF5409 43
an-worker1106 C4 22 WMF5410 41
an-worker1107 C4 24 WMF5411 42
an-worker1108 C4 36 WMF5412 40
an-worker1109 C7 4 WMF5413 29
an-worker1110 C7 17 WMF5414 39
an-worker1111 C8 12 WMF5415 12
an-worker1112 D2 39 WMF5416 19
an-worker1113 D5 18 WMF5417 16
an-worker1114 D5 20 WMF5418 17
an-worker1115 D7 15 WMF5419 24
an-worker1116 D7 39 WMF5420 23
an-worker1117 B4 38 WMF5421 10

Jul 30 2020, 9:12 PM · Analytics-Radar, ops-eqiad, SRE, DC-Ops
Jclark-ctr updated the task description for T259071: (Need By: TBD) rack/setup/install an-worker11[02-17].
Jul 30 2020, 9:09 PM · Analytics-Radar, ops-eqiad, SRE, DC-Ops

Jul 27 2020

Jclark-ctr added a comment to T258910: Remove db1082's BBU on-site.

@Marostegui removed bbu. host is booting up now

Jul 27 2020, 5:04 PM · ops-eqiad, SRE
Jclark-ctr added a comment to T258910: Remove db1082's BBU on-site.

@Marostegui is host down now? i can remove in about 1 hour

Jul 27 2020, 4:03 PM · ops-eqiad, SRE

Jul 24 2020

Jclark-ctr added a comment to T258018: ripe-atlas-eqiad IPv6 unreachable.

Connected console port to scs-c1-eqiad updated netbox with connection

Jul 24 2020, 8:41 PM · SRE, netops
Jclark-ctr closed T258221: please connect eqiad's RIPE Atlas anchor to one of the SCSes, a subtask of T258018: ripe-atlas-eqiad IPv6 unreachable, as Resolved.
Jul 24 2020, 8:41 PM · SRE, netops
Jclark-ctr closed T258221: please connect eqiad's RIPE Atlas anchor to one of the SCSes as Resolved.
Jul 24 2020, 8:40 PM · SRE, ops-eqiad
Jclark-ctr added a comment to T258221: please connect eqiad's RIPE Atlas anchor to one of the SCSes.

@CDanis connected console to port 41 on scs-c1-eqiad

Jul 24 2020, 8:35 PM · SRE, ops-eqiad

Jul 22 2020

Jclark-ctr added a comment to T253607: Degraded RAID on restbase-dev1004.

@hnowlan
Replaced failed drive

Jul 22 2020, 2:35 PM · DC-Ops, Platform Team Workboards (Green), ops-eqiad, SRE
Jclark-ctr added a comment to T258249: db1145 crashed - memory issues.

@jcrespo maintenance is completed

Jul 22 2020, 2:21 PM · SRE, ops-eqiad, DBA

Jul 21 2020

Jclark-ctr added a comment to T253607: Degraded RAID on restbase-dev1004.

@hnowlan replacement drive arrived today can you confirm drive can just be replaced. will take care of tomorrow.

Jul 21 2020, 10:29 PM · DC-Ops, Platform Team Workboards (Green), ops-eqiad, SRE
Jclark-ctr closed Unknown Object (Task), a subtask of T253607: Degraded RAID on restbase-dev1004, as Resolved.
Jul 21 2020, 10:22 PM · DC-Ops, Platform Team Workboards (Green), ops-eqiad, SRE
Jclark-ctr closed Unknown Object (Task), a subtask of T243521: Hadoop Hardware Orders FY2019-2020, as Resolved.
Jul 21 2020, 10:20 PM · Analytics-Kanban, Analytics
Jclark-ctr added a comment to T236327: replace onboard NIC in kafka-jumbo100[1-6].

@elukey can you let me know your availability for scheduling this project?

Jul 21 2020, 10:20 PM · Analytics-Clusters, ops-eqiad, SRE, User-Elukey
Jclark-ctr added a comment to T258249: db1145 crashed - memory issues.

@Marostegui Replacement Dimm has arrived please reach out to me for scheduling down time i am available for the next 2 hours but will be on site tomorrow 9:30am est

Jul 21 2020, 8:18 PM · SRE, ops-eqiad, DBA
Jclark-ctr added a comment to T257949: Degraded RAID on ms-be1024.

finished with bbu swap

Jul 21 2020, 3:16 PM · ops-eqiad, SRE

Jul 20 2020

Jclark-ctr updated the task description for T255406: decommission dbproxy1008.eqiad.wmnet.
Jul 20 2020, 10:36 PM · Patch-For-Review, DC-Ops, ops-eqiad, SRE, decommission-hardware
Jclark-ctr updated the task description for T256216: Decommission dbproxy1003.eqiad.wmnet.
Jul 20 2020, 10:35 PM · DC-Ops, SRE, ops-eqiad, decommission-hardware
Jclark-ctr updated the task description for T256216: Decommission dbproxy1003.eqiad.wmnet.
Jul 20 2020, 10:34 PM · DC-Ops, SRE, ops-eqiad, decommission-hardware
Jclark-ctr updated the task description for T257406: decommission db1097.eqiad.wmnet.
Jul 20 2020, 10:28 PM · Patch-For-Review, DC-Ops, ops-eqiad, decommission-hardware, SRE
Jclark-ctr added a comment to T257949: Degraded RAID on ms-be1024.

@fgiunchedi if you would like bbu swapped i am available tomorrow morning eastern time

Jul 20 2020, 10:16 PM · ops-eqiad, SRE
Jclark-ctr added a comment to T258249: db1145 crashed - memory issues.

Confirmed: Service Request 1030121866 was successfully submitted.

Jul 20 2020, 10:15 PM · SRE, ops-eqiad, DBA