User Details
User Details
- User Since
- Dec 18 2014, 3:39 PM (259 w, 4 h)
- Availability
- Available
- LDAP User
- Papaul
- MediaWiki User
- Unknown
Yesterday
Yesterday
Papaul updated the task description for T239733: codfw:rack/setup/install frdb2002.
Papaul added a comment to T239733: codfw:rack/setup/install frdb2002.
apaul@fasw-c-codfw# run show interfaces ge-[0-1]/0/20 descriptions Interface Admin Link Description ge-0/0/20 up up frdb2002:eth0 ge-1/0/20 up up frdb2002:eth1
Papaul added a comment to T239733: codfw:rack/setup/install frdb2002.
papaul@fasw-c-codfw# show | compare
[edit interfaces interface-range vlan-fundraising]
member "ge-[0-1]/0/19" { ... }
+ member "ge-[0-1]/0/20";
[edit interfaces]
+ ge-0/0/20 {
+ description frdb2002:eth0;
+ }
+ ge-1/0/20 {
+ description frdb2002:eth1;
+ }Papaul added a comment to T239733: codfw:rack/setup/install frdb2002.
Virtual Disk 0: RAID10, 5.237TB, Ready
Papaul moved T233185: Decommission db2067.codfw.wmnet from Backlog to Decommission on the ops-codfw board.
Papaul moved T239732: codfw: rack/setup/install puppetnaster2003.codfw.wmnet from Backlog to Racking Tasks on the ops-codfw board.
Papaul moved T239733: codfw:rack/setup/install frdb2002 from Backlog to Racking Tasks on the ops-codfw board.
Papaul moved T239805: ms-fe2007 NIC failure from Backlog to Hardware Failure / Troubleshoot on the ops-codfw board.
Reset the IDRAC server is back up
Papaul added a comment to T239805: ms-fe2007 NIC failure.
@fgiunchedi the 10G NiC is dead
Papaul updated the task description for T238726: Decommission db2062.codfw.wmnet.
Papaul added a comment to T233185: Decommission db2067.codfw.wmnet.
[edit interfaces interface-range vlan-private1-d-codfw]
- member ge-6/0/15;
[edit interfaces interface-range disabled]
member ge-6/0/9 { ... }
+ member ge-6/0/15;
[edit interfaces]
- ge-6/0/15 {
- description db2067;
- enable;
- }Tue, Dec 3
Tue, Dec 3
We can resolve this task for now and re-open if that drive fails
Papaul updated the task description for T239733: codfw:rack/setup/install frdb2002.
Papaul updated the task description for T239733: codfw:rack/setup/install frdb2002.
Papaul updated the task description for T239733: codfw:rack/setup/install frdb2002.
Papaul added a comment to T239733: codfw:rack/setup/install frdb2002.
@Jgreen I need some information for this server.
Papaul updated the task description for T239732: codfw: rack/setup/install puppetnaster2003.codfw.wmnet.
Papaul added a comment to T239009: Degraded RAID on ganeti2002.
@akosiaris after removing and putting the failed disk back the disk came back online with no errors
Mon, Dec 2
Mon, Dec 2
Papaul moved T239249: codfw: rack/setup/install mc203[7,8,9].codfw.wmnet from Backlog to Racking Tasks on the ops-codfw board.
Papaul moved T238726: Decommission db2062.codfw.wmnet from Procurement to Decommission on the ops-codfw board.
Papaul moved T238726: Decommission db2062.codfw.wmnet from Backlog to Procurement on the ops-codfw board.
Papaul added a comment to T232126: Decommission old mw2231/WMF6435 replaced with WMF6403.
@Volans Thanks
Papaul added a comment to T238726: Decommission db2062.codfw.wmnet.
papaul@asw-b-codfw# show | compare
[edit interfaces interface-range vlan-private1-b-codfw]
- member ge-5/0/40;
[edit interfaces interface-range disabled]
member ge-8/0/17 { ... }
+ member ge-5/0/40;
[edit interfaces]
- ge-5/0/40 {
- description db2062;
- enable;
- }Papaul updated the task description for T238726: Decommission db2062.codfw.wmnet.
Papaul updated the task description for T238726: Decommission db2062.codfw.wmnet.
Resolving this task since redundancy power is working in codfw
Update Netxbox
I update Netbox
Papaul updated subscribers of T239009: Degraded RAID on ganeti2002.
@akosiaris please see @wiki_willy comment above.
Sat, Nov 30
Sat, Nov 30
Papaul added a comment to T232126: Decommission old mw2231/WMF6435 replaced with WMF6403.
@Volans confirm that 10.193.1.118 is indeed the mgmt IP address for mw2231 and 10.193.2.251 is no longer in use.
Papaul added a comment to T232126: Decommission old mw2231/WMF6435 replaced with WMF6403.
@Volans do we have a template in place when a server name changes from X to Y to also update DNS in netbox. The last steps that I recalled were
1- change switch port description
2- change physical label
Papaul closed T238526: Decommission db2061.codfw.wmnet, a subtask of T228258: Decommission db2043-db2070, as Resolved.
Wed, Nov 27
Wed, Nov 27
Papaul added a comment to T239345: scs-[a1-c1]-codfw redundancy power test.
Looks like redundancy power is working on both scs's in codfw. What thing to do in esams is to try to change the outlet in which the scs is plugged in on ps2-oe16-esams and ps1-oe16-esams. we did have the same power issue on the mr1 while we were there.
Papaul updated the task description for T239249: codfw: rack/setup/install mc203[7,8,9].codfw.wmnet.
RobH awarded T239345: scs-[a1-c1]-codfw redundancy power test a Like token.
Papaul renamed T239345: scs-[a1-c1]-codfw redundancy power test from scs-[a1-c8]-codfw redundancy power test to scs-[a1-c1]-codfw redundancy power test.
Papaul added a comment to T239345: scs-[a1-c1]-codfw redundancy power test.
Test on scs-a1-codfw
Test1: turn off power switch on psu1 and turn on power switch on psu2
device is still on
Test2: turn off power switch on psu2 and turn on power switch on psu1
device is still
Tue, Nov 26
Tue, Nov 26
Papaul added a comment to T184066: rack/setup/install ps[12]-oe1[456]-esams.
qfx5100-spare1, psu 0 {#20156} to ps2-oe15-esams:17
qfx5100-spare2, psu 0 {#20157} to ps2-oe15-esams:16
qfx5100-spare1, psu 1 {#20159} to ps1-oe15-esams:2
qfx5100-spare2, psu 1 {#20158} to ps1-oe15-esams:3
Mon, Nov 25
Mon, Nov 25
complete
Before
BIOS Version 2.2.11
iDRAC Firmware Version 3.34.34.34
Fri, Nov 22
Fri, Nov 22
Papaul closed T237913: Decommission db2048.codfw.wmnet, a subtask of T228258: Decommission db2043-db2070, as Resolved.
Complete
Papaul updated the task description for T237913: Decommission db2048.codfw.wmnet.
Papaul closed T238526: Decommission db2061.codfw.wmnet, a subtask of T228258: Decommission db2043-db2070, as Resolved.
Complete
Papaul updated the task description for T238526: Decommission db2061.codfw.wmnet.
Complete
Papaul updated the task description for T238233: decommission alnilam.frack.codfw.wmnet.
Papaul placed T236216: rack/setup/install ganeti300[123] up for grabs.
Papaul updated the task description for T238526: Decommission db2061.codfw.wmnet.
Wed, Nov 20
Wed, Nov 20
Papaul updated the task description for T238233: decommission alnilam.frack.codfw.wmnet.
Papaul updated the task description for T237913: Decommission db2048.codfw.wmnet.
Papaul added a comment to T238526: Decommission db2061.codfw.wmnet.
papaul@asw-d-codfw# show | compare
[edit interfaces interface-range vlan-private1-d-codfw]
- member ge-6/0/9;
[edit interfaces interface-range disabled]
member ge-6/0/1 { ... }
+ member ge-6/0/9;
[edit interfaces]
- ge-6/0/9 {
- description db2061;
- enable;
- }Papaul closed T238642: Update label and switch port for wezen -> centrallog2001, a subtask of T224564: Reimage wezen to Buster (and rename to centrallog2001), as Resolved.
complete
Papaul added a comment to T224528: rack/setup codfw: cloudbackup2001.codfw.wmnet and cloudbackup2002.codfw.wmnet.
You welcome
Tue, Nov 19
Tue, Nov 19
Papaul added a comment to T238642: Update label and switch port for wezen -> centrallog2001.
papaul@asw-d-codfw# show | compare [edit interfaces ge-5/0/13] - description wezen; + description centrallog2001;
Papaul triaged T238642: Update label and switch port for wezen -> centrallog2001 as Medium priority.
Papaul added a comment to T224528: rack/setup codfw: cloudbackup2001.codfw.wmnet and cloudbackup2002.codfw.wmnet.
@Andrew this task has been resolved but both cloudbackup2001 and 2002 are showing "staged" in Netbox for status and both array are showing "planned" too.
Thu, Nov 14
Thu, Nov 14
Papaul added a comment to T238233: decommission alnilam.frack.codfw.wmnet.
papaul@fasw-c-codfw# show | compare
[edit interfaces interface-range disabled]
member "ge-[0-1]/0/8" { ... }
+ member "ge-[0-1]/0/9";
[edit interfaces interface-range vlan-fundraising]
- member "ge-[0-1]/0/9";
[edit interfaces]
- ge-0/0/9 {
- description alnilam;
- }
- ge-1/0/9 {
- description alnilam;
- }Papaul updated the task description for T237913: Decommission db2048.codfw.wmnet.
Papaul added a comment to T237913: Decommission db2048.codfw.wmnet.
papaul@asw-a-codfw# show | compare
[edit interfaces interface-range vlan-private1-a-codfw]
- member ge-1/0/0;
[edit interfaces interface-range disabled]
member ge-6/0/16 { ... }
+ member ge-1/0/0;
[edit interfaces]
- ge-1/0/0 {
- description db2048;
- }Wed, Nov 13
Wed, Nov 13
Before
BIOS Version
2.4.3
Firmware Version
2.40
Papaul added a comment to T237702: (codfw):rack/setup/install db213[2-5].
@Marostegui @jcrespo please fell free to take over the task.
Papaul updated the task description for T237702: (codfw):rack/setup/install db213[2-5].
Papaul updated the task description for T237702: (codfw):rack/setup/install db213[2-5].
Tue, Nov 12
Tue, Nov 12
Papaul moved T237913: Decommission db2048.codfw.wmnet from Backlog to Decommission on the ops-codfw board.
Papaul updated the task description for T237702: (codfw):rack/setup/install db213[2-5].
Papaul added a comment to T237702: (codfw):rack/setup/install db213[2-5].
papaul@asw-a-codfw# show | compare
[edit interfaces interface-range vlan-private1-a-codfw]
member xe-7/0/9 { ... }
+ member ge-5/0/1;
[edit interfaces interface-range disabled]
- member ge-5/0/1;
[edit interfaces]
+ ge-5/0/1 {
+ description db2132;
+ }Papaul updated the task description for T237702: (codfw):rack/setup/install db213[2-5].
Papaul updated the task description for T237702: (codfw):rack/setup/install db213[2-5].
Fri, Nov 8
Fri, Nov 8
Papaul closed T209738: decom einsteinium, a subtask of T202782: upgrade icinga server to stretch and replace einsteinium, as Resolved.
Papaul closed Unknown Object (Task), a subtask of T220170: Address Database infrastructure blockers on datacenter switchover & multi-dc deployment, as Resolved.
Complete
Papaul updated the task description for T233289: Decommission ms-be1027.
Complete
Papaul updated the task description for T216491: Decommission dbstore1002.
Complete
Papaul closed T206524: Decommission analytics1003, a subtask of T205509: Replace the Analytics Hadoop coordinator - Hive/Oozie/etc... (hardware refresh), as Resolved.
Papaul updated the task description for T206524: Decommission analytics1003.
Papaul added a comment to T206524: Decommission analytics1003.
papaul@asw2-c-eqiad# show | compare
[edit interfaces]
- ge-4/0/18 {
- description "analytics1003 - no-bw-mon";
- }Papaul updated the task description for T233289: Decommission ms-be1027.
Papaul updated the task description for T233289: Decommission ms-be1027.
Papaul added a comment to T233289: Decommission ms-be1027.
papaul@asw2-d-eqiad# show | compare
[edit interfaces]
- xe-7/0/13 {
- description ms-be1027;
- enable;
- }Papaul updated the task description for T209738: decom einsteinium.
Papaul added a comment to T209738: decom einsteinium.
papaul@asw2-d-eqiad# show | compare
[edit interfaces]
- ge-3/0/7 {
- description einsteinium;
- enable;
- }Papaul updated the task description for T216491: Decommission dbstore1002.
Papaul added a comment to T216491: Decommission dbstore1002.
papaul@asw2-d-eqiad# show | compare
[edit interfaces]
- ge-1/0/7 {
- description dbstore1002;
- enable;
- }