Cmjohnson (cmjohnson)
User

Projects (12)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Dec 16 2014, 10:22 PM (175 w, 1 d)
Availability
Available
IRC Nick
cmjohnson1
LDAP User
Cmjohnson
MediaWiki User
Unknown

Recent Activity

Yesterday

Cmjohnson updated the task description for T189519: Audit switch ports/descriptions/enable.
Wed, Apr 25, 5:12 PM · ops-eqiad, Operations, netops, ops-codfw
Cmjohnson updated the task description for T189519: Audit switch ports/descriptions/enable.
Wed, Apr 25, 3:54 PM · ops-eqiad, Operations, netops, ops-codfw
Cmjohnson updated the task description for T189519: Audit switch ports/descriptions/enable.
Wed, Apr 25, 3:38 PM · ops-eqiad, Operations, netops, ops-codfw
Cmjohnson reassigned T191792: Rack and setup db1116 - db1123 from Cmjohnson to Marostegui.

@Marostegui db1120 is fixed, i had the ethernet cable in the wrong port :-(. Assigning to you and removing ops-eqiad tag

Wed, Apr 25, 3:31 PM · Patch-For-Review, Operations, DBA
Cmjohnson updated the task description for T191792: Rack and setup db1116 - db1123.
Wed, Apr 25, 3:30 PM · Patch-For-Review, Operations, DBA

Tue, Apr 24

Cmjohnson updated the task description for T184054: Decommission db1029 and db1031.
Tue, Apr 24, 9:32 PM · Patch-For-Review, hardware-requests, ops-eqiad, Operations, DBA
Cmjohnson moved T182556: Decommission db1034 from Being worked on to Up next on the ops-eqiad board.
Tue, Apr 24, 9:31 PM · hardware-requests, ops-eqiad, Patch-For-Review, Operations, DBA
Cmjohnson moved T184054: Decommission db1029 and db1031 from Being worked on to Up next on the ops-eqiad board.
Tue, Apr 24, 9:31 PM · Patch-For-Review, hardware-requests, ops-eqiad, Operations, DBA
Cmjohnson moved T182556: Decommission db1034 from Decommission to Being worked on on the ops-eqiad board.
Tue, Apr 24, 9:31 PM · hardware-requests, ops-eqiad, Patch-For-Review, Operations, DBA
Cmjohnson moved T184054: Decommission db1029 and db1031 from Decommission to Being worked on on the ops-eqiad board.
Tue, Apr 24, 9:31 PM · Patch-For-Review, hardware-requests, ops-eqiad, Operations, DBA
Cmjohnson updated the task description for T182556: Decommission db1034.
Tue, Apr 24, 9:30 PM · hardware-requests, ops-eqiad, Patch-For-Review, Operations, DBA
Cmjohnson moved T189566: Decommission eventlog1001 from Decommission to Up next on the ops-eqiad board.
Tue, Apr 24, 8:48 PM · ops-eqiad, hardware-requests, Operations
Cmjohnson moved T191355: decom niobium/WMF3428 from Decommission to Up next on the ops-eqiad board.
Tue, Apr 24, 8:48 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson added a comment to T191355: decom niobium/WMF3428.

Most of this was already completed, verified not in puppet, production dns was removed, switch port was already disabled. Moving to the next steps of wiping and removal

Tue, Apr 24, 8:48 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson updated the task description for T191355: decom niobium/WMF3428.
Tue, Apr 24, 8:47 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T175150: Decommission stat1003.eqiad.wmnet as Resolved.
Tue, Apr 24, 7:24 PM · Patch-For-Review, hardware-requests, ops-eqiad, Operations
Cmjohnson closed T175150: Decommission stat1003.eqiad.wmnet, a subtask of T152712: Replacement of stat1002 and stat1003, as Resolved.
Tue, Apr 24, 7:24 PM · Patch-For-Review, Analytics-Kanban, Analytics-Cluster
Cmjohnson updated the task description for T175150: Decommission stat1003.eqiad.wmnet.
Tue, Apr 24, 7:24 PM · Patch-For-Review, hardware-requests, ops-eqiad, Operations
Cmjohnson moved T185004: Decommission mw1201-mw1220 from Decommission to Being worked on on the ops-eqiad board.
Tue, Apr 24, 7:11 PM · hardware-requests, ops-eqiad, User-Joe, Operations
Cmjohnson moved T175150: Decommission stat1003.eqiad.wmnet from Decommission to Being worked on on the ops-eqiad board.
Tue, Apr 24, 7:10 PM · Patch-For-Review, hardware-requests, ops-eqiad, Operations
Cmjohnson added a comment to T191792: Rack and setup db1116 - db1123.

@Marostegui @jcrespo All of the db's with the exception of db1120 (c6) are installed and ready for you to take over. Most likely I have a bad cable or a loose connection for db1120 and will take care of tomorrow.

Tue, Apr 24, 7:08 PM · Patch-For-Review, Operations, DBA
Cmjohnson updated the task description for T191792: Rack and setup db1116 - db1123.
Tue, Apr 24, 4:46 PM · Patch-For-Review, Operations, DBA
Cmjohnson added a comment to T184293: rack/setup/install lvs101[3-6].

@Vgutierrez Sorry about that, it was set but I had an extra . in the subnet. Anyway, that is fixed. Also, I am not sure which image you want to install so I did not set the dhcp file yet. This is the mac address for eth0 F4:E9:D4:DB:25:40

Tue, Apr 24, 3:53 PM · Patch-For-Review, ops-eqiad, Operations, Traffic
Cmjohnson moved T185171: replace mr1-eqiad from Being worked on to Up next on the ops-eqiad board.
Tue, Apr 24, 3:09 PM · ops-eqiad, Operations, netops
Cmjohnson moved T189519: Audit switch ports/descriptions/enable from Up next to Not urgent on the ops-eqiad board.
Tue, Apr 24, 3:09 PM · ops-eqiad, Operations, netops, ops-codfw

Mon, Apr 23

Cmjohnson reassigned T191896: Rack and setup ms-be1040-1043 from Cmjohnson to fgiunchedi.

@fgiunchedi These are all yours for implementation.

Mon, Apr 23, 8:37 PM · Patch-For-Review, Operations
Cmjohnson updated the task description for T191896: Rack and setup ms-be1040-1043.
Mon, Apr 23, 8:36 PM · Patch-For-Review, Operations
Cmjohnson updated subscribers of T191896: Rack and setup ms-be1040-1043.

@Marostegui yes raid is setup to raid 10 256K stripe

Mon, Apr 23, 3:55 PM · Patch-For-Review, Operations
Cmjohnson added a comment to T191792: Rack and setup db1116 - db1123.

@Marostegui @jynus All 8 of the db's are racked, cabled and idrac setup. Updated racktables. These should be ready for you later today/first thing tomorrow morning (your morning)

Mon, Apr 23, 3:51 PM · Patch-For-Review, Operations, DBA
Cmjohnson updated the task description for T191792: Rack and setup db1116 - db1123.
Mon, Apr 23, 3:50 PM · Patch-For-Review, Operations, DBA
Cmjohnson updated the task description for T191896: Rack and setup ms-be1040-1043.
Mon, Apr 23, 2:08 PM · Patch-For-Review, Operations

Wed, Apr 18

Cmjohnson updated the task description for T191792: Rack and setup db1116 - db1123.
Wed, Apr 18, 8:39 PM · Patch-For-Review, Operations, DBA
Cmjohnson closed T175595: decommission wdqs100[12] as Resolved.

Removed from rack, updated tracking sheet

Wed, Apr 18, 5:22 PM · Patch-For-Review, ops-eqiad, hardware-requests, Operations
Cmjohnson updated the task description for T175595: decommission wdqs100[12].
Wed, Apr 18, 5:22 PM · Patch-For-Review, ops-eqiad, hardware-requests, Operations
Cmjohnson closed T191360: decom spare server lawrencium/WMF3542 as Resolved.

removed from rack, tracking sheet updated.

Wed, Apr 18, 5:19 PM · Patch-For-Review, hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T191360: decom spare server lawrencium/WMF3542, a subtask of T187473: Decommission old and unused/spare servers in eqiad, as Resolved.
Wed, Apr 18, 5:19 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191792: Rack and setup db1116 - db1123 from Up next to Being worked on on the ops-eqiad board.
Wed, Apr 18, 5:08 PM · Patch-For-Review, Operations, DBA
Cmjohnson closed T183209: decom uranium as Resolved.

Removed from rack, racktables updated, tracking sheet updated

Wed, Apr 18, 5:03 PM · Patch-For-Review, hardware-requests, ops-eqiad, monitoring, Technical-Debt, Operations
Cmjohnson updated the task description for T183209: decom uranium.
Wed, Apr 18, 5:02 PM · Patch-For-Review, hardware-requests, ops-eqiad, monitoring, Technical-Debt, Operations
Cmjohnson renamed T191792: Rack and setup db1116 - db1123 from Rack and setup 8 new eqiad DBs to Rack and setup db1116 - db1123.
Wed, Apr 18, 4:31 PM · Patch-For-Review, Operations, DBA
Cmjohnson closed T189727: decommission elastic1021 as Resolved.

Updated rackables and tracking sheet.

Wed, Apr 18, 4:24 PM · Patch-For-Review, hardware-requests, ops-eqiad, DC-Ops, Operations
Cmjohnson closed T189727: decommission elastic1021, a subtask of T188595: Memory test failure on elastic1021, as Resolved.
Wed, Apr 18, 4:24 PM · Discovery-Search (Current work), ops-eqiad, DC-Ops, Operations
Cmjohnson updated the task description for T189727: decommission elastic1021.
Wed, Apr 18, 4:23 PM · Patch-For-Review, hardware-requests, ops-eqiad, DC-Ops, Operations
Cmjohnson closed T182955: Decommission kafka1018 as Resolved.

removed from rack and network port updated (ge-8/0/0). updated racktables and tracking sheet

Wed, Apr 18, 3:45 PM · Patch-For-Review, hardware-requests, Analytics, Operations, ops-eqiad
Cmjohnson updated the task description for T182955: Decommission kafka1018.
Wed, Apr 18, 3:45 PM · Patch-For-Review, hardware-requests, Analytics, Operations, ops-eqiad
Cmjohnson added a comment to T184293: rack/setup/install lvs101[3-6].

@Vgutierrez I set the descriptions on the switches with both jic.

Wed, Apr 18, 3:27 PM · Patch-For-Review, ops-eqiad, Operations, Traffic
Cmjohnson updated the task description for T184293: rack/setup/install lvs101[3-6].
Wed, Apr 18, 3:23 PM · Patch-For-Review, ops-eqiad, Operations, Traffic
Cmjohnson added a comment to T184293: rack/setup/install lvs101[3-6].

All the cross connects have been made and connected to the switch ports. I updated the descriptions in both switches on each row. The server still needs install.

Wed, Apr 18, 3:22 PM · Patch-For-Review, ops-eqiad, Operations, Traffic
Cmjohnson added a comment to T191896: Rack and setup ms-be1040-1043.

Configured the raid, set to all 14 disks are raid 0 with the ssd in slot 12 first and the ssd in slot 13 second, the other 12 disks are set to raid 0 in order.

Wed, Apr 18, 3:21 PM · Patch-For-Review, Operations

Tue, Apr 17

Cmjohnson closed T159996: decom fluorine as Resolved.
Tue, Apr 17, 5:00 PM · Patch-For-Review, ops-eqiad, hardware-requests, Operations
Cmjohnson closed T159996: decom fluorine , a subtask of T123728: replace fluorine with mwlog servers (was: Upgrade fluorine to trusty/jessie), as Resolved.
Tue, Apr 17, 4:59 PM · User-fgiunchedi, Patch-For-Review, Operations
Cmjohnson updated the task description for T159996: decom fluorine .
Tue, Apr 17, 4:59 PM · Patch-For-Review, ops-eqiad, hardware-requests, Operations
Cmjohnson added a project to T189822: Replace 5 Samsung SSD 850 devices w/ 4 1.6T Intel or HP SSDs: ops-eqiad.
Tue, Apr 17, 4:23 PM · User-fgiunchedi, ops-eqiad, Services (blocked), Operations, hardware-requests, Cassandra, User-Eevans
Cmjohnson added a comment to T189822: Replace 5 Samsung SSD 850 devices w/ 4 1.6T Intel or HP SSDs.

@mobrovac The 5 ssds arrived for restbase1010. Do you need to schedule down time to replace?

Tue, Apr 17, 4:22 PM · User-fgiunchedi, ops-eqiad, Services (blocked), Operations, hardware-requests, Cassandra, User-Eevans
Cmjohnson moved T191792: Rack and setup db1116 - db1123 from Backlog to Up next on the ops-eqiad board.
Tue, Apr 17, 4:00 PM · Patch-For-Review, Operations, DBA
Cmjohnson moved T191996: db1114 connection issues from Backlog to Being worked on on the ops-eqiad board.
Tue, Apr 17, 3:59 PM · ops-eqiad, Patch-For-Review, Operations, netops, DBA
Cmjohnson moved T192280: sda failure in hydrogen.wikimedia.org from Backlog to Blocked on the ops-eqiad board.
Tue, Apr 17, 3:59 PM · ops-eqiad, Traffic, Operations
Cmjohnson updated subscribers of T192280: sda failure in hydrogen.wikimedia.org.

This servers warranty expired in 2014 and should be replaced instead of repaired. @faidon please comment.

Tue, Apr 17, 3:59 PM · ops-eqiad, Traffic, Operations
Cmjohnson added a comment to T184293: rack/setup/install lvs101[3-6].

@ayounsi the new card arrived and is installed...all the fibers are run. I need to know which port you prefer on each switch. I was going to use xe-4/0/47 on all but he host switch which would get next available.

Tue, Apr 17, 3:31 PM · Patch-For-Review, ops-eqiad, Operations, Traffic
Cmjohnson moved T184293: rack/setup/install lvs101[3-6] from Up next to Being worked on on the ops-eqiad board.
Tue, Apr 17, 3:20 PM · Patch-For-Review, ops-eqiad, Operations, Traffic
Cmjohnson updated the task description for T191896: Rack and setup ms-be1040-1043.
Tue, Apr 17, 2:57 PM · Patch-For-Review, Operations
Cmjohnson added a comment to T191896: Rack and setup ms-be1040-1043.

@ayounsi I cabled the new ms-be servers to the following. Please let me know if you want that changed.

Tue, Apr 17, 2:56 PM · Patch-For-Review, Operations

Tue, Apr 10

Cmjohnson closed T182805: decom spare server caesium as Resolved.
Tue, Apr 10, 6:21 PM · hardware-requests, DC-Ops, Operations, ops-eqiad
Cmjohnson merged T191358: decom spare server caesium into T182805: decom spare server caesium .
Tue, Apr 10, 6:21 PM · hardware-requests, DC-Ops, Operations, ops-eqiad
Cmjohnson merged task T191358: decom spare server caesium into T182805: decom spare server caesium .
Tue, Apr 10, 6:21 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T191363: decom spare server nobelium/wmf4543 as Resolved.

dns removed...removed from rack, everything updated

Tue, Apr 10, 6:19 PM · Patch-For-Review, hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T191363: decom spare server nobelium/wmf4543, a subtask of T187473: Decommission old and unused/spare servers in eqiad, as Resolved.
Tue, Apr 10, 6:19 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T175093: Decommission osmium.eqiad.wmnet as Resolved.
Tue, Apr 10, 6:10 PM · Patch-For-Review, Performance-Team (Radar), ops-eqiad, hardware-requests, Operations
Cmjohnson closed T175093: Decommission osmium.eqiad.wmnet, a subtask of T158837: Consolidate performance website and related software, as Resolved.
Tue, Apr 10, 6:10 PM · Patch-For-Review, monitoring, Performance-Team, Operations
Cmjohnson updated the task description for T175093: Decommission osmium.eqiad.wmnet.
Tue, Apr 10, 6:09 PM · Patch-For-Review, Performance-Team (Radar), ops-eqiad, hardware-requests, Operations
Cmjohnson closed T191359: decom spare server iodine as Resolved.

removed from rack, spreadsheet and racktables updated

Tue, Apr 10, 6:00 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T191359: decom spare server iodine, a subtask of T187473: Decommission old and unused/spare servers in eqiad, as Resolved.
Tue, Apr 10, 6:00 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T191358: decom spare server caesium as Resolved.

disk removed from rack, added to spreadsheet, removed from racktables

Tue, Apr 10, 5:53 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson closed T191358: decom spare server caesium, a subtask of T187473: Decommission old and unused/spare servers in eqiad, as Resolved.
Tue, Apr 10, 5:53 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson updated subscribers of T191896: Rack and setup ms-be1040-1043.

@ayounsi These are racked in 10G racks and I would like to utilize the new switches....Can you assign ports please

Tue, Apr 10, 5:15 PM · Patch-For-Review, Operations
Cmjohnson updated the task description for T191896: Rack and setup ms-be1040-1043.
Tue, Apr 10, 5:11 PM · Patch-For-Review, Operations
Cmjohnson moved T191896: Rack and setup ms-be1040-1043 from Backlog to Being worked on on the ops-eqiad board.
Tue, Apr 10, 2:28 PM · Patch-For-Review, Operations
Cmjohnson created T191896: Rack and setup ms-be1040-1043.
Tue, Apr 10, 2:10 PM · Patch-For-Review, Operations
Cmjohnson moved T191352: decom zinc/WMF3298 from Backlog to Decommission on the ops-eqiad board.
Tue, Apr 10, 2:05 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191351: decom vanadium/WMF3291 from Backlog to Decommission on the ops-eqiad board.
Tue, Apr 10, 2:05 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191348: decommission uranium/WMF3128 from Backlog to Decommission on the ops-eqiad board.
Tue, Apr 10, 2:04 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191355: decom niobium/WMF3428 from Backlog to Decommission on the ops-eqiad board.
Tue, Apr 10, 2:03 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191357: decom silver/WMF3434 from Backlog to Decommission on the ops-eqiad board.
Tue, Apr 10, 2:01 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191358: decom spare server caesium from Backlog to Up next on the ops-eqiad board.
Tue, Apr 10, 2:00 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191359: decom spare server iodine from Backlog to Up next on the ops-eqiad board.
Tue, Apr 10, 2:00 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191360: decom spare server lawrencium/WMF3542 from Backlog to Up next on the ops-eqiad board.
Tue, Apr 10, 2:00 PM · Patch-For-Review, hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191362: decom promethium/WMF3571 from Backlog to Decommission on the ops-eqiad board.
Tue, Apr 10, 2:00 PM · hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191363: decom spare server nobelium/wmf4543 from Backlog to Up next on the ops-eqiad board.
Tue, Apr 10, 2:00 PM · Patch-For-Review, hardware-requests, Operations, DC-Ops, ops-eqiad
Cmjohnson moved T191364: decom spare server osmium/wmf4546 from Backlog to Decommission on the ops-eqiad board.
Tue, Apr 10, 1:59 PM · hardware-requests, Operations, DC-Ops, ops-eqiad

Thu, Apr 5

Cmjohnson added a comment to T187373: Rebuild raids on labvirt1019 and 1020.

I received this last last night from HP...I will try this first (i am hoping I have the cable)

Thu, Apr 5, 1:08 PM · cloud-services-team (Kanban), Operations, Cloud-Services
Cmjohnson added a comment to T187373: Rebuild raids on labvirt1019 and 1020.

@faidon. That would explain the issue, the disk are in the front in slots 4
and 6.

Thu, Apr 5, 12:29 PM · cloud-services-team (Kanban), Operations, Cloud-Services

Wed, Apr 4

Cmjohnson moved T175093: Decommission osmium.eqiad.wmnet from Decommission to Up next on the ops-eqiad board.
Wed, Apr 4, 7:23 PM · Patch-For-Review, Performance-Team (Radar), ops-eqiad, hardware-requests, Operations
Cmjohnson closed T165345: decommission indium as Resolved.
Wed, Apr 4, 7:21 PM · Patch-For-Review, Operations, ops-eqiad
Cmjohnson updated the task description for T165345: decommission indium.
Wed, Apr 4, 7:20 PM · Patch-For-Review, Operations, ops-eqiad
Cmjohnson added a comment to T177958: Decommission ocg1001-3.

@RobH any status update on this?

Wed, Apr 4, 7:06 PM · ops-eqiad, hardware-requests, Operations
Cmjohnson moved T175595: decommission wdqs100[12] from Decommission to Up next on the ops-eqiad board.
Wed, Apr 4, 7:06 PM · Patch-For-Review, ops-eqiad, hardware-requests, Operations
Cmjohnson closed T189773: Decommission db1020 as Resolved.
Wed, Apr 4, 7:05 PM · hardware-requests, Operations, ops-eqiad, Patch-For-Review, DBA
Cmjohnson closed T189773: Decommission db1020, a subtask of T183469: Setup newer machines and replace all old misc (m*) and x1 eqiad machines, as Resolved.
Wed, Apr 4, 7:05 PM · Patch-For-Review, Operations, DBA
Cmjohnson closed T189773: Decommission db1020, a subtask of T134476: Decommission old coredb machines (<=db1050), as Resolved.
Wed, Apr 4, 7:05 PM · hardware-requests, Goal, Operations, DBA
Cmjohnson updated the task description for T189773: Decommission db1020.
Wed, Apr 4, 7:05 PM · hardware-requests, Operations, ops-eqiad, Patch-For-Review, DBA