Page MenuHomePhabricator

Papaul (Papaul)
User

Projects (7)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Dec 18 2014, 3:39 PM (330 w, 2 d)
Availability
Available
LDAP User
Papaul
MediaWiki User
Unknown

Recent Activity

Fri, Apr 9

Papaul updated the task description for T277323: (Need By: 2021-04-30) rack/setup/install backup200[4-7].
Fri, Apr 9, 1:37 AM · SRE, ops-codfw, DC-Ops
Papaul closed T276642: (Need By: TBD) rack/setup/install moss-be200[12] as Resolved.

@fgiunchedi This is complete

Fri, Apr 9, 1:36 AM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Fri, Apr 9, 1:35 AM · SRE, ops-codfw, DC-Ops

Thu, Apr 8

Papaul updated the task description for T275676: (Need By: TBD) rack/setup/install cloudnet2004-dev.
Thu, Apr 8, 11:12 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Thu, Apr 8, 11:12 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Thu, Apr 8, 9:35 PM · SRE, ops-codfw, DC-Ops
Papaul added a comment to T274945: (Need By: TBD) rack/setup/install cloudcephosd10[16-20].eqiad.wmnet.

@Cmjohnson I did the second interface for cloudcephosd1016 see below for the instructions let me know in you have any questions

Thu, Apr 8, 6:42 PM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
Papaul added a comment to T274945: (Need By: TBD) rack/setup/install cloudcephosd10[16-20].eqiad.wmnet.

@Cmjohnson I will take a look at it once done with some onsite work

Thu, Apr 8, 4:26 PM · SRE, cloud-services-team (Hardware), ops-eqiad, DC-Ops
Papaul updated the task description for T277323: (Need By: 2021-04-30) rack/setup/install backup200[4-7].
Thu, Apr 8, 3:40 PM · SRE, ops-codfw, DC-Ops
Papaul reassigned T279245: Degraded RAID on ms-be2028 from Papaul to fgiunchedi.

Disk replaced

Thu, Apr 8, 2:38 PM · User-fgiunchedi, SRE, ops-codfw

Wed, Apr 7

Papaul updated the task description for T275676: (Need By: TBD) rack/setup/install cloudnet2004-dev.
Wed, Apr 7, 9:15 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Wed, Apr 7, 9:06 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Wed, Apr 7, 8:06 PM · SRE, ops-codfw, DC-Ops
Papaul closed T275637: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet as Resolved.

@Joe this is complete.

Wed, Apr 7, 7:55 PM · serviceops, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275637: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet.
Wed, Apr 7, 7:54 PM · serviceops, SRE, ops-codfw, DC-Ops
Dzahn awarded T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards a Mountain of Wealth token.
Wed, Apr 7, 7:38 PM · SRE, ops-codfw, DC-Ops
Papaul closed T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet as Resolved.

@fgiunchedi this is complete

Wed, Apr 7, 5:32 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet.
Wed, Apr 7, 5:32 PM · SRE, ops-codfw, DC-Ops
Papaul added a comment to T279457: Multiple host down alerts from rack C2.

Good morning Papaul

Wed, Apr 7, 3:35 PM · netops, SRE, ops-codfw
Papaul added a comment to T279457: Multiple host down alerts from rack C2.

David Valverde

12:39 AM (9 hours ago)

to me, support

Wed, Apr 7, 3:34 PM · netops, SRE, ops-codfw
Papaul closed T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards as Resolved.

@Dzahn this is complete

Wed, Apr 7, 2:46 PM · SRE, ops-codfw, DC-Ops
Papaul closed T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards, a subtask of T277119: decom 28 codfw appservers purchased on 2016-05-17 (mw2215 through mw2242), as Resolved.
Wed, Apr 7, 2:45 PM · Patch-For-Review, serviceops
Papaul closed T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards, a subtask of T277780: decom 8 codfw appservers purchased on 2016-06-02 , as Resolved.
Wed, Apr 7, 2:45 PM · Patch-For-Review, SRE, ops-codfw, serviceops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Wed, Apr 7, 2:45 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Wed, Apr 7, 3:35 AM · SRE, ops-codfw, DC-Ops
Papaul closed T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev as Resolved.

@Andrew this is complete

Wed, Apr 7, 2:03 AM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul updated the task description for T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev.
Wed, Apr 7, 1:56 AM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Wed, Apr 7, 12:44 AM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Wed, Apr 7, 12:43 AM · SRE, ops-codfw, DC-Ops

Tue, Apr 6

Papaul added a comment to T279457: Multiple host down alerts from rack C2.

Case Number:2021-0406-0609 create

Tue, Apr 6, 8:33 PM · netops, SRE, ops-codfw
Papaul updated the task description for T277323: (Need By: 2021-04-30) rack/setup/install backup200[4-7].
Tue, Apr 6, 5:02 PM · SRE, ops-codfw, DC-Ops
Papaul closed Unknown Object (Task), a subtask of T262668: WMF media storage must be adequately backed up in a remote location, as Resolved.
Tue, Apr 6, 5:00 PM · Data-Persistence-Backup, Epic, Goal, SRE, SRE-swift-storage
Papaul updated the task description for T275676: (Need By: TBD) rack/setup/install cloudnet2004-dev.
Tue, Apr 6, 4:51 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Tue, Apr 6, 4:49 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275637: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet.
Tue, Apr 6, 4:28 PM · serviceops, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet.
Tue, Apr 6, 4:19 PM · SRE, ops-codfw, DC-Ops
Papaul closed T277780: decom 8 codfw appservers purchased on 2016-06-02 as Resolved.

complete

Tue, Apr 6, 3:19 PM · Patch-For-Review, SRE, ops-codfw, serviceops
Papaul updated the task description for T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev.
Tue, Apr 6, 3:14 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul reassigned T279245: Degraded RAID on ms-be2028 from Papaul to fgiunchedi.

@fgiunchedi disk replaced

Tue, Apr 6, 3:01 PM · User-fgiunchedi, SRE, ops-codfw
Papaul closed T275760: decommission scb200[1-6].codfw.wmnet as Resolved.

complete

Tue, Apr 6, 1:40 AM · Patch-For-Review, SRE, ops-codfw, serviceops

Mon, Apr 5

Papaul updated the task description for T275760: decommission scb200[1-6].codfw.wmnet.
Mon, Apr 5, 5:40 PM · Patch-For-Review, SRE, ops-codfw, serviceops

Sat, Apr 3

Papaul closed T279214: Netbox/Accounting Discrepancies as Resolved.

fixed

Sat, Apr 3, 1:20 AM · SRE, ops-codfw, DC-Ops

Thu, Apr 1

Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Thu, Apr 1, 4:36 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Thu, Apr 1, 3:46 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Thu, Apr 1, 3:06 AM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev.
Thu, Apr 1, 12:14 AM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops

Wed, Mar 31

Papaul added a comment to T265435: codfw: Testing Out Sample PDUs.

The test PDU is on online .its been monitor in Librenms
https://librenms.wikimedia.org/device/203
The only thing left is the setup in icinga

Wed, Mar 31, 8:50 PM · observability, ops-codfw, DC-Ops, SRE
Papaul closed T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123] as Resolved.

@Gehel This is ready

Wed, Mar 31, 2:20 AM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul updated the task description for T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].
Wed, Mar 31, 2:18 AM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops

Tue, Mar 30

Papaul updated the task description for T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet.
Tue, Mar 30, 11:34 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275637: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet.
Tue, Mar 30, 11:17 PM · serviceops, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet.
Tue, Mar 30, 10:59 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].
Tue, Mar 30, 9:48 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul updated the task description for T275637: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet.
Tue, Mar 30, 6:57 PM · serviceops, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275637: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet.
Tue, Mar 30, 6:15 PM · serviceops, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].
Tue, Mar 30, 5:40 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul updated the task description for T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev.
Tue, Mar 30, 5:24 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul created T278726: Eqiad: Ports with no description on cloudsw1-d5-eqiad.
Tue, Mar 30, 2:33 AM · cloud-services-team (Kanban), SRE, ops-eqiad

Wed, Mar 24

Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Wed, Mar 24, 11:29 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276642: (Need By: TBD) rack/setup/install moss-be200[12].
Wed, Mar 24, 11:28 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev.
Wed, Mar 24, 11:17 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul updated the task description for T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].
Wed, Mar 24, 11:10 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul closed T276587: (Need By: TBD) rack/setup/install cumin2002.codfw.wmnet as Resolved.

@MoritzMuehlenhoff all yours

Wed, Mar 24, 8:31 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276587: (Need By: TBD) rack/setup/install cumin2002.codfw.wmnet.
Wed, Mar 24, 8:29 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276587: (Need By: TBD) rack/setup/install cumin2002.codfw.wmnet.
Wed, Mar 24, 6:09 PM · SRE, ops-codfw, DC-Ops
Papaul added a comment to T265435: codfw: Testing Out Sample PDUs.

First issue :

  • The mounting buttons don't align with the mounting bracket in the rack
Wed, Mar 24, 4:50 PM · observability, ops-codfw, DC-Ops, SRE
Papaul added a comment to T265435: codfw: Testing Out Sample PDUs.

Received the test PDU . I tested both colored cables, the one we bought first (red on image) and the one that was sent to us for testing( blue on image) all fits well with the lock mechanism on the PDU. The lock on the PDU secured the cable very well better then the

Wed, Mar 24, 4:22 PM · observability, ops-codfw, DC-Ops, SRE
Papaul updated the task description for T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].
Wed, Mar 24, 3:36 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul updated the task description for T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].
Wed, Mar 24, 3:35 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul added a comment to T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].

thank you

Wed, Mar 24, 3:30 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul updated subscribers of T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].

@Gehel each server has 4x1.9TB disks. I want to make sure we are doing both HW RAID 10 and SW RAID 10 .
Thanks

Wed, Mar 24, 3:25 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul updated the task description for T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet.
Wed, Mar 24, 3:13 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet.
Wed, Mar 24, 2:57 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276587: (Need By: TBD) rack/setup/install cumin2002.codfw.wmnet.
Wed, Mar 24, 2:48 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev.
Wed, Mar 24, 2:42 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul added a comment to T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.

@Dzahn mw2377 and mw2378 are ready for service

Wed, Mar 24, 12:35 AM · SRE, ops-codfw, DC-Ops

Tue, Mar 23

Papaul updated the task description for T276587: (Need By: TBD) rack/setup/install cumin2002.codfw.wmnet.
Tue, Mar 23, 12:07 AM · SRE, ops-codfw, DC-Ops

Mon, Mar 22

Papaul updated the task description for T276587: (Need By: TBD) rack/setup/install cumin2002.codfw.wmnet.
Mon, Mar 22, 11:58 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Mon, Mar 22, 11:46 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Mon, Mar 22, 11:37 PM · SRE, ops-codfw, DC-Ops
Papaul added a comment to T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.

All 35 servers racked.

Mon, Mar 22, 10:54 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274171: (Need By: TBD) rack/setup/install (35) mw2377 and upwards.
Mon, Mar 22, 10:54 PM · SRE, ops-codfw, DC-Ops
Papaul closed T277119: decom 28 codfw appservers purchased on 2016-05-17 (mw2215 through mw2242) as Resolved.

asset tag mgmt removed and all the disk removed also for server

Mon, Mar 22, 10:53 PM · Patch-For-Review, serviceops
Papaul added a comment to T277780: decom 8 codfw appservers purchased on 2016-06-02 .

@Dzahn thanks for the update. I am planning on racking mw2401 to mw2411 in A5 and not in A4 since A4 is a 10G rack , i will like to keep this rack only for 10G servers and not put in a 1G server in a 10G rack. Let me know if this is a problem.

Mon, Mar 22, 9:13 PM · Patch-For-Review, SRE, ops-codfw, serviceops
Papaul updated the task description for T276509: (Need By: TBD) rack/setup/install cloudcephmon2004-dev.
Mon, Mar 22, 4:41 PM · SRE, cloud-services-team (Hardware), ops-codfw, DC-Ops
Papaul updated the task description for T275513: (Need By: TBD) rack/setup/install moss-fe200[12].codfw.wmnet.
Mon, Mar 22, 4:32 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276587: (Need By: TBD) rack/setup/install cumin2002.codfw.wmnet.
Mon, Mar 22, 4:31 PM · SRE, ops-codfw, DC-Ops
Papaul closed T277537: ganeti2015 doesn't boot as Resolved.

Remove and insert back both Risers system is backup up

Mon, Mar 22, 4:02 PM · ops-codfw, SRE
Papaul reopened T277119: decom 28 codfw appservers purchased on 2016-05-17 (mw2215 through mw2242) as "Open".

Reopen this task since i have to offline all the servers in Netbox and remove the disks

Mon, Mar 22, 3:27 PM · Patch-For-Review, serviceops
Papaul updated the task description for T275637: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet.
Mon, Mar 22, 3:25 PM · serviceops, SRE, ops-codfw, DC-Ops
Papaul updated the task description for T276647: (Need By: 2021-04-30) rack/setup/install wcqs200[123].
Mon, Mar 22, 3:19 PM · SRE, Discovery-Search (Current work), ops-codfw, DC-Ops
Papaul closed Unknown Object (Task), a subtask of T247556: [Epic] Search platform - Hardware requests for 2020-2021, as Resolved.
Mon, Mar 22, 2:30 PM · Epic, Discovery-Search
Papaul closed Unknown Object (Task), a subtask of T254232: New clusters for SPARQL Endpoint for Commons, as Resolved.
Mon, Mar 22, 2:30 PM · Wikidata, Wikidata-Query-Service
Papaul added a comment to T277171: decommission frqueue1001.frack.eqiad.wmnet.

Is it frqueue2001 or 1001?

Mon, Mar 22, 2:25 PM · ops-eqiad, SRE, decommission-hardware
Papaul added a comment to T277171: decommission frqueue1001.frack.eqiad.wmnet.

@Jgreen @Cmjohnson any reason why this is assigned to me?

Mon, Mar 22, 2:23 PM · ops-eqiad, SRE, decommission-hardware
Papaul triaged T277537: ganeti2015 doesn't boot as Medium priority.
Mon, Mar 22, 2:20 PM · ops-codfw, SRE

Mar 10 2021

Papaul closed T274905: (Need By: TBD) rack/setup/install kafka-logging200[123].codfw.wmnet as Resolved.

@herron all yours

Mar 10 2021, 5:53 PM · SRE, ops-codfw, DC-Ops
Papaul updated the task description for T274905: (Need By: TBD) rack/setup/install kafka-logging200[123].codfw.wmnet.
Mar 10 2021, 5:53 PM · SRE, ops-codfw, DC-Ops
Papaul closed T272837: Decom ms-be[2016-2027] as Resolved.

complete

Mar 10 2021, 5:04 PM · SRE, ops-codfw, User-fgiunchedi
Papaul closed T272837: Decom ms-be[2016-2027], a subtask of T266016: Refresh and expand Swift hardware capacity, as Resolved.
Mar 10 2021, 5:04 PM · User-fgiunchedi, SRE-swift-storage