Page MenuHomePhabricator

Jgreen (Jeff Green)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Nov 25 2014, 1:54 PM (270 w, 22 h)
Availability
Available
IRC Nick
Jeff_Green
LDAP User
Jgreen
MediaWiki User
Jgreen (wmf) [ Global Accounts ]

Recent Activity

Mon, Jan 27

Jgreen updated the task description for T243542: quantify civicrm database growth.
Mon, Jan 27, 3:00 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen updated the task description for T243542: quantify civicrm database growth.
Mon, Jan 27, 2:58 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen updated the task description for T243542: quantify civicrm database growth.
Mon, Jan 27, 2:57 PM · Fundraising-Backlog, fundraising-tech-ops

Sat, Jan 25

Jgreen updated the task description for T243542: quantify civicrm database growth.
Sat, Jan 25, 3:17 AM · Fundraising-Backlog, fundraising-tech-ops

Fri, Jan 24

Jgreen edited projects for T243551: Server data hang, added: Fundraising-Backlog; removed fundraising-tech-ops.
Fri, Jan 24, 9:57 PM · Fundraising-Backlog
Jgreen closed T218258: EPIC: prepare for Debian Buster for fundraising systems as Resolved.

The pxeboot->tftp->preseed->puppet aspect is done. There are still roles that we haven't tested, mostly because of the PHP version change (payments, civicrm, payments-listener), but that's a separate issue.

Fri, Jan 24, 9:56 PM · fundraising-tech-ops
Jgreen updated the task description for T243542: quantify civicrm database growth.
Fri, Jan 24, 7:23 PM · Fundraising-Backlog, fundraising-tech-ops

Thu, Jan 23

Jgreen closed T243424: geoip_update run failing on frav1002 as Resolved.

Fixed. The issue appeared to be a (logical) change in wget behavior, where if fed an https:// request with an proxy_http environment variable, it no longer converts the client->proxy request to http. So the suboptimal fix was to adjust the request URL to http:// and leave it to our proxy to convert that to an https:// request to maxmind.

Thu, Jan 23, 10:42 PM · fundraising-tech-ops
Jgreen created T243542: quantify civicrm database growth.
Thu, Jan 23, 7:20 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen closed T242926: Issue new SSL Client Certificate for jgreen as Resolved.
Thu, Jan 23, 5:02 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen claimed T243424: geoip_update run failing on frav1002.
Thu, Jan 23, 4:38 PM · fundraising-tech-ops
Jgreen updated the task description for T234068: (ASAP) rack/setup/install frban1001.frack.eqiad.wmnet.
Thu, Jan 23, 4:25 PM · Operations, fundraising-tech-ops
Jgreen closed T243255: Staging data refresh as Resolved.

@Jgreen it might be good to do them I think - since it's been a while - mostly dev_drupal -

Thu, Jan 23, 4:15 PM · Fundraising-Backlog, fundraising-tech-ops

Wed, Jan 22

Jgreen added a comment to T243255: Staging data refresh.

@Eileenmcnaughton dev_civicrm is done, do you need other databases too or is that good?

Wed, Jan 22, 10:07 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen closed T234069: rack/setup/install frban2001.frack.codfw.wmnet, a subtask of T242257: 2019-2020 Q3 fundraising hardware refresh and capex, as Resolved.
Wed, Jan 22, 9:38 PM · fundraising-tech-ops
Jgreen closed T234069: rack/setup/install frban2001.frack.codfw.wmnet as Resolved.
Wed, Jan 22, 9:38 PM · Operations, fundraising-tech-ops, ops-codfw
Jgreen reopened T234069: rack/setup/install frban2001.frack.codfw.wmnet, a subtask of T242257: 2019-2020 Q3 fundraising hardware refresh and capex, as Open.
Wed, Jan 22, 9:27 PM · fundraising-tech-ops
Jgreen reopened T234069: rack/setup/install frban2001.frack.codfw.wmnet as "Open".
Wed, Jan 22, 9:27 PM · Operations, fundraising-tech-ops, ops-codfw
Jgreen closed T242265: rack/setup/install frlog2001.frack.codfw.wmnet as Resolved.
Wed, Jan 22, 9:00 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen closed T242265: rack/setup/install frlog2001.frack.codfw.wmnet, a subtask of T242257: 2019-2020 Q3 fundraising hardware refresh and capex, as Resolved.
Wed, Jan 22, 9:00 PM · fundraising-tech-ops
Jgreen updated the task description for T242265: rack/setup/install frlog2001.frack.codfw.wmnet.
Wed, Jan 22, 8:59 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen created T243424: geoip_update run failing on frav1002.
Wed, Jan 22, 5:04 PM · fundraising-tech-ops
Jgreen added a subtask for T242265: rack/setup/install frlog2001.frack.codfw.wmnet: Unknown Object (Task).
Wed, Jan 22, 3:48 PM · Operations, ops-codfw, fundraising-tech-ops

Tue, Jan 21

Jgreen updated the task description for T242265: rack/setup/install frlog2001.frack.codfw.wmnet.
Tue, Jan 21, 6:43 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen updated the task description for T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Tue, Jan 21, 6:02 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen claimed T243255: Staging data refresh.

I started a db restore from the 1/20/2020 backup this morning. It should be one toward the end of the day.

Tue, Jan 21, 4:42 PM · Fundraising-Backlog, fundraising-tech-ops

Fri, Jan 17

Jgreen closed T239999: disable local auditd logging as Resolved.

Disabled for releases other than stretch/trusty in puppet.

Fri, Jan 17, 6:05 PM · fundraising-tech-ops
Jgreen updated the task description for T239999: disable local auditd logging.
Fri, Jan 17, 6:04 PM · fundraising-tech-ops
Jgreen updated the task description for T239999: disable local auditd logging.
Fri, Jan 17, 4:37 PM · fundraising-tech-ops
Jgreen added a project to T77912: [epic] PCI gap analysis and Improvements: fundraising-tech-ops.
Fri, Jan 17, 4:33 PM · fundraising-tech-ops, Epic, Fundraising-Backlog
Jgreen lowered the priority of T77912: [epic] PCI gap analysis and Improvements from High to Medium.
Fri, Jan 17, 4:33 PM · fundraising-tech-ops, Epic, Fundraising-Backlog
Jgreen closed T204931: Re-evaluate use of EV certificates for payments.wm.o? as Resolved.

Closing this task because as it was defined it has been completed and we decided to stay the course through subsequent EV cert renewals. Also this question comes up annually at renewal time regardless of the task.

Fri, Jan 17, 4:05 PM · Fundraising-Backlog, Traffic, HTTPS, Operations
Jgreen claimed T77912: [epic] PCI gap analysis and Improvements.

A SAQ-A-EP Gap Assessment was completed by Palladion 11/2019.

Fri, Jan 17, 3:48 PM · fundraising-tech-ops, Epic, Fundraising-Backlog
Jgreen assigned T242990: decommission alnitak.frack.codfw.wmnet to Papaul.
Fri, Jan 17, 3:44 PM · ops-codfw, Operations, DC-Ops, decommission
Jgreen updated the task description for T242990: decommission alnitak.frack.codfw.wmnet.
Fri, Jan 17, 3:43 PM · ops-codfw, Operations, DC-Ops, decommission
Jgreen updated the task description for T242265: rack/setup/install frlog2001.frack.codfw.wmnet.
Fri, Jan 17, 3:25 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen added a comment to T242265: rack/setup/install frlog2001.frack.codfw.wmnet.

@Jgreen no good update from Dell

Fri, Jan 17, 2:43 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen added a comment to T237582: frqueue1001 system battery needs replacement.

@Jgreen I have the batteries...when can we schedule to do this?

Fri, Jan 17, 1:13 PM · ops-eqiad, Operations
Aklapper awarded T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data a Like token.
Fri, Jan 17, 9:10 AM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops

Thu, Jan 16

Jgreen updated subscribers of T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Thu, Jan 16, 10:52 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen added a comment to T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .

@Aklapper Do I have to? I was thinking of it as a personal task to help me keep track of OKRs and progress, and thus intentionally left off the project tags.

Thu, Jan 16, 10:20 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen updated the task description for T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Thu, Jan 16, 9:44 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen removed a project from T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data : fundraising-tech-ops.
Thu, Jan 16, 9:40 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen reopened T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data as "Open".
Thu, Jan 16, 9:36 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen placed T241083: Epic: civi crm db approaching data partition capacity up for grabs.
Thu, Jan 16, 9:33 PM · Epic, Fundraising-Backlog, fundraising-tech-ops
Jgreen placed T240499: refactor drush install up for grabs.
Thu, Jan 16, 9:32 PM · fundraising-tech-ops
Jgreen closed T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data as Invalid.
Thu, Jan 16, 9:31 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen triaged T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data as Medium priority.
Thu, Jan 16, 9:29 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen triaged T242257: 2019-2020 Q3 fundraising hardware refresh and capex as Medium priority.
Thu, Jan 16, 9:29 PM · fundraising-tech-ops
Jgreen moved T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data from Backlog to In Progress on the fundraising-tech-ops board.
Thu, Jan 16, 9:29 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen closed T243023: 2019-2020 Q2 fundraising hardware refresh and capex as Resolved.
Thu, Jan 16, 9:28 PM · fundraising-tech-ops
Jgreen reassigned T242983: decommission frdb2001.frack.codfw.wmnet from Jgreen to Papaul.
Thu, Jan 16, 9:24 PM · ops-codfw, Operations, DC-Ops, decommission
Jgreen added a subtask for T242257: 2019-2020 Q3 fundraising hardware refresh and capex: T239139: rack/setup/install frdb1003.frack.eqiad.wmnet.
Thu, Jan 16, 9:22 PM · fundraising-tech-ops
Jgreen added a parent task for T239139: rack/setup/install frdb1003.frack.eqiad.wmnet: T242257: 2019-2020 Q3 fundraising hardware refresh and capex.
Thu, Jan 16, 9:22 PM · Operations, fundraising-tech-ops, ops-eqiad
Jgreen removed a subtask for T242257: 2019-2020 Q3 fundraising hardware refresh and capex: T239139: rack/setup/install frdb1003.frack.eqiad.wmnet.
Thu, Jan 16, 9:21 PM · fundraising-tech-ops
Jgreen edited parent tasks for T239139: rack/setup/install frdb1003.frack.eqiad.wmnet, added: T243023: 2019-2020 Q2 fundraising hardware refresh and capex; removed: T242257: 2019-2020 Q3 fundraising hardware refresh and capex.
Thu, Jan 16, 9:21 PM · Operations, fundraising-tech-ops, ops-eqiad
Jgreen added a subtask for T243023: 2019-2020 Q2 fundraising hardware refresh and capex: T239139: rack/setup/install frdb1003.frack.eqiad.wmnet.
Thu, Jan 16, 9:21 PM · fundraising-tech-ops
Jgreen created T243023: 2019-2020 Q2 fundraising hardware refresh and capex.
Thu, Jan 16, 9:20 PM · fundraising-tech-ops
Jgreen renamed T242257: 2019-2020 Q3 fundraising hardware refresh and capex from 2019-2020 Q3 fundraising hardware refreshes and capex to 2019-2020 Q3 fundraising hardware refresh and capex.
Thu, Jan 16, 9:20 PM · fundraising-tech-ops
Jgreen added a subtask for T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data : T242257: 2019-2020 Q3 fundraising hardware refresh and capex.
Thu, Jan 16, 9:19 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen added a parent task for T242257: 2019-2020 Q3 fundraising hardware refresh and capex: T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Thu, Jan 16, 9:19 PM · fundraising-tech-ops
Jgreen renamed T242257: 2019-2020 Q3 fundraising hardware refresh and capex from fundraising 2019-2020 hardware refreshes and capex to 2019-2020 Q3 fundraising hardware refreshes and capex.
Thu, Jan 16, 9:18 PM · fundraising-tech-ops
Jgreen added a subtask for T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data : T242671: remove fundraising puppet jessie exceptions.
Thu, Jan 16, 9:17 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen added a parent task for T242671: remove fundraising puppet jessie exceptions: T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Thu, Jan 16, 9:17 PM · fundraising-tech-ops
Jgreen removed a subtask for T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data : Unknown Object (Task).
Thu, Jan 16, 9:16 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen renamed T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data from EPIC/OKR: Support fundraising through maintaining infrastructure for payments and donor data to OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Thu, Jan 16, 9:13 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen added a subtask for T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data : Unknown Object (Task).
Thu, Jan 16, 9:06 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen set Due Date to Mar 31 2020, 11:59 PM on T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Thu, Jan 16, 9:05 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen created T243019: OKR 2019-2020 Q3: Support fundraising through maintaining infrastructure for payments and donor data .
Thu, Jan 16, 9:04 PM · fr-tech-ops-okr, Fundraising-Backlog, fundraising-tech-ops
Jgreen added a comment to T242265: rack/setup/install frlog2001.frack.codfw.wmnet.

Note we have the same Debian vs unused 10G NIC problem documented here T242481. We're waiting for information from Dell on how to disable the 10G ports in BIOS, meanwhile there's a pxeboot/preseed workaround in T242481.

Thu, Jan 16, 5:21 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen added a subtask for T242257: 2019-2020 Q3 fundraising hardware refresh and capex: T242990: decommission alnitak.frack.codfw.wmnet.
Thu, Jan 16, 4:22 PM · fundraising-tech-ops
Jgreen added a parent task for T242990: decommission alnitak.frack.codfw.wmnet: T242257: 2019-2020 Q3 fundraising hardware refresh and capex.
Thu, Jan 16, 4:22 PM · ops-codfw, Operations, DC-Ops, decommission
Jgreen added a subtask for T242257: 2019-2020 Q3 fundraising hardware refresh and capex: T242983: decommission frdb2001.frack.codfw.wmnet.
Thu, Jan 16, 4:19 PM · fundraising-tech-ops
Jgreen added a parent task for T242983: decommission frdb2001.frack.codfw.wmnet: T242257: 2019-2020 Q3 fundraising hardware refresh and capex.
Thu, Jan 16, 4:19 PM · ops-codfw, Operations, DC-Ops, decommission
Jgreen created T242990: decommission alnitak.frack.codfw.wmnet.
Thu, Jan 16, 4:17 PM · ops-codfw, Operations, DC-Ops, decommission
Jgreen created T242983: decommission frdb2001.frack.codfw.wmnet.
Thu, Jan 16, 4:08 PM · ops-codfw, Operations, DC-Ops, decommission
Jgreen reassigned T242265: rack/setup/install frlog2001.frack.codfw.wmnet from Jgreen to Papaul.

@Papaul I'm getting an error at pxeboot, looks like the cable is not connected or the network port is off? Can you take a look?

Thu, Jan 16, 3:32 PM · Operations, ops-codfw, fundraising-tech-ops

Wed, Jan 15

Jgreen updated the task description for T234068: (ASAP) rack/setup/install frban1001.frack.eqiad.wmnet.
Wed, Jan 15, 3:58 PM · Operations, fundraising-tech-ops
Jgreen updated the task description for T234068: (ASAP) rack/setup/install frban1001.frack.eqiad.wmnet.
Wed, Jan 15, 3:56 PM · Operations, fundraising-tech-ops
Jgreen added a comment to T242022: Verify no losses in kafka->kafkatee->logfile data pipeline segment.

Please note that as of this AM I switched us to frban2001 and moved alnitak 'off to the side' pending decom. The 1:1 logs we collected as described above are now accessible via mintaka:/srv/archive/banner_logs/2019-testing.

Wed, Jan 15, 3:38 PM · Fundraising-Backlog
Jgreen closed T239733: rack/setup/install frdb2002.frack.codfw.wmnet, a subtask of T242257: 2019-2020 Q3 fundraising hardware refresh and capex, as Resolved.
Wed, Jan 15, 3:33 PM · fundraising-tech-ops
Jgreen closed T239733: rack/setup/install frdb2002.frack.codfw.wmnet as Resolved.
Wed, Jan 15, 3:33 PM · fundraising-tech-ops, ops-codfw, Operations
Jgreen closed T234069: rack/setup/install frban2001.frack.codfw.wmnet, a subtask of T242257: 2019-2020 Q3 fundraising hardware refresh and capex, as Resolved.
Wed, Jan 15, 3:30 PM · fundraising-tech-ops
Jgreen closed T234069: rack/setup/install frban2001.frack.codfw.wmnet as Resolved.
Wed, Jan 15, 3:30 PM · Operations, fundraising-tech-ops, ops-codfw
Jgreen updated the task description for T234069: rack/setup/install frban2001.frack.codfw.wmnet.
Wed, Jan 15, 3:08 PM · Operations, fundraising-tech-ops, ops-codfw
Jgreen updated the task description for T239733: rack/setup/install frdb2002.frack.codfw.wmnet.
Wed, Jan 15, 3:07 PM · fundraising-tech-ops, ops-codfw, Operations
Jgreen updated the task description for T239733: rack/setup/install frdb2002.frack.codfw.wmnet.
Wed, Jan 15, 3:05 PM · fundraising-tech-ops, ops-codfw, Operations
Jgreen updated the task description for T239733: rack/setup/install frdb2002.frack.codfw.wmnet.
Wed, Jan 15, 2:14 PM · fundraising-tech-ops, ops-codfw, Operations

Tue, Jan 14

Jgreen closed Restricted Task, a subtask of T242265: rack/setup/install frlog2001.frack.codfw.wmnet, as Resolved.
Tue, Jan 14, 2:41 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen closed Restricted Task, a subtask of T242269: rack/setup/install frpm2001.frack.codfw.wmnet, as Resolved.
Tue, Jan 14, 2:41 PM · fundraising-tech-ops
Jgreen closed Restricted Task, a subtask of T242270: rack/setup/install civi2001.frack.codfw.wmnet, as Resolved.
Tue, Jan 14, 2:41 PM · fundraising-tech-ops

Mon, Jan 13

Jgreen closed T242671: remove fundraising puppet jessie exceptions as Resolved.
Mon, Jan 13, 8:55 PM · fundraising-tech-ops
Jgreen closed T242671: remove fundraising puppet jessie exceptions, a subtask of T185013: EPIC: migrate fundraising off of Debian Jessie, as Resolved.
Mon, Jan 13, 8:55 PM · fundraising-tech-ops
Jgreen added a comment to T242671: remove fundraising puppet jessie exceptions.

commit b8229e89763048d04caad84e27f9c020f2f308a3
Author: Jeff Green <jgreen@wikimedia.org>
Date: Mon Jan 13 14:03:01 2020 -0500

Mon, Jan 13, 8:54 PM · fundraising-tech-ops
Jgreen created T242671: remove fundraising puppet jessie exceptions.
Mon, Jan 13, 8:51 PM · fundraising-tech-ops

Wed, Jan 8

Jgreen added a subtask for T242265: rack/setup/install frlog2001.frack.codfw.wmnet: Unknown Object (Task).
Wed, Jan 8, 9:50 PM · Operations, ops-codfw, fundraising-tech-ops
Jgreen added a subtask for T242269: rack/setup/install frpm2001.frack.codfw.wmnet: Unknown Object (Task).
Wed, Jan 8, 9:50 PM · fundraising-tech-ops
Jgreen added a subtask for T242270: rack/setup/install civi2001.frack.codfw.wmnet: Unknown Object (Task).
Wed, Jan 8, 9:50 PM · fundraising-tech-ops
Jgreen updated the task description for T242270: rack/setup/install civi2001.frack.codfw.wmnet.
Wed, Jan 8, 9:32 PM · fundraising-tech-ops
Jgreen updated the task description for T242270: rack/setup/install civi2001.frack.codfw.wmnet.
Wed, Jan 8, 9:31 PM · fundraising-tech-ops