Page MenuHomePhabricator

Jgreen (Jeff Green)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Nov 25 2014, 1:54 PM (242 w, 5 d)
Availability
Available
IRC Nick
Jeff_Green
LDAP User
Jgreen
MediaWiki User
Jgreen (wmf) [ Global Accounts ]

Recent Activity

Fri, Jul 19

Jgreen closed T228316: frdev1001 ssh access for @Ppena as Resolved.
Fri, Jul 19, 6:34 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen triaged T228509: puppetize dump_database cron job on fundraising build servers as Normal priority.
Fri, Jul 19, 12:10 PM · fundraising-tech-ops
Jgreen created T228509: puppetize dump_database cron job on fundraising build servers.
Fri, Jul 19, 12:10 PM · fundraising-tech-ops
Jgreen closed T221008: upgrade fundraising queue servers from Debian Jessie as Resolved.

This is done!

Fri, Jul 19, 1:47 AM · fundraising-tech-ops
Jgreen closed T221008: upgrade fundraising queue servers from Debian Jessie, a subtask of T185013: EPIC: migrate fundraising off of Debian Jessie, as Resolved.
Fri, Jul 19, 1:47 AM · fundraising-tech-ops

Thu, Jul 18

Jgreen added a comment to T228316: frdev1001 ssh access for @Ppena .

I will reactivate @Ppena's account. She'll need to generate a new ssh key, I'll follow up with her in IRC or email.

Thu, Jul 18, 6:39 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen closed T228176: refresh CiviCRM SSL client certificate for Katie Haggard as Resolved.

generated & sent!

Thu, Jul 18, 5:51 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen closed T228438: refresh civicrm certificate for Sandra Hust as Resolved.
Thu, Jul 18, 3:59 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen moved T228438: refresh civicrm certificate for Sandra Hust from Backlog to Done on the fundraising-tech-ops board.

New cert sent!

Thu, Jul 18, 3:59 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen renamed T228316: frdev1001 ssh access for @Ppena from setup frdev 1001 access for @Ppena to frdev1001 ssh access for @Ppena .
Thu, Jul 18, 3:33 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen created T228438: refresh civicrm certificate for Sandra Hust.
Thu, Jul 18, 3:31 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen triaged T221116: Investigate r-cran-shiny and/or RStudio shiny-server for Fundraising team use. as Normal priority.
Thu, Jul 18, 3:28 PM · fundraising-tech-ops
Jgreen changed the status of T221116: Investigate r-cran-shiny and/or RStudio shiny-server for Fundraising team use. from Open to Stalled.
Thu, Jul 18, 3:28 PM · fundraising-tech-ops
Jgreen closed T228164: refresh IP address list for maxmind API as Resolved.
Thu, Jul 18, 3:27 PM · fundraising-tech-ops
Jgreen closed T228336: Update fundraising_code_update to tweeze new directory from localsettings to payments-wiki as Resolved.
Thu, Jul 18, 3:27 PM · fundraising-tech-ops, Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, FR-Ingenico, Fundraising-Backlog
Jgreen claimed T228316: frdev1001 ssh access for @Ppena .
Thu, Jul 18, 3:27 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen moved T228336: Update fundraising_code_update to tweeze new directory from localsettings to payments-wiki from Backlog to Done on the fundraising-tech-ops board.

@Ejegg this is done but I haven't done a test run

Thu, Jul 18, 3:07 PM · fundraising-tech-ops, Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, FR-Ingenico, Fundraising-Backlog
Jgreen moved T221116: Investigate r-cran-shiny and/or RStudio shiny-server for Fundraising team use. from In Progress to Backlog on the fundraising-tech-ops board.
Thu, Jul 18, 1:21 PM · fundraising-tech-ops

Tue, Jul 16

Jgreen moved T228176: refresh CiviCRM SSL client certificate for Katie Haggard from Backlog to In Progress on the fundraising-tech-ops board.
Tue, Jul 16, 8:12 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen renamed T228176: refresh CiviCRM SSL client certificate for Katie Haggard from Need SSL client certificate for CiviCRM to refresh CiviCRM SSL client certificate for Katie Haggard.
Tue, Jul 16, 8:12 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen moved T228164: refresh IP address list for maxmind API from In Progress to Done on the fundraising-tech-ops board.
Tue, Jul 16, 8:08 PM · fundraising-tech-ops
Jgreen created T228205: deploy pfw policy eqiad-1563305452 & codfw-1563305452.
Tue, Jul 16, 7:38 PM · Operations, netops
Jgreen added a comment to T228164: refresh IP address list for maxmind API.

commit 0ae3e07572d6991e7347babff96d3664ade881ac (HEAD -> master, origin/master, origin/HEAD)
Author: Jeff Green <jgreen@wikimedia.org>
Date: Tue Jul 16 19:26:45 2019 +0000

Tue, Jul 16, 7:36 PM · fundraising-tech-ops
Jgreen added a comment to T228164: refresh IP address list for maxmind API.

commit 8c2f1b2e607433ee263d8b1741145d741895ce22 (HEAD -> master, origin/master, origin/HEAD)
Author: Jeff Green <jgreen@wikimedia.org>
Date: Tue Jul 16 18:20:46 2019 +0000

Tue, Jul 16, 6:48 PM · fundraising-tech-ops
Jgreen triaged T228164: refresh IP address list for maxmind API as Normal priority.
Tue, Jul 16, 1:58 PM · fundraising-tech-ops
Jgreen moved T228164: refresh IP address list for maxmind API from Backlog to In Progress on the fundraising-tech-ops board.
Tue, Jul 16, 1:58 PM · fundraising-tech-ops
Jgreen added a comment to T228164: refresh IP address list for maxmind API.

Reviewing the changes, they've removed several IPv4 addresses from the list. There are no new IPv4 addresses.

Tue, Jul 16, 1:10 PM · fundraising-tech-ops
Jgreen created T228164: refresh IP address list for maxmind API.
Tue, Jul 16, 1:09 PM · fundraising-tech-ops

Tue, Jul 9

Jgreen moved T227528: Request Civi CRM certificate for new user Evelyn Martin from Backlog to Done on the fundraising-tech-ops board.
Tue, Jul 9, 6:13 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen merged task T227528: Request Civi CRM certificate for new user Evelyn Martin into Restricted Task.
Tue, Jul 9, 6:06 PM · fundraising-tech-ops, Fundraising-Backlog

Mon, Jul 1

Jgreen closed T157600: fix silverpop database updater not to crush the master database with long queries as Resolved.
Mon, Jul 1, 12:30 PM · fundraising-tech-ops, Fundraising-Backlog

Thu, Jun 27

Jgreen moved T156053: nginx apt proxy cache sometimes fails from Backlog to Done on the fundraising-tech-ops board.
Thu, Jun 27, 7:45 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen closed T156053: nginx apt proxy cache sometimes fails as Resolved.

This hasn't been a problem in a while, but I reduced the cache control default time from 10m to 5m anyway.

Thu, Jun 27, 7:45 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen closed Restricted Task, a subtask of T136963: overhaul payments-wiki deployment process, as Resolved.
Thu, Jun 27, 7:19 PM · Fundraising-Backlog, fundraising-tech-ops, Fundraising-Backlog-Old
Jgreen closed T202419: Page fr-tech about spikes in frtechmail as Declined.

Nice to have but we won't get around to it.

Thu, Jun 27, 7:16 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen added a subtask for T226749: fundraising tech operations GDPR tracking task: Unknown Object (Task).
Thu, Jun 27, 7:15 PM · fundraising-tech-ops
Jgreen added a subtask for T226749: fundraising tech operations GDPR tracking task: Unknown Object (Task).
Thu, Jun 27, 7:14 PM · fundraising-tech-ops
Jgreen added a subtask for T226749: fundraising tech operations GDPR tracking task: Unknown Object (Task).
Thu, Jun 27, 7:14 PM · fundraising-tech-ops
Jgreen triaged T226749: fundraising tech operations GDPR tracking task as Normal priority.
Thu, Jun 27, 6:00 PM · fundraising-tech-ops
Jgreen closed T195988: get bonded ethernet config into puppet as Declined.

this would be nice to have, but is so low in priority we will ever get to it

Thu, Jun 27, 5:47 PM · fundraising-tech-ops
Jgreen closed T211435: Give jsamra access to /srv/br on frdev1001 as Declined.
Thu, Jun 27, 5:43 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen claimed T212745: Create read-only user for civicrm devdb on staging.
Thu, Jun 27, 5:42 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen placed T224733: investigate recent divot in landingpage log activity up for grabs.

unassigning b/c it does not look like there's anything wrong with the frack part of the pipeline (kafkatee and filters)

Thu, Jun 27, 5:37 PM · Analytics, Fundraising-Backlog, fundraising-tech-ops
Jgreen closed T218261: Build out Debian Buster test instances in virtualbox dev environment, a subtask of T218258: EPIC: prepare for Debian Buster for fundraising systems , as Resolved.
Thu, Jun 27, 1:13 PM · fundraising-tech-ops
Jgreen closed T218261: Build out Debian Buster test instances in virtualbox dev environment as Resolved.
Thu, Jun 27, 1:13 PM · fundraising-tech-ops
Jgreen closed T225022: investigate which civi job is creating/deleting tables right during the nightly database backups as Resolved.
Thu, Jun 27, 1:13 PM · Fundraising-Backlog, fundraising-tech-ops

Wed, Jun 26

Jgreen added a comment to T219558: Payments wiki form variant with employer field.
  • reload triggers to start logging data - logging won't be on until we do this. @Jgreen do you have any other outages planned that we could do this in or does it need it's own outage? I feel it's non-urgent
Wed, Jun 26, 1:44 PM · Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, MW-1.34-notes (1.34.0-wmf.8; 2019-06-04), Fundraising Sprint King Kong vs. Mozilla, Fundraising Sprint James Bond: Licensed to Share, Fundraising Sprint It Came From Out of Scope, Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising-Backlog

Tue, Jun 25

Jgreen edited projects for T226156: Phan job fails on CI for mediawiki/core REL1_3[12], added: Fundraising-Backlog; removed fundraising-tech-ops.
Tue, Jun 25, 9:42 PM · MW-1.32-release, MW-1.31-release, Fundraising-Backlog, Continuous-Integration-Config
Jgreen moved T218261: Build out Debian Buster test instances in virtualbox dev environment from Backlog to Done on the fundraising-tech-ops board.
Tue, Jun 25, 9:24 PM · fundraising-tech-ops
Jgreen moved T225022: investigate which civi job is creating/deleting tables right during the nightly database backups from Backlog to Done on the fundraising-tech-ops board.

Something got adjusted (?) because the problem has ceased.

Tue, Jun 25, 9:23 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen added a comment to T226434: remove or deactivate Casey Dentinger's civicrm user.

boo

Tue, Jun 25, 4:42 PM · Fundraising Sprint Men In Slack, Fundraising-Backlog

Mon, Jun 24

Jgreen closed T217353: Backup strategy for Grafana as Resolved.
Mon, Jun 24, 6:17 PM · fundraising-tech-ops
Jgreen closed T217353: Backup strategy for Grafana, a subtask of T215182: Install private Grafana/Promtheus instance in fundraising, as Resolved.
Mon, Jun 24, 6:17 PM · Patch-For-Review, fundraising-tech-ops
Jgreen closed T215182: Install private Grafana/Promtheus instance in fundraising as Resolved.
Mon, Jun 24, 6:17 PM · Patch-For-Review, fundraising-tech-ops
Jgreen closed T225145: grant temporary tables for developers on fundraising dev database as Resolved.
Mon, Jun 24, 6:16 PM · fundraising-tech-ops
Jgreen created T226434: remove or deactivate Casey Dentinger's civicrm user.
Mon, Jun 24, 5:37 PM · Fundraising Sprint Men In Slack, Fundraising-Backlog
Jgreen closed T225596: grant mysql 'file' access to frdev users on the fundraising development database as Resolved.
Mon, Jun 24, 5:36 PM · fundraising-tech-ops

Jun 13 2019

Jgreen triaged T225145: grant temporary tables for developers on fundraising dev database as Normal priority.
Jun 13 2019, 2:32 PM · fundraising-tech-ops

Jun 12 2019

Jgreen removed a project from T107384: Redirect old PayPal IPN URL to active listener: fundraising-tech-ops.
Jun 12 2019, 10:30 AM · Recurring-Donations, Fundraising-Backlog
Jgreen triaged T225596: grant mysql 'file' access to frdev users on the fundraising development database as Normal priority.
Jun 12 2019, 10:26 AM · fundraising-tech-ops
Jgreen moved T225596: grant mysql 'file' access to frdev users on the fundraising development database from Backlog to Done on the fundraising-tech-ops board.

This is done!

Jun 12 2019, 8:45 AM · fundraising-tech-ops
Jgreen created T225596: grant mysql 'file' access to frdev users on the fundraising development database.
Jun 12 2019, 8:42 AM · fundraising-tech-ops

Jun 5 2019

Jgreen moved T225145: grant temporary tables for developers on fundraising dev database from Backlog to Done on the fundraising-tech-ops board.
Jun 5 2019, 8:35 PM · fundraising-tech-ops
Jgreen created T225145: grant temporary tables for developers on fundraising dev database.
Jun 5 2019, 7:59 PM · fundraising-tech-ops

Jun 4 2019

Jgreen added a comment to T224733: investigate recent divot in landingpage log activity.

More context/clarification, we currently have two kafkatee pipelines which I'll refer to as "old" vs "new".

Jun 4 2019, 8:32 PM · Analytics, Fundraising-Backlog, fundraising-tech-ops
Jgreen added a comment to T224733: investigate recent divot in landingpage log activity.

@Jgreen can you provide a little more context if you think we could be of help?

Hi @fdans! These are logs generated with Kafkatee, which, I think, connects to and filters the firehose of all webrequests, to record only hits to Donate wiki landing pages. The logs are then processed and hits ingressed into a database on the fundraising cluster.
This is part of an old data pipeline that we're working to replace, BTW.

Are you also missing data on webrequest table on hive?

We haven't checked yet... Definitely that's the first place to check.
Thanks much!!!

Jun 4 2019, 8:15 PM · Analytics, Fundraising-Backlog, fundraising-tech-ops
Jgreen created T225022: investigate which civi job is creating/deleting tables right during the nightly database backups.
Jun 4 2019, 8:14 PM · Fundraising-Backlog, fundraising-tech-ops

May 31 2019

Jgreen added a comment to T224733: investigate recent divot in landingpage log activity.

Raw hit counts from the logs:

May 31 2019, 5:57 PM · Analytics, Fundraising-Backlog, fundraising-tech-ops
Jgreen added a comment to T224733: investigate recent divot in landingpage log activity.

Here are the block of time where there were no logs to rotate, the 'min' value is the time elapsed since the last non-zero log file.

May 31 2019, 3:52 PM · Analytics, Fundraising-Backlog, fundraising-tech-ops
Jgreen moved T224733: investigate recent divot in landingpage log activity from Backlog to In Progress on the fundraising-tech-ops board.
May 31 2019, 2:52 PM · Analytics, Fundraising-Backlog, fundraising-tech-ops
Jgreen created T224733: investigate recent divot in landingpage log activity.
May 31 2019, 2:52 PM · Analytics, Fundraising-Backlog, fundraising-tech-ops

May 23 2019

Jgreen closed Restricted Task, a subtask of T91508: [Epic] overhaul fundraising cluster monitoring, as Resolved.
May 23 2019, 8:39 PM · Epic, observability, fundraising-tech-ops
Jgreen closed T222761: Update civi1001 django_settings.py, backfill banner impressions as Resolved.
May 23 2019, 8:37 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen closed T183138: fundraising database improvements for 2018 as Resolved.
May 23 2019, 8:37 PM · Fundraising-Backlog, fundraising-tech-ops, Epic

May 22 2019

Jgreen added a comment to T218261: Build out Debian Buster test instances in virtualbox dev environment.

build: done & prod-worthy
siem: done & prod-worth

May 22 2019, 6:41 PM · fundraising-tech-ops
Jgreen lowered the priority of T183138: fundraising database improvements for 2018 from High to Normal.
May 22 2019, 5:35 PM · Fundraising-Backlog, fundraising-tech-ops, Epic
Jgreen moved T183138: fundraising database improvements for 2018 from Backlog to Done on the fundraising-tech-ops board.
May 22 2019, 5:23 PM · Fundraising-Backlog, fundraising-tech-ops, Epic
Jgreen removed a subtask for T183138: fundraising database improvements for 2018 : T170321: encrypt fundraising database client->server communication.
May 22 2019, 5:23 PM · Fundraising-Backlog, fundraising-tech-ops, Epic
Jgreen removed a parent task for T170321: encrypt fundraising database client->server communication: T183138: fundraising database improvements for 2018 .
May 22 2019, 5:23 PM · fundraising-tech-ops
Jgreen moved T222974: install nginx 1.14.1 from stretch-backports on payments servers, enable TLSv1.3 from Backlog to Done on the fundraising-tech-ops board.
May 22 2019, 4:43 PM · fundraising-tech-ops, FR-Ingenico, Fundraising-Backlog
Jgreen closed T222974: install nginx 1.14.1 from stretch-backports on payments servers, enable TLSv1.3 as Declined.

Our current thinking is that this is unlikely to help with SSL negotiation failures, and we'd rather stick with the stock version otherwise.

May 22 2019, 4:42 PM · fundraising-tech-ops, FR-Ingenico, Fundraising-Backlog

May 21 2019

Jgreen added a project to T107384: Redirect old PayPal IPN URL to active listener: fundraising-tech-ops.
May 21 2019, 6:09 PM · Recurring-Donations, Fundraising-Backlog
Jgreen added a comment to T216633: Redis queues should use a key prefix.

I linked this to T221008 because we're talking about making this change at the same time as we upgrade the queue servers and redis, since we'll need downtime and empty queues for both tasks.

May 21 2019, 5:56 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen added a parent task for T216633: Redis queues should use a key prefix: T221008: upgrade fundraising queue servers from Debian Jessie.
May 21 2019, 5:55 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen added a subtask for T221008: upgrade fundraising queue servers from Debian Jessie: T216633: Redis queues should use a key prefix.
May 21 2019, 5:55 PM · fundraising-tech-ops
Jgreen added a comment to T223658: Enable Content Security Policy on donate-wiki.

@Jgreen This look identical to the ticket referenced. can you give more info?

May 21 2019, 5:49 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen renamed T223658: Enable Content Security Policy on donate-wiki from Enable Content Security Policy on payments-wiki to Enable Content Security Policy on donate-wiki.
May 21 2019, 5:48 PM · fundraising-tech-ops, Fundraising-Backlog

May 17 2019

Jgreen created T223658: Enable Content Security Policy on donate-wiki.
May 17 2019, 7:05 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen renamed T190183: Enable Content Security Policy on payments-wiki from Enable Content Security Policy on payments-wiki and donate-wiki to Enable Content Security Policy on payments-wiki.
May 17 2019, 7:03 PM · fundraising-tech-ops, Fundraising-Backlog
Jgreen closed T222618: schedule ~15 minute payments outage to switch clusters from codfw to eqiad as Resolved.
May 17 2019, 12:02 PM · Fundraising-Backlog, fundraising-tech-ops
Jgreen moved T222618: schedule ~15 minute payments outage to switch clusters from codfw to eqiad from In Progress to Done on the fundraising-tech-ops board.
May 17 2019, 12:01 PM · Fundraising-Backlog, fundraising-tech-ops

May 15 2019

Jgreen added a comment to T222618: schedule ~15 minute payments outage to switch clusters from codfw to eqiad .

We're planning for 2PM Thurs 5/16/2019.

May 15 2019, 2:45 PM · Fundraising-Backlog, fundraising-tech-ops

May 10 2019

hashar awarded T222840: move main fundraising puppet repo to gerrit a Love token.
May 10 2019, 8:58 PM · Gerrit, fundraising-tech-ops
Jgreen created T222974: install nginx 1.14.1 from stretch-backports on payments servers, enable TLSv1.3.
May 10 2019, 6:13 PM · fundraising-tech-ops, FR-Ingenico, Fundraising-Backlog

May 9 2019

Jgreen removed a subtask for T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS): T185547: Use Composer merge plugin for payments-wiki.
May 9 2019, 3:48 PM · Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising Sprint Fistful of $variables, Fundraising Sprint Ewoks Take Manhattan, Fundraising Sprint Da Vinci Coder, Fundraising Sprint Casino Royale With Cheese, MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Fundraising Sprint Bert and Ernie's Excellent Adventure, Patch-For-Review, Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog
Jgreen removed a parent task for T185547: Use Composer merge plugin for payments-wiki: T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS).
May 9 2019, 3:48 PM · Fundraising Sprint Queue is pronounced GJif, Patch-For-Review, Fundraising-Backlog, MediaWiki-extensions-DonationInterface
Jgreen closed T220453: upgrade civi1001 and mintaka to Stretch, possibly Buster, a subtask of T185013: EPIC: migrate fundraising off of Debian Jessie, as Resolved.
May 9 2019, 3:47 PM · fundraising-tech-ops
Jgreen closed T220453: upgrade civi1001 and mintaka to Stretch, possibly Buster as Resolved.

civi1001 is done

May 9 2019, 3:47 PM · fundraising-tech-ops
Jgreen moved T220452: upgrade frdev1001 to Debian Stretch from Backlog to Done on the fundraising-tech-ops board.
May 9 2019, 3:47 PM · fundraising-tech-ops
Jgreen renamed T220452: upgrade frdev1001 to Debian Stretch from upgrade frdev1001 to Debian Buster to upgrade frdev1001 to Debian Stretch.
May 9 2019, 3:45 PM · fundraising-tech-ops