Page MenuHomePhabricator

cwdent (casey dentinger)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
May 12 2015, 6:28 PM (210 w, 4 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
CDentinger (WMF) [ Global Accounts ]

Recent Activity

Mon, May 20

cwdent moved T222761: Update civi1001 django_settings.py, backfill banner impressions from Backlog to Done on the fundraising-tech-ops board.
Mon, May 20, 4:16 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent moved T215182: Install private Grafana/Promtheus instance in fundraising from Backlog to In Progress on the fundraising-tech-ops board.
Mon, May 20, 4:16 PM · Patch-For-Review, fundraising-tech-ops

Wed, May 8

cwdent closed T222764: Civi SSL Certificate expired as Resolved.

Great!

Wed, May 8, 5:20 PM · fundraising-tech-ops, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
cwdent closed T217355: Revoke production prometheus fundraising access as Resolved.
Wed, May 8, 4:24 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent closed T217355: Revoke production prometheus fundraising access, a subtask of T215182: Install private Grafana/Promtheus instance in fundraising, as Resolved.
Wed, May 8, 4:24 PM · Patch-For-Review, fundraising-tech-ops
cwdent added a comment to T222764: Civi SSL Certificate expired .

@RLewis restarting the browser is worth a try. If that doesn't work could you open the menu described here in browser prefs and see if you see the certificate listed?

Wed, May 8, 4:22 PM · fundraising-tech-ops, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
cwdent moved T222764: Civi SSL Certificate expired from Backlog to In Progress on the fundraising-tech-ops board.
Wed, May 8, 4:04 PM · fundraising-tech-ops, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
cwdent added a comment to T222764: Civi SSL Certificate expired .

@RLewis your cert has 135 days left until expiration, did this just start happening? Are you using a different computer?

Wed, May 8, 3:28 PM · fundraising-tech-ops, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Tue, Apr 30

cwdent closed T221475: Network setup for frmon2001.frack.codfw.wmnet as Resolved.

@Papaul thanks! Working :)

Tue, Apr 30, 3:20 PM · Patch-For-Review, netops, Operations, fundraising-tech-ops
cwdent closed T221475: Network setup for frmon2001.frack.codfw.wmnet, a subtask of T196476: rack/setup/install Prometeuse/Grafana host frmon2001 for fr-tech, as Resolved.
Tue, Apr 30, 3:20 PM · Operations, fundraising-tech-ops

Mon, Apr 29

cwdent updated subscribers of T221475: Network setup for frmon2001.frack.codfw.wmnet.

@Papaul it looks like you wired this up in T196557 but I have tried the hw addresses reported by racadm and am not seeing dhcp packets, could you assist troubleshooting?

Mon, Apr 29, 7:10 PM · Patch-For-Review, netops, Operations, fundraising-tech-ops
cwdent moved T217355: Revoke production prometheus fundraising access from In Progress to Done on the fundraising-tech-ops board.
Mon, Apr 29, 5:12 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent updated the task description for T217355: Revoke production prometheus fundraising access.
Mon, Apr 29, 5:11 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent added a comment to T217355: Revoke production prometheus fundraising access.
commit 173b34cd01bdc0aa5998af347406d9775755656f (HEAD -> master, origin/master, origin/HEAD)
Author: Casey Dentinger <cdentinger@wikimedia.org>
Date:   Mon Apr 29 17:07:06 2019 +0000
Mon, Apr 29, 5:09 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent added a comment to T217355: Revoke production prometheus fundraising access.
commit 5e6951f6082627a1f61f38d27532a48197eada4f
Author: Casey Dentinger <cdentinger@wikimedia.org>
Date:   Mon Apr 29 17:03:13 2019 +0000
Mon, Apr 29, 5:08 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops

Apr 26 2019

cwdent added a comment to T221475: Network setup for frmon2001.frack.codfw.wmnet.

@ayounsi after talking to @Jgreen I'm going to redo the DNS using the wildcard cert to also have the failover cname.

Apr 26 2019, 3:32 PM · Patch-For-Review, netops, Operations, fundraising-tech-ops

Apr 23 2019

cwdent moved T91508: [Epic] overhaul fundraising cluster monitoring from Backlog to In Progress on the fundraising-tech-ops board.
Apr 23 2019, 7:24 PM · Epic, observability, fundraising-tech-ops
cwdent added a comment to T221475: Network setup for frmon2001.frack.codfw.wmnet.

commit 606f45371334528bbbd51a4daa17805f1fddd7e4 (HEAD -> master, origin/master, origin/HEAD)

Author: Casey Dentinger <cdentinger@wikimedia.org>
Date:   Tue Apr 23 16:23:20 2019 +0000
Apr 23 2019, 4:34 PM · Patch-For-Review, netops, Operations, fundraising-tech-ops
cwdent claimed T217355: Revoke production prometheus fundraising access.
Apr 23 2019, 4:17 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent moved T217355: Revoke production prometheus fundraising access from Backlog to In Progress on the fundraising-tech-ops board.
Apr 23 2019, 4:16 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent claimed T217353: Backup strategy for Grafana.
Apr 23 2019, 4:16 PM · fundraising-tech-ops
cwdent moved T217353: Backup strategy for Grafana from Backlog to In Progress on the fundraising-tech-ops board.
Apr 23 2019, 4:16 PM · fundraising-tech-ops
cwdent moved T221475: Network setup for frmon2001.frack.codfw.wmnet from Backlog to In Progress on the fundraising-tech-ops board.
Apr 23 2019, 4:15 PM · Patch-For-Review, netops, Operations, fundraising-tech-ops

Apr 20 2019

cwdent added a comment to T221475: Network setup for frmon2001.frack.codfw.wmnet.

@ayounsi - the new policies are at 1555726449, let me know if you need anything else thanks

Apr 20 2019, 2:18 AM · Patch-For-Review, netops, Operations, fundraising-tech-ops

Apr 19 2019

cwdent created T221475: Network setup for frmon2001.frack.codfw.wmnet.
Apr 19 2019, 6:10 PM · Patch-For-Review, netops, Operations, fundraising-tech-ops

Apr 18 2019

cwdent closed T220647: ccogdill has new yubikey, need to update frdev server access as Resolved.
Apr 18 2019, 2:06 PM · fundraising-tech-ops, Fundraising-Backlog

Apr 16 2019

cwdent added a comment to T220647: ccogdill has new yubikey, need to update frdev server access.

@CCogdill_WMF you're right that part is just a comment that is fine to leave off, the key is also shorter than your old one, but that can be normal if the new computer has different default ciphers. Did you try to log in?

Apr 16 2019, 6:43 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T220647: ccogdill has new yubikey, need to update frdev server access.

That ssh key looks funny, like it got cut off early, but maybe it's just shorter, let me know if you can log in.

Apr 16 2019, 6:32 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T220647: ccogdill has new yubikey, need to update frdev server access.

@CCogdill_WMF actually one more minute

Apr 16 2019, 6:27 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T220647: ccogdill has new yubikey, need to update frdev server access.

@CCogdill_WMF that's fine and sorry for not reading the task! You should be good now.

Apr 16 2019, 6:26 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T220647: ccogdill has new yubikey, need to update frdev server access.

@CCogdill_WMF please post the output of the yubikey press to your officewiki profile and I'll get it updated

Apr 16 2019, 6:07 PM · fundraising-tech-ops, Fundraising-Backlog

Apr 8 2019

cwdent updated subscribers of T217355: Revoke production prometheus fundraising access.

@ayounsi there is a new config at -1554758904, removing prod prometheus and grafana access to pay-lvs servers.

Apr 8 2019, 9:54 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent added a project to T217355: Revoke production prometheus fundraising access: netops.
Apr 8 2019, 9:53 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops

Apr 5 2019

cwdent added a subtask for T220100: upgrade pay-lvs servers to stretch: T217355: Revoke production prometheus fundraising access.
Apr 5 2019, 5:54 PM · fundraising-tech-ops
cwdent added a parent task for T217355: Revoke production prometheus fundraising access: T220100: upgrade pay-lvs servers to stretch.
Apr 5 2019, 5:54 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops

Apr 4 2019

cwdent added a comment to T219825: Update dashboards to node-exporter 0.16+ metric names.

@fgiunchedi @colewhite actually we have a private grafana/prometheus instance up and running in fundraising now so we can disconnect this and remove the fundraising boards. I'd like to export some FR metrics some day but for the time being this will be easier in terms of PCI compliance and data safety.

Apr 4 2019, 5:50 PM · Patch-For-Review, observability

Mar 26 2019

cwdent added a subtask for T219333: apt-get update broken on jessie: jessie-updates and jessie-backports removed by Debian: T219280: sort out jessie vs jesse-backports vs openssl pinning issue .
Mar 26 2019, 11:18 PM · Patch-For-Review, Operations
cwdent added a parent task for T219280: sort out jessie vs jesse-backports vs openssl pinning issue : T219333: apt-get update broken on jessie: jessie-updates and jessie-backports removed by Debian.
Mar 26 2019, 11:17 PM · fundraising-tech-ops

Mar 15 2019

cwdent added a comment to T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS).

@Jgreen said:

Mar 15 2019, 3:33 PM · Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising Sprint Fistful of $variables, Fundraising Sprint Ewoks Take Manhattan, Fundraising Sprint Da Vinci Coder, Fundraising Sprint Casino Royale With Cheese, MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Fundraising Sprint Bert and Ernie's Excellent Adventure, Patch-For-Review, Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog

Mar 14 2019

cwdent closed T218269: rsyslog will not unattended-upgrade as Resolved.

I looked back and rsyslog was set to install from backports like 6 months ago. What I don't understand is why it is not installed from backports right now. I updated them manually. I'll reopen if this comes up again.

Mar 14 2019, 9:39 PM · fundraising-tech-ops
cwdent added a comment to T218269: rsyslog will not unattended-upgrade.
$ apt-cache policy rsyslog
rsyslog:
  Installed: 8.24.0-1
  Candidate: 8.1901.0-1~bpo9+1
  Version table:
     8.1901.0-1~bpo9+1 1001
        -10 http://ftp.debian.org/debian stretch-backports/main amd64 Packages
     8.38.0-1~bpo9+1wmf1 500
        500 http://apt.wikimedia.org/wikimedia stretch-wikimedia/main amd64 Packages
 *** 8.24.0-1 500
        500 http://ftp.us.debian.org/debian stretch/main amd64 Packages
        100 /var/lib/dpkg/status
     8.4.2-1+deb8u2 -10
        -10 http://ftp.us.debian.org/debian jessie/main amd64 Packages
Mar 14 2019, 9:14 PM · fundraising-tech-ops
cwdent added a comment to T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS).

@mepps - Did we decide which of the two described approaches we want to take? Once we do that I'll start on some subtasks for the 'advanced prep' section.

Mar 14 2019, 5:34 PM · Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising Sprint Fistful of $variables, Fundraising Sprint Ewoks Take Manhattan, Fundraising Sprint Da Vinci Coder, Fundraising Sprint Casino Royale With Cheese, MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Fundraising Sprint Bert and Ernie's Excellent Adventure, Patch-For-Review, Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog

Mar 13 2019

cwdent added a comment to T217353: Backup strategy for Grafana.

@CDanis thanks! I will definitely use that trick.

Mar 13 2019, 9:46 PM · fundraising-tech-ops
cwdent created T218269: rsyslog will not unattended-upgrade.
Mar 13 2019, 9:41 PM · fundraising-tech-ops
cwdent created T218219: cronspam: /usr/local/bin/geoip_update.
Mar 13 2019, 2:56 PM · fundraising-tech-ops

Mar 6 2019

cwdent added a comment to T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS).

@cwdent Does @Ejegg's comment resolve your concerns?

Mar 6 2019, 3:31 PM · Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising Sprint Fistful of $variables, Fundraising Sprint Ewoks Take Manhattan, Fundraising Sprint Da Vinci Coder, Fundraising Sprint Casino Royale With Cheese, MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Fundraising Sprint Bert and Ernie's Excellent Adventure, Patch-For-Review, Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog

Mar 5 2019

cwdent added a comment to T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS).

@mepps I think it would be more usefully discussed on a task where it can be seen by everyone, because my essential worry is there haven't been enough eyes on this change, and it is a likely source of unintended consequences.

Mar 5 2019, 9:22 PM · Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising Sprint Fistful of $variables, Fundraising Sprint Ewoks Take Manhattan, Fundraising Sprint Da Vinci Coder, Fundraising Sprint Casino Royale With Cheese, MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Fundraising Sprint Bert and Ernie's Excellent Adventure, Patch-For-Review, Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog

Mar 1 2019

cwdent created T217413: cronspam: file size changed while zipping.
Mar 1 2019, 3:38 PM · fundraising-tech-ops

Feb 28 2019

cwdent created T217355: Revoke production prometheus fundraising access.
Feb 28 2019, 5:40 PM · Operations, netops, Patch-For-Review, fundraising-tech-ops
cwdent created T217353: Backup strategy for Grafana.
Feb 28 2019, 5:35 PM · fundraising-tech-ops
cwdent created T217342: Deploy inconsistency between civi1001 and mintaka.
Feb 28 2019, 4:48 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent created T217341: tmp on civi1001 is large.
Feb 28 2019, 4:26 PM · fundraising-tech-ops, Fundraising-Backlog

Feb 27 2019

cwdent added a comment to T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS).

@DStrine wondered if it would be possible to roll the CSP header before the PHP upgrade. According to https://www.mediawiki.org/wiki/Compatibility we could upgrade PHP before MW. However I think there may be problems with ResourceLoader image inlining.

Feb 27 2019, 6:09 PM · Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising Sprint Fistful of $variables, Fundraising Sprint Ewoks Take Manhattan, Fundraising Sprint Da Vinci Coder, Fundraising Sprint Casino Royale With Cheese, MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Fundraising Sprint Bert and Ernie's Excellent Adventure, Patch-For-Review, Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog

Feb 19 2019

cwdent created T216559: disable rschoenbaechler in fundraising.
Feb 19 2019, 9:08 PM · fundraising-tech-ops

Feb 13 2019

cwdent added a comment to T184460: Upgrade PaymentsWiki to Mediawiki 1.31 (new LTS).

Unlike 1004 which is working properly, Apache on on 2003 is returning "(52) Empty reply from server"

Feb 13 2019, 5:20 PM · Fundraising Sprint Hansel and grep -l, Fundraising Sprint Greps of Wrath, Fundraising Sprint Fistful of $variables, Fundraising Sprint Ewoks Take Manhattan, Fundraising Sprint Da Vinci Coder, Fundraising Sprint Casino Royale With Cheese, MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Fundraising Sprint Bert and Ernie's Excellent Adventure, Patch-For-Review, Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog
cwdent created T216051: Update Maxmind IP addresses.
Feb 13 2019, 5:06 PM · fundraising-tech-ops

Feb 6 2019

cwdent closed T215364: Deploy pfw policy to allow https to frmon.frdev.wikimedia.org as Resolved.

Working, thanks @ayounsi !

Feb 6 2019, 3:10 AM · netops, Operations, fundraising-tech-ops
cwdent closed T215364: Deploy pfw policy to allow https to frmon.frdev.wikimedia.org, a subtask of T215182: Install private Grafana/Promtheus instance in fundraising, as Resolved.
Feb 6 2019, 3:10 AM · Patch-For-Review, fundraising-tech-ops

Feb 5 2019

cwdent updated the task description for T215364: Deploy pfw policy to allow https to frmon.frdev.wikimedia.org.
Feb 5 2019, 10:58 PM · netops, Operations, fundraising-tech-ops
cwdent added a project to T215364: Deploy pfw policy to allow https to frmon.frdev.wikimedia.org: netops.
Feb 5 2019, 10:57 PM · netops, Operations, fundraising-tech-ops
cwdent created T215364: Deploy pfw policy to allow https to frmon.frdev.wikimedia.org.
Feb 5 2019, 10:56 PM · netops, Operations, fundraising-tech-ops
cwdent closed T214812: Staging site data refresh as Resolved.

This is done, incidentally the dumps are now big enough to cause disk alerts about /srv

Feb 5 2019, 2:45 PM · Fundraising-Backlog, fundraising-tech-ops

Feb 4 2019

cwdent created T215182: Install private Grafana/Promtheus instance in fundraising.
Feb 4 2019, 5:42 PM · Patch-For-Review, fundraising-tech-ops
cwdent added a comment to T214812: Staging site data refresh.

Just kicked this off, will update when it finishes, probably tomorrow.

Feb 4 2019, 3:58 PM · Fundraising-Backlog, fundraising-tech-ops

Jan 30 2019

cwdent closed T186073: Rack/setup frmon1001 as Resolved.

@Cmjohnson yep, sorry forgot about this ticket! Thanks for your help.

Jan 30 2019, 10:59 PM · Patch-For-Review, fundraising-tech-ops, Operations
cwdent updated the task description for T186073: Rack/setup frmon1001.
Jan 30 2019, 10:58 PM · Patch-For-Review, fundraising-tech-ops, Operations

Jan 17 2019

cwdent added a comment to T213948: Update SciPy on frdev1001.

@Pcoombe yes indeed, I made a subtask for that for tracking and to remind myself.

Jan 17 2019, 11:25 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent created T214115: Re-image frdev1001 to stretch.
Jan 17 2019, 11:22 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T213948: Update SciPy on frdev1001.

@Pcoombe unfortunately the available versions on Jessie (current OS) and Stretch (upcoming OS) are both old (0.14 and 0.18 respectively). Buster (2 OS versions out) has 1.0 but that's a ways off. So we'd want to look at packaging it ourselves which is doable, unless someone around here (analytics?) has already done that which would be easier.

Jan 17 2019, 5:59 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T213973: Remove frimpressions db from prod mysql.

@Marostegui @jcrespo thanks!

Jan 17 2019, 5:17 PM · DBA, Fundraising-Backlog

Jan 16 2019

cwdent created T213973: Remove frimpressions db from prod mysql.
Jan 16 2019, 9:24 PM · DBA, Fundraising-Backlog
cwdent edited projects for T213915: wmf_deploy updated but not merged and deployed into .12, added: Fundraising-Backlog; removed fundraising-tech-ops.
Jan 16 2019, 3:07 PM · Fundraising Sprint Bert and Ernie's Excellent Adventure, MW-1.33-notes (1.33.0-wmf.12; 2019-01-08), Fundraising Sprint A series of unfortunate event handlers, Patch-For-Review, Fundraising-Backlog, MediaWiki-extensions-CentralNotice

Jan 9 2019

cwdent closed T213100: Refresh Minfraud IP list as Resolved.

@ayounsi thanks for the help, this looks good

Jan 9 2019, 3:48 PM · netops, Operations, fundraising-tech-ops

Jan 8 2019

cwdent updated subscribers of T213100: Refresh Minfraud IP list.

@ayounsi the new rules are at 1546987554

Jan 8 2019, 10:57 PM · netops, fundraising-tech-ops, Operations
cwdent added a parent task for T213100: Refresh Minfraud IP list: Unknown Object (Task).
Jan 8 2019, 10:12 PM · netops, fundraising-tech-ops, Operations

Jan 7 2019

cwdent reassigned T211712: moving from krypton to grafana1001 broke fundraising dashboards from cwdent to CDanis.

@CDanis all good here, go ahead and remove the old service at your convenience.

Jan 7 2019, 8:06 PM · fundraising-tech-ops, Patch-For-Review, User-CDanis, observability
cwdent added a comment to T211712: moving from krypton to grafana1001 broke fundraising dashboards.

@ayounsi thanks! Fundraising grafana is now fixed. i pushed up 1546890827 which removes krypton.

Jan 7 2019, 7:56 PM · fundraising-tech-ops, Patch-For-Review, User-CDanis, observability
cwdent updated subscribers of T211712: moving from krypton to grafana1001 broke fundraising dashboards.

@ayounsi the updated config for this is at 1546888529

Jan 7 2019, 7:18 PM · fundraising-tech-ops, Patch-For-Review, User-CDanis, observability
cwdent added a comment to T211712: moving from krypton to grafana1001 broke fundraising dashboards.

Deployed iptables change:

Jan 7 2019, 6:11 PM · fundraising-tech-ops, Patch-For-Review, User-CDanis, observability
cwdent added a comment to T213100: Refresh Minfraud IP list.

iptables change

Jan 7 2019, 5:09 PM · netops, fundraising-tech-ops, Operations
cwdent created T213100: Refresh Minfraud IP list.
Jan 7 2019, 4:56 PM · netops, fundraising-tech-ops, Operations
cwdent added a comment to T212177: Closing donation banner breaks scrolling.

@Pythoncoder thanks for the report, I shuffled the tags around so this gets seen by the right people.

Jan 7 2019, 3:04 PM · Wikimedia-Fundraising-Banners, Fundraising-Backlog
cwdent edited projects for T212177: Closing donation banner breaks scrolling, added: Fundraising-Backlog; removed fundraising-tech-ops.
Jan 7 2019, 3:03 PM · Wikimedia-Fundraising-Banners, Fundraising-Backlog

Jan 3 2019

cwdent added a comment to T212745: Create read-only user for civicrm devdb on staging.

@Eileenmcnaughton sure, looking at the grants, would that be just select on dev_*?

Jan 3 2019, 6:17 PM · fundraising-tech-ops, Fundraising-Backlog

Jan 2 2019

cwdent added a project to T212796: Epic: Fundraising Analytics Tools: Epic.
Jan 2 2019, 6:27 PM · Epic, fundraising-tech-ops, Fundraising-Backlog
cwdent added a parent task for T178953: Overhaul /srv/br: T212796: Epic: Fundraising Analytics Tools.
Jan 2 2019, 6:26 PM · Epic, Fundraising-Backlog, fundraising-tech-ops
cwdent added subtasks for T212796: Epic: Fundraising Analytics Tools: Unknown Object (Task), T178953: Overhaul /srv/br.
Jan 2 2019, 6:26 PM · Epic, fundraising-tech-ops, Fundraising-Backlog
cwdent created T212796: Epic: Fundraising Analytics Tools.
Jan 2 2019, 6:25 PM · Epic, fundraising-tech-ops, Fundraising-Backlog

Dec 19 2018

cwdent added a parent task for T212252: Create icinga alert for connectivity to Ingenico Connect endpoint: T207511: Sort out fr-tech work phone situation.
Dec 19 2018, 3:38 PM · Fundraising-Backlog, fundraising-tech-ops
cwdent added a subtask for T207511: Sort out fr-tech work phone situation: T212252: Create icinga alert for connectivity to Ingenico Connect endpoint.
Dec 19 2018, 3:38 PM · observability, Fundraising-Backlog

Dec 18 2018

cwdent added a comment to T212252: Create icinga alert for connectivity to Ingenico Connect endpoint.

While currently tech can see the alerts in IRC, Jeff and I get SMS about it, which means dropping what you are doing, getting out of bed, etc. So it would be good to keep that alert stream to things that are actionable by ops. Another icinga channel might be the answer, but there is the open question of who pays for our phones.

Dec 18 2018, 8:49 PM · Fundraising-Backlog, fundraising-tech-ops
cwdent added a comment to T212252: Create icinga alert for connectivity to Ingenico Connect endpoint.

There are a couple related tickets here: T202419

Dec 18 2018, 8:46 PM · Fundraising-Backlog, fundraising-tech-ops
cwdent added a comment to T212252: Create icinga alert for connectivity to Ingenico Connect endpoint.

Does this mean fr-tech wants to get paged by icinga?

Dec 18 2018, 8:45 PM · Fundraising-Backlog, fundraising-tech-ops
cwdent closed T211060: Fundraising cluster access for Christine Stone as Resolved.

@Cstone has logged in to everything

Dec 18 2018, 4:44 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T211060: Fundraising cluster access for Christine Stone.
c917cff add cstone mysql grants
Dec 18 2018, 4:44 PM · fundraising-tech-ops, Fundraising-Backlog

Dec 17 2018

cwdent added a comment to T211060: Fundraising cluster access for Christine Stone.
07a03cd add cstone secrets
Dec 17 2018, 9:42 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T211060: Fundraising cluster access for Christine Stone.
36e3166 add cstone user
Dec 17 2018, 9:42 PM · fundraising-tech-ops, Fundraising-Backlog
cwdent added a comment to T208270: acl for easy export of civi data.

Thanks everyone, inspiring to see the commitment to donor privacy in action.

Dec 17 2018, 6:28 PM · Fundraising Sprint XML ate my homework, Fundraising Sprint Window dressing is mostly olive oil, Patch-For-Review, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM

Dec 13 2018

cwdent added a project to T211712: moving from krypton to grafana1001 broke fundraising dashboards: fundraising-tech-ops.
Dec 13 2018, 6:07 PM · fundraising-tech-ops, Patch-For-Review, User-CDanis, observability

Dec 12 2018

cwdent added a comment to T211435: Give jsamra access to /srv/br on frdev1001.

@Pcoombe can we get contact/employment info for @Jksamra updated on https://collab.wikimedia.org/wiki/Fundraising#Contact_List ?

Dec 12 2018, 4:35 PM · Fundraising-Backlog, fundraising-tech-ops