Page MenuHomePhabricator

KHaggard (Katie Haggard)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Nov 9 2018, 10:42 PM (106 w, 6 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
KHaggard (WMF) [ Global Accounts ]

Recent Activity

Tue, Nov 24

KHaggard added a comment to T266475: matching gifts values don't match between databases.

Moska is out of office, but I'm pretty sure QA checks are almost complete except one last thing Briana needs Moska for. That's all I know for now, but Moska returns tomorrow so she may be able to chime in then. Thanks!

Tue, Nov 24, 9:54 PM · Fundraising Sprint We all meet again, Fundraising Sprint Vagranty McVagrantface, Fundraising-Backlog

Thu, Nov 12

KHaggard closed T265352: Civi to IBM export: Yesterday's files were sent today as Resolved.

Thanks @jgleeson ! I checked out the recurring import jobs and they processed yesterday's again but also the correct day's files right after. We're all set today for sending out emails :)

Thu, Nov 12, 2:25 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog

Wed, Nov 11

KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Sure thing, @DStrine ! Apologies, I was under the impression that re-using the same task was preferred, as the issue replicates the same way on the Acoustic side. I'll make new tasks from now on. Shall I resolve this one now and make a new task for tomorrow if needed?

Wed, Nov 11, 7:22 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard lowered the priority of T265352: Civi to IBM export: Yesterday's files were sent today from Unbreak Now! to High.
Wed, Nov 11, 5:17 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Issue is resolved for today! Big thanks to @Ejegg and @jgleeson. From what I read in the chat and email today, it seems that in the short-term, fr-tech will need to fix data manually for each query before re-running the export job. @jgleeson will kindly check back in tomorrow to see if the export needs redoing then. Thank you, Jack!

Wed, Nov 11, 5:15 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Thanks! @Ejegg looked into it and send over the files again. I processed them on my side and so I think we are good. I do want to quickly note that the Unsubscribes file doesn't seem to be increasing (like it usually does) for the last few days. Dropping in yesterday's job and today's job:

Wed, Nov 11, 3:33 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard reopened T265352: Civi to IBM export: Yesterday's files were sent today as "Open".

The civi export file failed again this morning, but we already had emails go out at 10:00 UTC. Donor services has been notified. We have another batch of emails scheduled for tomorrow, so it's urgent for us to have the export running today and tomorrow. Is there someone working today who is willing to look into this? Thanks!

Wed, Nov 11, 2:22 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog

Tue, Nov 10

KHaggard closed T265352: Civi to IBM export: Yesterday's files were sent today as Resolved.
Tue, Nov 10, 6:33 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

This issue is now resolved. We had a bump in the road with manual exports failing a few times, and then a bad data issue with fields including a "b'" before the values.
Thanks for working on this today!

Tue, Nov 10, 6:32 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard reopened T265352: Civi to IBM export: Yesterday's files were sent today as "Open".

Reopening this task. We have emails scheduled for today at 14:00 UTC. Could today's export be rerun asap? @jgleeson @Ejegg

Tue, Nov 10, 1:28 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog

Wed, Nov 4

KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Noting this issue happened again today (Nov 4, 2020). @jgleeson noticed and kicked off a rerun this morning, so we are clear to send emails today.

Wed, Nov 4, 1:20 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog

Fri, Oct 30

KHaggard added a comment to T265700: all_Wikimedia database shows both_funds_donation_count as a decimal.

The conversation about the few un-updated contacts has been moved to this phab T254304 so we can "officially" close this one out. Thanks!

Fri, Oct 30, 6:46 PM · Fundraising Sprint Upbeat Upholstery, Fundraising-Backlog
KHaggard updated subscribers of T254304: Conflicting fields in some Acoustic contact records.

Adding in some new mystery contacts from another phab (T265700) into this one to investigate why a small number of contacts did not get modified by a full database update and are also not on the Master Suppression List.

Fri, Oct 30, 6:44 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
KHaggard closed T265352: Civi to IBM export: Yesterday's files were sent today as Resolved.

Acoustic import ran successfully and looks good to me. Thanks for the help! Resolving this task now.

Fri, Oct 30, 5:16 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Met with fr-tech team today! @Ejegg found that the "uploader" is being kicked off too soon before the "builder" is finished. He kicked off a new file for me and is working on making sure the uploads wait to deploy until after the building job completes. Let me know if I got that right :)

Fri, Oct 30, 4:58 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard updated subscribers of T265352: Civi to IBM export: Yesterday's files were sent today.

Whoops, just realized Jack, Eileen, and Maggie are OOO today. @Ejegg - are you available to triage this?

Fri, Oct 30, 1:56 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard reopened T265352: Civi to IBM export: Yesterday's files were sent today as "Open".

Hey @jgleeson. I'm opening this ticket again as the export sent over yesterday's files again. Luckily, there's no emails going out today, but we pick back up on Monday.

Fri, Oct 30, 1:53 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog

Wed, Oct 28

KHaggard added a comment to T266599: As an email reporter, I need to know how to pull domain reports in Civi for soft bounces.

Also, just wanting to realign on the main issue of this task:
yahoo.com is bouncing at 3% now based on the latest enUS send we deployed, which seems alarming since it's the second most popular domain group in every email send. @EYener is it possible to pull a civi report tracking yahoo specifically?

Wed, Oct 28, 3:33 PM · FR-Email, Fundraising-Backlog
KHaggard added a comment to T266665: Civi to IBM export: No file on FTP.

Confirming that the import jobs completed successfully now and we are rescheduling emails. Do we want to keep this phab open for the re-try code or should I resolve this task?

Wed, Oct 28, 2:41 PM · FR-Email, Fundraising-Backlog
KHaggard added a comment to T266665: Civi to IBM export: No file on FTP.

Just confirming that there was a send scheduled to go out in 30 mins for Major Gifts, we're unscheduling that send now.

Wed, Oct 28, 1:31 PM · FR-Email, Fundraising-Backlog
KHaggard added a comment to T266599: As an email reporter, I need to know how to pull domain reports in Civi for soft bounces.

US sends from 9/16, 9/30, 10/22, and 10/26 specifically @EYener

Wed, Oct 28, 1:19 PM · FR-Email, Fundraising-Backlog
KHaggard triaged T266665: Civi to IBM export: No file on FTP as Unbreak Now! priority.
Wed, Oct 28, 1:06 PM · FR-Email, Fundraising-Backlog
KHaggard created T266665: Civi to IBM export: No file on FTP.
Wed, Oct 28, 1:06 PM · FR-Email, Fundraising-Backlog

Oct 27 2020

KHaggard created T266599: As an email reporter, I need to know how to pull domain reports in Civi for soft bounces.
Oct 27 2020, 8:05 PM · FR-Email, Fundraising-Backlog

Oct 22 2020

KHaggard added a comment to T265700: all_Wikimedia database shows both_funds_donation_count as a decimal.

@mepps Hi! The primary issue is resolved yes, but there's some straggler contacts that didn't get the update that we're trying to figure out. I think we could probably close this one out and then figure out which phab to put these edge cases in. I'll do some digging around!

Oct 22 2020, 4:23 PM · Fundraising Sprint Upbeat Upholstery, Fundraising-Backlog
KHaggard closed T265352: Civi to IBM export: Yesterday's files were sent today as Resolved.

Thanks @jgleeson ! Just ran and checked the recurring jobs and they've all processed successfully. Emails are being scheduled out for 16:00 UTC today (~8 mins)

Oct 22 2020, 3:54 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Thanks @jgleeson - To be on the safe side, we unscheduled emails today until the new file processes. Please let me know once it's available :)

Oct 22 2020, 2:52 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard reopened T265352: Civi to IBM export: Yesterday's files were sent today as "Open".

Hi all, Re-opening this task as today's import processed yesterday's file again - DatabaseUpdate-20201021033741.csv

Oct 22 2020, 1:19 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog

Oct 19 2020

KHaggard added a comment to T265700: all_Wikimedia database shows both_funds_donation_count as a decimal.

Thanks @MNoorWMF for sharing how you found those contacts in the database. I looked at the 1.00 and 2.00 donation count contacts and most of them are old donors with both_funds_latest_donation_date predating 2015, which we don't target for emails anymore. There are a few that we've sent to fairly recently, so I'm dropping some CIDs below for fr-tech to investigate. These contacts are getting emails from us, but did not get updated with the full file push and I'm having trouble figuring out why.

Oct 19 2020, 3:06 PM · Fundraising Sprint Upbeat Upholstery, Fundraising-Backlog
KHaggard added a comment to T265700: all_Wikimedia database shows both_funds_donation_count as a decimal.

@MNoorWMF - Can you show me how you checked this? I unfortunately cannot create a query to check for formatting changes.

doing a quick search of the database (note: not a query) within Acoustic and i still see a handful of folks that have x.00 but much less than before.

search results for 1.00 showed 7 contacts
2.00 showed 33 contacts
3.00 showed 32 contacts
4.00 showed 18 contacts

Oct 19 2020, 1:34 PM · Fundraising Sprint Upbeat Upholstery, Fundraising-Backlog
KHaggard added a comment to T265700: all_Wikimedia database shows both_funds_donation_count as a decimal.

Thanks everyone!

Oct 19 2020, 12:55 PM · Fundraising Sprint Upbeat Upholstery, Fundraising-Backlog

Oct 16 2020

KHaggard added a comment to T265700: all_Wikimedia database shows both_funds_donation_count as a decimal.

The recurring jobs ran successfully and so I checked the database and at a glance it looks like most contacts still have both_funds_donation_count in decimal format. I think the fix may have only applied to recent contacts, so we will need a full file push of _all_wikimedia to correct the format across the board. Could this be deployed today?

Oct 16 2020, 1:11 PM · Fundraising Sprint Upbeat Upholstery, Fundraising-Backlog

Oct 15 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

Ok, just set up the recurring update and ran the recent file from the FTP. Here's the "receipt" from the job:

Oct 15 2020, 4:06 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

Thanks, Eileen! Will attempt setting up the recurring import now.

Oct 15 2020, 1:09 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Oct 14 2020

KHaggard added a comment to T222287: Civi: make sure Forget Me requests reach IBM.

I found the email addresses through a query in Acoustic. I just amended it to show the 5 contact IDs so you'll be able to see the email addresses there. Do you have Acoustic access?

Oct 14 2020, 4:35 PM · Patch-For-Review, Fundraising Sprint We all meet again, Fundraising Sprint Vagranty McVagrantface, Fundraising Sprint Upbeat Upholstery, fr-donorservices, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
KHaggard added a comment to T222287: Civi: make sure Forget Me requests reach IBM.

@mepps I go to Data > Databases > Suppression Lists > Master Suppression List. When you click into the Master Suppression List in Acoustic, there's a search function where you can search for email address. If there's no search results, then that's how I know they're not in the suppression list. That's unfortunately the only way for me to check that I'm aware of.

Oct 14 2020, 4:24 PM · Patch-For-Review, Fundraising Sprint We all meet again, Fundraising Sprint Vagranty McVagrantface, Fundraising Sprint Upbeat Upholstery, fr-donorservices, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
KHaggard added a comment to T222287: Civi: make sure Forget Me requests reach IBM.

Hi @Eileenmcnaughton - the ones you linked aren't the contacts. I have the 5 Contact IDs but I've checked Civi for them and they're not in there:
12778090
15678606
20904192
1221887
2416641

Oct 14 2020, 1:47 PM · Patch-For-Review, Fundraising Sprint We all meet again, Fundraising Sprint Vagranty McVagrantface, Fundraising Sprint Upbeat Upholstery, fr-donorservices, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Oct 13 2020

KHaggard updated subscribers of T265352: Civi to IBM export: Yesterday's files were sent today.

Ah I see, got it :) thanks for explaining and fixing the issue so quickly @jgleeson ! Thanks for resolving the ticket @DStrine !

Oct 13 2020, 7:53 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
spatton awarded T265352: Civi to IBM export: Yesterday's files were sent today a Love token.
Oct 13 2020, 3:16 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Thanks @jgleeson! I just ran them and they look good, so we're back on track. Were you able to find the source of the data integrity issues?

Oct 13 2020, 2:44 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard added a comment to T265352: Civi to IBM export: Yesterday's files were sent today.

Thanks @jgleeson ! Will be around to process the new files if the job completes.

Oct 13 2020, 1:16 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard triaged T265352: Civi to IBM export: Yesterday's files were sent today as High priority.
Oct 13 2020, 12:40 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog
KHaggard created T265352: Civi to IBM export: Yesterday's files were sent today.
Oct 13 2020, 12:40 PM · fundraising sprint Theme songs for programming languages, FR-Email, Fundraising-Backlog

Oct 9 2020

KHaggard added a comment to T265161: As a SurveyMonkey account owner, I would like to know if we need to update our email allowlist for SurveyMonkey.

@DStrine Just chiming in that we just embed survey URLs directly into the Thank You pages, if that helps! I'm thinking more about blockages for our SurveyMonkey account users if we ever need to reset a password, for instance. Let me know if this should be flagged elsewhere!

Oct 9 2020, 5:17 PM · Fundraising-Backlog
KHaggard created T265161: As a SurveyMonkey account owner, I would like to know if we need to update our email allowlist for SurveyMonkey.
Oct 9 2020, 5:09 PM · Fundraising-Backlog

Oct 5 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

No rush at all on this task. In fact, we have a small break in sending emails late next week so setting up a new recurring import would be more convenient next week :)

Oct 5 2020, 9:06 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

@mepps Yes I think so! Would it be possible for fr-tech to send a duplicate Unsubscribes file under a different name than "Unsubscribes" so I can differentiate/organize the recurring jobs in Acoustic?

Oct 5 2020, 8:49 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Oct 2 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

Hey all - I just ran the test trial of this with a MSL file from Tuesday. The opt-out job took 3 minutes and the _all_wikimedia recalculation job took 11 minutes. I'm adding the job results below:

Oct 2 2020, 7:41 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Sep 29 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

I think after I run the test on Friday we will have a good understanding of how many contacts in general are opted out, and it might be a good practice to have this be a 3rd recurring import job if it doesn't take too long to run. I'll report back on how long the job takes and how many contacts update.

Sep 29 2020, 7:51 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

Thanks @mepps - that makes sense. I just got a training from Brian on how to run this job. In the spirit of being overly cautious, I will execute the suppressed contact opt-out from the main database job this Friday, so that it doesn't run while we are sending emails. Will ping here after it runs so we get a sense of how long it takes to process and if it's viable to set up a nightly recurring job for it.

Sep 29 2020, 7:43 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Sep 28 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

Hi @mepps - thanks for following up. @bsisolak and I have a one-on-one meeting set up for tomorrow to go through the process. Will update how it goes afterwards.

Sep 28 2020, 1:29 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Sep 17 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

Addressing Brian's questions:

  • I think @mepps is talking about Acoustic, but @bsisolak is right about how it will slowly get out of sync again and we will have to make a routine of opting out folks in the main database. This is synonymous to what we currently do in Acoustic twice a year: purge the suppressed contacts out of the main database (instead of re-labeling). I guess the solution we want is to figure out an ongoing way to keep suppressed contacts out of the main database regularly, removing the need to manually purge when we happen to remember.
Sep 17 2020, 4:43 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Sep 15 2020

KHaggard added a comment to T261870: frFR contacts not updating in Acoustic.

No need, I see the Sent Date info in the forwarded email and it looks like the control from this morning's send.

Sep 15 2020, 6:34 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard added a comment to T261870: frFR contacts not updating in Acoustic.

Hi @MBeat33 - Thanks for flagging. I'm looking up this contact in Acoustic and their information looks updated to me, latest_donation_date is the 2020 donation and it's saying that the last time we sent them an email was in Feb 2020 (Thank You Campaign). The same is reflected in "mailing events" in Civi.

Sep 15 2020, 6:15 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard updated subscribers of T261705: As a email manager, I'd like to see which contacts are suppressed.

Sorry, I'm a bit confused. Fr-tech sends the Master Suppression List export file to us and we have it mapped to update nightly. Would the fix be to change the settings of this data job?

Sep 15 2020, 5:13 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Sep 14 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

Oh, that's helpful - thanks @mepps

Sep 14 2020, 6:01 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Sep 10 2020

KHaggard added a comment to T261705: As a email manager, I'd like to see which contacts are suppressed.

@mepps No that doesn't reflect suppression list contacts. We have people labeled as "Opted In" in our database that also have their email on the suppression list so they are always suppressed, but that field doesn't notate it. I'm not aware if it's being used for something else, but if not, it would be super helpful if that field updated when people are put on the suppression list!

Sep 10 2020, 8:50 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog

Sep 3 2020

KHaggard closed T261870: frFR contacts not updating in Acoustic as Resolved.

@Eileenmcnaughton and @MNoorWMF - Just double checked the above CIDs - looks like they're updated correctly now. Thanks Eileen! I think we can move forward with the campaign now.

Sep 3 2020, 1:59 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard added a comment to T261870: frFR contacts not updating in Acoustic.

Thanks @Eileenmcnaughton I see it processed early this morning. Checking the database now.

Sep 3 2020, 1:24 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog

Sep 2 2020

KHaggard added a comment to T261870: frFR contacts not updating in Acoustic.

Ah, ok. Thanks for clarifying and working on this. @MNoorWMF moved our next email send day to Monday, so if you want to send over the full database file tonight, it'll process as scheduled and I can check it in the morning to make sure the contacts we listed in this task are updated. Does that sounds good?

Sep 2 2020, 8:31 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard added a comment to T261870: frFR contacts not updating in Acoustic.

Cool, thanks @Eileenmcnaughton - will we need to do a full database update tonight or tomorrow to get all contacts situated?

Sep 2 2020, 8:17 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard renamed T261870: frFR contacts not updating in Acoustic from frFR CIDs not updated in Acoustic to frFR contacts not updating in Acoustic.
Sep 2 2020, 5:25 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard added a comment to T261870: frFR contacts not updating in Acoustic.

@krobinson Confirming that those three CIDs you commented do not have updated latest_donation_date criteria within Acoustic. CID 16626014 was found via email address, which had CID 26931866 instead in Acoustic.

Sep 2 2020, 5:18 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard added a comment to T261870: frFR contacts not updating in Acoustic.

Just added another note from investigating: Looks like CID 16801314 has a matching CID and email address between civi and Acoustic, but Acoustic is listing AF_latest_donation_date as Nov 2016. Looks like this contact was not updated from the donor's Aug 26 donation, so something must be up with the civi to Acoustic nightly export.

Sep 2 2020, 4:06 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard added a project to T261870: frFR contacts not updating in Acoustic: FR-Email.
Sep 2 2020, 2:35 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard triaged T261870: frFR contacts not updating in Acoustic as Unbreak Now! priority.
Sep 2 2020, 2:33 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog
KHaggard created T261870: frFR contacts not updating in Acoustic.
Sep 2 2020, 2:31 PM · Fundraising Sprint Raw data never hurt anyone, fr-donorservices, FR-Email, Fundraising-Backlog

Aug 31 2020

KHaggard added a comment to T254304: Conflicting fields in some Acoustic contact records.

New phab for investigating the weird contacts we can't place: T261705

Aug 31 2020, 9:56 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
KHaggard added a comment to T257597: Add two additional fields to silverpop export.

Updating this thread, the two new fields are in the database and functioning. However, I cannot confirm with certainty that all contacts in the database have all been backfilled, as there's not a clear way for me to run queries on these changes. When I run a query that I expect to return 0 contacts, I get a large return that warrants a closer look at the contacts case by case - similar to the issue we surfaced in ticket T254304. For example, there are contacts sitting in our database that have blanks for both_funds_latest_currency when Annual_Fund_latest_currency is populated. There's suppression list contacts in our database and old contacts that have been deduped, all of which get pulled into query counts. In general, there's some data hygiene that needs to get done at some point, so that my queries pull as accurately as possible. So, I made a long term task for this here: T261705

Aug 31 2020, 9:52 PM · Fundraising Sprint Pseudopretzels, Fundraising-Backlog
KHaggard triaged T261705: As a email manager, I'd like to see which contacts are suppressed as Low priority.
Aug 31 2020, 9:50 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
KHaggard created T261705: As a email manager, I'd like to see which contacts are suppressed.
Aug 31 2020, 9:49 PM · Fundraising Sprint Upbeat Upholstery, fundraising sprint Theme songs for programming languages, Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
KHaggard added a comment to T254304: Conflicting fields in some Acoustic contact records.

@CCogdill_WMF Were you going to contact legal? I'm not sure what we need to reach Legal for - but this task still stands and I was planning on creating a new task to link to this. It seems to be pointing to a bigger issue that our database is carrying contacts that don't match what's in civi, and so I cannot verify with fr-tech when new fields are successfully backfilled. We have quite a few contacts in IBM with nonsensical data and it meddles with our query counts.

Aug 31 2020, 6:23 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Aug 24 2020

KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

Thanks @jgleeson - I ran the export job you sent over and it the bad data issue seems to be fixed. Pasting in rows below. The 1 bad data seems to be a row that did not have an email address. Since the export covers all contact updates in the last 7 days, we should be fine now to continue forward with the frFR send tomorrow.

Aug 24 2020, 3:02 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

@Eileenmcnaughton @mepps - Hey all updating this task again - looks like the nightly import is showing tons of bad data again, I can track it that it's been doing this over the weekend so I think we need another full file push. Are you able to see on your end if modified date is back in the export? All I can see on my end for the bad data error is: "Date provided is not a valid date/format. Valid format: MM/dd/yyyy"

Aug 24 2020, 1:00 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog

Aug 20 2020

KHaggard added a comment to T259189: High Unique Clicks for nlNL RML program.

Just updating that we have a Trilogy rep looking into this, but I have some questions for fr-tech:

Aug 20 2020, 8:57 PM · Fundraising-Backlog
KHaggard added a comment to T254304: Conflicting fields in some Acoustic contact records.

Per our convo in T260708 - moving my comment to here.

Aug 20 2020, 12:11 AM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Aug 19 2020

KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

I agree and yes, sorry that other email address is in fact on the suppression list when I double checked. It's difficult to search within the suppression list because it takes forever to load my search results. I wish there was a way in IBM to filter out suppression list contacts from my queries so it's not as confusing for everyone - may be a future phab in that.

Aug 19 2020, 11:58 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

Ah, ok when I search the database for that contact without restrictions, CID 1768225 has two email address tied to it. Contact hash is also the same. I can only find one email address out of the two in civi. They have different AF_latest_donation_dates

Aug 19 2020, 11:45 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

Got it, thanks. I ran a query to check for any contacts in en6C and FR who donated within the last 5 years and are not opted out that have blanks for those fields ^. The count wasn't huge, but it returned a bit over 6k records. I'm pasting a few cids from that query below for you to look at @Eileenmcnaughton . Let me know what you think.

Aug 19 2020, 11:23 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

@Eileenmcnaughton Do you mean the all_funds_latest_currency and all_funds_latest_currency_symbol from ticket T257597 ? I'll check now

Aug 19 2020, 10:53 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

The file @Eileenmcnaughton sent over processed successfully with bad data back to what it normally is. See aggregate row totals below:

Aug 19 2020, 10:40 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

Just ran the latest import and there's a lot of bad data. @Eileenmcnaughton the error is saying: Date provided is not a valid date/format. Valid format: MM/dd/yyyy Could someone fix the date formatting and send the file over again?

Aug 19 2020, 3:42 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

Jumping in - the nightly recurring data jobs ran several times this morning, but it looks like there's another file (maybe more) in the queue that I missed. I'm manually running it now. Sorry for any confusion. I'll update this phab again when it's finished.

Aug 19 2020, 3:00 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog

Aug 18 2020

KHaggard added a comment to T260708: Latest currency fields in silverpop export are incorrect.

Hey just jumping in to confirm, yes it's looking like the following Acoustic fields are not populating accurately:
AF_latest_currency (civi equivalent = foundation_latest_currency)
AF_latest_currency_symbol (civi equivalent = foundation_latest_currency_symbol)

Aug 18 2020, 5:27 PM · Patch-For-Review, fundraising Sprint Quackery limited to ducks, Fundraising-Backlog
KHaggard added a comment to T257597: Add two additional fields to silverpop export.

The data jobs seems to be running successfully on my end. Just making sure I understand correctly, will the backfill export file be similar to how it used to look for just one run?

Aug 18 2020, 1:33 PM · Fundraising Sprint Pseudopretzels, Fundraising-Backlog

Aug 17 2020

KHaggard added a comment to T257597: Add two additional fields to silverpop export.

This makes sense to me. Thanks @Eileenmcnaughton. I was out of office last Friday but will work on remapping the file today. Will update here when it runs successfully. Let me know if there's a way I can help on the backfilling project.

Aug 17 2020, 1:42 PM · Fundraising Sprint Pseudopretzels, Fundraising-Backlog

Aug 11 2020

KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Three file bundles processed last night, I'm listing the DatabaseUpdate files below. Thanks for letting me know about the change, confirming that total rows looks to be around the number you specified, 1.34k for the August 11 files. I didn't list the unsubscribes files below, as they look normal and the same as before, but let me know if you need them too.

Aug 11 2020, 1:19 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Aug 7 2020

KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Just updating on that last comment ^

Aug 7 2020, 9:07 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Hi there, looks like the import job failed this morning because there was no file to retrieve. I wonder if the civi server upgrade from last night could have cancelled the file export? If that's the case, maybe it'll start working normally again tomorrow. I know Eileen is out today, so tagging in @Ejegg or @jgleeson. Could one of you take a look if you have time? Thanks :)

Aug 7 2020, 1:45 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Aug 6 2020

KHaggard lowered the priority of T259189: High Unique Clicks for nlNL RML program from Medium to Low.

Just updating that our Trilogy rep is going to look into this clicks issue. In case it's helpful, here's the URL for that mailing, requested from the meeting:

Aug 6 2020, 9:10 PM · Fundraising-Backlog

Aug 4 2020

KHaggard added a comment to T259189: High Unique Clicks for nlNL RML program.

I'll flag this with our Trilogy rep this week, thanks!

Aug 4 2020, 1:25 PM · Fundraising-Backlog

Jul 29 2020

KHaggard added a comment to T259189: High Unique Clicks for nlNL RML program.

Could someone from email team drop in the full email URL for that track?

Jul 29 2020, 7:35 PM · Fundraising-Backlog
KHaggard triaged T259189: High Unique Clicks for nlNL RML program as Medium priority.
Jul 29 2020, 7:34 PM · Fundraising-Backlog
KHaggard created T259189: High Unique Clicks for nlNL RML program.
Jul 29 2020, 7:33 PM · Fundraising-Backlog

Jul 21 2020

KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Awesome, thanks for the work on this! I can confirm that the nightly import data jobs are running smoothly with aggregate totals that make sense. Thanks for the heads up that we will soon change to processing recently modified contacts only - I will keep that in mind for my checks.

Jul 21 2020, 1:31 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Jul 17 2020

KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Oh ok, I'm understanding that there could be a 'delay' in what populates the duplicate addresses row. Sounds like no issue then. Today's import job looks great.

Jul 17 2020, 12:49 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Jul 16 2020

KHaggard added a comment to T254809: Export Matching Gifts data to acoustic.

Just clarifying here - I can't actually see the file showing up in Acoustic but I know the file is being sent over because jgleeson mentioned it in IRC a while back. I dug up the file name from IRC chat history: MatchingGifts-[dateandtimestamp].csv so @MNoorWMF when you and I set up this recurring data job we will mark down the file name as: MatchingGifts-*

Jul 16 2020, 5:42 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Patch-For-Review, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog
KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Hi @Eileenmcnaughton . Sorry for the delay, I was off work yesterday. Looking at the results of the import jobs, Two July 15th files were processed - once on July 15 and again today. The July 16th file processed this morning as expected and looks healthy.

Jul 16 2020, 1:16 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Jul 10 2020

KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Fresh data job run looks ok. One thing I'll point out just in case is that the Master Suppression List total rows has increased by 12k since yesterday. I'm used to MSL increasing but since we haven't sent out emails for a while, it looks a little strange. Does that seem right to you, @Eileenmcnaughton ?

Jul 10 2020, 5:33 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
KHaggard added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Oh wait, I actually see there's a file ready to run right now. Starting that job now and will report back here on how it looks.

Jul 10 2020, 2:54 PM · Fundraising Sprint Pseudopretzels, Fundraising Sprint Octopus hugs, Fundraising Sprint Nyan cats for everyone, Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog