Page MenuHomePhabricator
Feed Advanced Search

Today

Eileenmcnaughton closed T256940: Enable changes to wmf_donor or contributions to alter contact.modified_date, a subtask of T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export , as Resolved.
Thu, Jul 2, 6:59 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton closed T256940: Enable changes to wmf_donor or contributions to alter contact.modified_date as Resolved.
Thu, Jul 2, 6:59 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T256940: Enable changes to wmf_donor or contributions to alter contact.modified_date.

I take it all back - I was looking in the UI - the DB field IS updated!

Thu, Jul 2, 6:59 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton created T256940: Enable changes to wmf_donor or contributions to alter contact.modified_date.
Thu, Jul 2, 6:26 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T256522: Small number of contacts being inappropriately put on the suppression list.

mepps these 4

Thu, Jul 2, 5:21 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@KHaggard I have actually run the full upload 3 times today - which I think will see 3 files. All 3 should map to the same mapping but they have different ratios of placeholders to data. If the most recent one successfully uploads you should have data in all the new fields. I ran through all 3 fully as I am scared one or more will fail (the code differs between them) & figured it would be good to try all 3. That might take a bit of wrangling at your end. The last one has only just started

Thu, Jul 2, 4:52 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Tue, Jun 30

Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@EYener the staging DB structure is changing.... It's in flux right now but the goal is to update it more often and to do that it needs simplifying. I am open to adding extra fields for you that are not needed by the export

Tue, Jun 30, 7:54 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Sat, Jun 27

Eileenmcnaughton created T256522: Small number of contacts being inappropriately put on the suppression list.
Sat, Jun 27, 4:17 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

My checks on the suppression list suggest the changes are OK but there is a small number being put on the suppression list possibly incorrectly - I think the issue is timing. We attempt to mitigate this by looking at max(email_id) but I think we might need to look at modified date- will subtask it

Sat, Jun 27, 4:11 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Fri, Jun 26

Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@KHaggard so as I understand it

  1. you need the extra fields to exist inn accoustic
  2. we deploy new fields in the csv (either with actual data or placeholders where we don't have the actual data merged yet
  3. you clean up the mapping to match the new csv layout.
Fri, Jun 26, 10:53 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@jgleeson it still requires action at @KHaggard's end to get the new fields & I think the difference in effort is not that great (create new fields, map them) - so I think we just don't send them until @KHaggard is ready

Fri, Jun 26, 9:55 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

hmm this one needs digging 20478153

Fri, Jun 26, 7:43 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

File length yesterday & today - very similar

Fri, Jun 26, 7:38 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

I also got these errors ... which seem not a problem but to be checked

Fri, Jun 26, 7:16 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

I deployed the speed improvement for exclude list (at least the db generate part) - yesterday

  • export part - 3 hours 50
  • upload - 30 mins
Fri, Jun 26, 7:12 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Thu, Jun 25

Eileenmcnaughton closed T254941: Fix new recurrings to be created with a Pending status as Resolved.
Thu, Jun 25, 11:26 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton moved T242001: Civi: annual summary email - add tax deductibility language from Pending Deployment to Done on the Fundraising Sprint MySQL is YourSQL and WeSQL board.
Thu, Jun 25, 11:26 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, FR-AutoTY-Email, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton moved T254941: Fix new recurrings to be created with a Pending status from Pending Deployment to Done on the Fundraising Sprint MySQL is YourSQL and WeSQL board.
Thu, Jun 25, 11:26 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton moved T256162: Missing "unsubscribe" link in automatic recurring failure email from Review to Pending Deployment on the Fundraising Sprint MySQL is YourSQL and WeSQL board.
Thu, Jun 25, 11:25 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising-Backlog
Eileenmcnaughton moved T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export from Backlog to Doing on the Fundraising Sprint MySQL is YourSQL and WeSQL board.
Thu, Jun 25, 11:25 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton moved T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP) from Backlog to Doing on the Fundraising Sprint MySQL is YourSQL and WeSQL board.
Thu, Jun 25, 11:25 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton moved T242001: Civi: annual summary email - add tax deductibility language from Pending Deployment to Done on the Fundraising Sprint Lazy Loading Life board.
Thu, Jun 25, 10:37 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, FR-AutoTY-Email, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T242001: Civi: annual summary email - add tax deductibility language.

Looks like this went out

Thu, Jun 25, 10:37 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, FR-AutoTY-Email, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton moved T254941: Fix new recurrings to be created with a Pending status from Pending Deployment to Done on the Fundraising Sprint Lazy Loading Life board.
Thu, Jun 25, 10:36 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton added a comment to T254941: Fix new recurrings to be created with a Pending status.

@mepps yep - just checked

Thu, Jun 25, 10:36 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@KHaggard I can't deploy them without getting the mapping changed because they are in a 'logical place' in the file - not at the end - so the mapping would break. It would also break on 2 fields being no longer in the export that are in the mapping

Thu, Jun 25, 10:21 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Wed, Jun 24

Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

& just to be clear - I'm talking about the mapping in general - I took a look in the UI & the fields in the UI are not in the same order as the mapping so I think the 2 are independent of each other - but obviously we can only map to new fields once they exist

Wed, Jun 24, 10:47 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@KHaggard I tried to ping you on chat to clarify -for the removed fields I'm not clear because they are to be removed from the file - & hence the mapping

Wed, Jun 24, 10:21 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@KHaggard we can punt that question

Wed, Jun 24, 9:35 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

Sorry I lie - that change is not the one queued up - the queued change just calculates it incrementally but uploads the full set - still the question is worth asking - if we switch to incremental do we need to purge first (I'm not sure how beneficial switching to incremental is on this one as the file size is less)

Wed, Jun 24, 9:28 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton updated subscribers of T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

@CCogdill_WMF @KHaggard when I deploy this currently-queued patch it will mean that only additions to the suppression list in the last 7 days get uploaded going forwards - do you want to purge the suppression list & get a full reload one last time before we switch?

Wed, Jun 24, 9:25 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T254809: Export Matching Gifts data to acoustic.

@jgleeson I merged yours but added a follow up patch here https://gerrit.wikimedia.org/r/#/c/wikimedia/fundraising/tools/+/607391/ - per comments - the individual record holds the employer name, where applicable.

Wed, Jun 24, 12:45 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Patch-For-Review, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog

Tue, Jun 23

Eileenmcnaughton created T256184: Add utm_medium to failed recur email.
Tue, Jun 23, 10:53 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

@KHaggard maybe we should remove the 2 fields that I've removed in the meantime then. I have a patch in review that should massively reduce the time to re-create the suppression list - but if I deploy that the 2 old fields will be dropped too. Also we have the extra fields for MG - employer_name & employer-id almost ready to deploy

Tue, Jun 23, 8:55 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton moved T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP) from Backlog to Doing on the Fundraising Sprint Lazy Loading Life board.
Tue, Jun 23, 8:53 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T255805: TS update import back into Civi.

What I normally do is test doing a UI import to the target smart import mapping & check it's OK (e.g 200 rows) & get Leanne to check.

Tue, Jun 23, 8:52 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

@KHaggard that's quite far out - I thought you wanted the new fields before that?

Tue, Jun 23, 7:46 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T254304: Conflicting fields in some Acoustic contact records.

Of the list these are all cases where they were added to the suppression list but not updated due to their opt out flags. This is by design

Tue, Jun 23, 7:58 AM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

I'm thinking the goal will be to build a staging table - in that table I would add the main details of all contacts who have been updated and then massage those contacts and then insert them over. The main challenge is that to do that BEFORE adding the new fields would skip the once off update. to fill those fields

Tue, Jun 23, 7:03 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton updated the task description for T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .
Tue, Jun 23, 7:03 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton updated the task description for T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .
Tue, Jun 23, 6:05 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton created T256096: Add job to protect us against contacts with duplicate primary addresses.
Tue, Jun 23, 5:52 AM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T256073: Silverpop export: move the suppression list to a different job.

I'm a bit stuck on this - I can't understand why this isn't passing - https://gerrit.wikimedia.org/r/607156 & I'm having trouble running the tests locally & my attempt to fix https://gerrit.wikimedia.org/r/607166 is not working :-). I'm going to focus on another part of the sql for a bit (this this is kind of a discrete portion & I was going to 'knock it off & then look at the address part' ..... 4 hours ago....

Tue, Jun 23, 5:25 AM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

That last patch drops out about 50 mins from the job

Tue, Jun 23, 1:56 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton updated the task description for T256073: Silverpop export: move the suppression list to a different job.
Tue, Jun 23, 1:49 AM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T256073: Silverpop export: move the suppression list to a different job.

@CCogdill_WMF thanks for this - that simplifies it - it sounds like the suppression list can run 'any time'

Tue, Jun 23, 12:10 AM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Mon, Jun 22

Eileenmcnaughton created T256073: Silverpop export: move the suppression list to a different job.
Mon, Jun 22, 10:41 PM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton updated subscribers of T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

@KHaggard my understanding is that re-ordering at our end means you need to go in & adjust your end from acoustic to match. I think we should drop the discussed fields, add placeholders for the new fields & re-order in one hit (the new fields would be empty initially). I have put a proposed re-order in this spreadsheet

Mon, Jun 22, 9:46 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Fri, Jun 19

Eileenmcnaughton added a comment to T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

@KHaggard we have the field removals ready to go but I wonder if we should take the chance to re-order the existing fields (get with the alphabet man) & maybe create placeholder fields for the new fields to be added. Or if we should just co-ordinate removing those 2 fields as step 1

Fri, Jun 19, 2:24 AM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

@EYener I've made so many comments I'm not sure which you are trying to clarify. I am aware of your interest in having more of our calculated fields available & have some thoughts on it. I kinda need to create a sub ticket on that &express it a bit more clearly - will ping you from it when it exists

Fri, Jun 19, 2:22 AM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Thu, Jun 18

Eileenmcnaughton created T255739: SIlverpop urls expiring at the end of the month will our integrations break?.
Thu, Jun 18, 1:47 AM · Fundraising-Backlog

Wed, Jun 17

Eileenmcnaughton added a comment to T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

Note that MG would like these available in the UI. The first 2 are cheap - the second not so much but raises question about the 'where'

Wed, Jun 17, 11:16 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T254517: New list pull from Civi.

Note that the way to make MS Excel (except Leanne's copy) interpret special characters is to add some hex to the start of the file -
https://en.wikipedia.org/wiki/Byte_order_mark#UTF-8

Wed, Jun 17, 10:16 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Tue, Jun 16

Eileenmcnaughton added a comment to T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

@KHaggard given we need to co-ordinate the timing for deletions I might move to get the deletion changes ready to deploy from our end & we can pick a day.

Tue, Jun 16, 11:43 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T252245: Add and delete fields from the _all_Wikimedia database (civi export to ESP).

@KHaggard just noting on the removals that

Tue, Jun 16, 10:55 PM · Patch-For-Review, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T254304: Conflicting fields in some Acoustic contact records.

@KHaggard yes - please provide the others - I've spotted something in the silverpop script that looks a bit wrong to me & I'm wondering if it might relate

Tue, Jun 16, 9:44 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T251914: Investigate drupal upgrade.

I have doubts about the usefulness of wmf_campaign but digging it looks like MG used it as recently as 2019

Tue, Jun 16, 8:59 PM · Fundraising-Backlog
Eileenmcnaughton added a comment to T237564: Special Characters do not export well from civi.

OK last time around I could replicate the issue on Excel - but now I can export just fine for that contact - shall we look at in Major GIftts

Tue, Jun 16, 8:39 PM · Fundraising Sprint YAMLton, the Musical, Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

So reading up on materialized views here is what I understand

Tue, Jun 16, 7:21 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

I did a bit of a 'literature search' (trawled phab) & found the following that relate / impact this

Tue, Jun 16, 6:17 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton closed T152448: Spike: Investigate Silverpop invalid rows as Resolved.

I think we should close this - if it was still an issue there will be more recent tickets

Tue, Jun 16, 12:46 AM · Fundraising-Backlog, FR-Email
Eileenmcnaughton added a comment to T161759: retrieve the contacts who have signed up for email without going through our donor system.

I feel like this is done

Tue, Jun 16, 12:44 AM · Wikimedia-Fundraising-CiviCRM, Epic, Fundraising-Backlog
Eileenmcnaughton added a comment to T193446: Excessive modified_date triggers locking civicrm_contact.

@Ejegg I think we fixed this?

Tue, Jun 16, 12:17 AM · Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton added a comment to T254304: Conflicting fields in some Acoustic contact records.

@KHaggard Looking at 1764053 - this is a contact who is no longer being exported & is on the suppression list. So it's a different issue & seems to be 'by design'

Tue, Jun 16, 12:17 AM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Mon, Jun 15

Eileenmcnaughton added a comment to T242001: Civi: annual summary email - add tax deductibility language.

@mepps sounds good. Might be good to try doing as an apiv4 - good chance to dig into that. Note the api could go in the wmf_thankyou extension rather than the module

Mon, Jun 15, 10:39 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, FR-AutoTY-Email, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T237564: Special Characters do not export well from civi.

@RLewis can you provide the example contact id

Mon, Jun 15, 10:37 PM · Fundraising Sprint YAMLton, the Musical, Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising-Backlog
Eileenmcnaughton added a comment to T254513: large quantity of bounce messages in the civimail "ignored" bucket.

ah no

// if $matches is empty, this email is not CiviMail-bound
if (!$matches) {
  $store->markIgnored($key);
  continue;
}
Mon, Jun 15, 7:57 PM · Fundraising Sprint Lazy Loading Life, Fundraising-Backlog
Eileenmcnaughton added a comment to T254513: large quantity of bounce messages in the civimail "ignored" bucket.

this hook `CRM_Utils_Hook::emailProcessorContact($email, $contactID, $result);` could help debug?

Mon, Jun 15, 7:56 PM · Fundraising Sprint Lazy Loading Life, Fundraising-Backlog
Eileenmcnaughton added a comment to T254513: large quantity of bounce messages in the civimail "ignored" bucket.

So it's this exception catch

Mon, Jun 15, 7:54 PM · Fundraising Sprint Lazy Loading Life, Fundraising-Backlog
Eileenmcnaughton closed T255449: Civi Warning PHP out of date as Resolved.
Mon, Jun 15, 7:44 PM · Fundraising-Backlog
Eileenmcnaughton added a comment to T255449: Civi Warning PHP out of date.

It was set to 'remind me in a month' - a month passed. Hopefully by next month we will be updated

Mon, Jun 15, 7:44 PM · Fundraising-Backlog

Thu, Jun 11

Eileenmcnaughton added a comment to T242001: Civi: annual summary email - add tax deductibility language.

@mepps - so this is good stuff. I would think that if the simplest version is fairly easy to do then it's fine to go with that for now - how hard do you think it is?

Thu, Jun 11, 8:56 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, FR-AutoTY-Email, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

SO, if we start with

Thu, Jun 11, 6:26 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton claimed T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

I have been digging into materialized views too - best links

Thu, Jun 11, 6:21 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton moved T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export from Backlog to Doing on the Fundraising Sprint Lazy Loading Life board.
Thu, Jun 11, 6:11 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

So to describe the above we have 2 outputs

Thu, Jun 11, 5:53 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog
Eileenmcnaughton added a comment to T253152: Q4 FY2019/20 investigate export and upload issues with the silverpop export .

So I'm gonna start by talking about what we do & what we should do. Here is what the current export does

Thu, Jun 11, 1:03 AM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Wed, Jun 10

Eileenmcnaughton added a comment to T230064: generate generic email for failed recurring donations .

@MBeat33 we have deployed fixes to the form so it should work without the open-in-new-tab trick. Turning it on for the scheduled job is quick literally a check-box here at the bottom of this page civicrm/settings/smashpig

Wed, Jun 10, 10:25 PM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton moved T230064: generate generic email for failed recurring donations from Review to Done on the Fundraising Sprint Lazy Loading Life board.
Wed, Jun 10, 10:24 PM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T242001: Civi: annual summary email - add tax deductibility language.

As an aside it would be good to move some parts of the drupal module into the civi extension wmf-thankyou as part of this

Wed, Jun 10, 10:22 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, FR-AutoTY-Email, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T254815: Civi: manual dedupe is slow.

@MBeat33 I just deployed a fix & it seemed OK in my testing just now

Wed, Jun 10, 10:20 PM · Fundraising Sprint Lazy Loading Life, FR-Civi-Dedupe, Fundraising-Backlog
Eileenmcnaughton moved T254815: Civi: manual dedupe is slow from Review to Done on the Fundraising Sprint Lazy Loading Life board.
Wed, Jun 10, 10:20 PM · Fundraising Sprint Lazy Loading Life, FR-Civi-Dedupe, Fundraising-Backlog
Eileenmcnaughton claimed T254815: Civi: manual dedupe is slow.
Wed, Jun 10, 3:03 AM · Fundraising Sprint Lazy Loading Life, FR-Civi-Dedupe, Fundraising-Backlog
Eileenmcnaughton moved T254815: Civi: manual dedupe is slow from Backlog to Review on the Fundraising Sprint Lazy Loading Life board.
Wed, Jun 10, 3:03 AM · Fundraising Sprint Lazy Loading Life, FR-Civi-Dedupe, Fundraising-Backlog
Eileenmcnaughton added a comment to T254815: Civi: manual dedupe is slow.

OK - I found the issue - it's a regression caused by (ahem) a performance fix I did. It's hitting an unindexed query. I have put up a quick-hack fix & am looking on a better one upstream

Wed, Jun 10, 3:03 AM · Fundraising Sprint Lazy Loading Life, FR-Civi-Dedupe, Fundraising-Backlog
Eileenmcnaughton added a comment to T254940: Test CiviCRM on new box.

The email that was in the email for the new server was already in Silvepop. I altered the entry to add the api access checkbox but have not re-tested

Wed, Jun 10, 1:46 AM · fundraising-tech-ops, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton added a comment to T230064: generate generic email for failed recurring donations .

@mepps I figured out the shoreditch-bug - (after incurring serious brain injury) https://gerrit.wikimedia.org/r/#/c/wikimedia/fundraising/crm/+/604214/

Wed, Jun 10, 1:42 AM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton moved T230064: generate generic email for failed recurring donations from Done to Review on the Fundraising Sprint Lazy Loading Life board.
Wed, Jun 10, 1:41 AM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton moved T230064: generate generic email for failed recurring donations from Doing to Done on the Fundraising Sprint Lazy Loading Life board.
Wed, Jun 10, 1:40 AM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Tue, Jun 9

Eileenmcnaughton added a comment to T230064: generate generic email for failed recurring donations .

@MBeat33 so regarding the above

Tue, Jun 9, 11:11 PM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T230064: generate generic email for failed recurring donations .

css issue

Tue, Jun 9, 10:11 PM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T230064: generate generic email for failed recurring donations .

So the send button is not showing with shoreditch enabled...

Tue, Jun 9, 10:10 PM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton moved T230064: generate generic email for failed recurring donations from Backlog to Doing on the Fundraising Sprint Lazy Loading Life board.
Tue, Jun 9, 9:39 PM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton created T254941: Fix new recurrings to be created with a Pending status.
Tue, Jun 9, 9:04 PM · Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton created T254940: Test CiviCRM on new box.
Tue, Jun 9, 9:03 PM · fundraising-tech-ops, Fundraising Sprint MySQL is YourSQL and WeSQL, Fundraising Sprint Lazy Loading Life, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM
Eileenmcnaughton added a comment to T230064: generate generic email for failed recurring donations .

I added a patch to fix the settings form

Tue, Jun 9, 4:35 AM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton added a comment to T230064: generate generic email for failed recurring donations .

It should now be possible to send these from live - you will see an activity created on any that have been sent

Tue, Jun 9, 12:31 AM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton moved T230064: generate generic email for failed recurring donations from Doing to Done on the Fundraising Sprint Kavascript: the chill new language board.
Tue, Jun 9, 12:29 AM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Mon, Jun 8

Eileenmcnaughton closed T254205: CiviCRM regular upgrade, a subtask of T230064: generate generic email for failed recurring donations , as Resolved.
Mon, Jun 8, 10:56 PM · Fundraising Sprint Lazy Loading Life, Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
Eileenmcnaughton closed T254205: CiviCRM regular upgrade as Resolved.
Mon, Jun 8, 10:56 PM · Fundraising Sprint Kavascript: the chill new language, Fundraising Sprint Just space out, Fundraising Sprint Ice cream cures everything, Fundraising Sprint Heaven is a page on Wikipedia, fundraising Sprint Grep works IRL, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog