User Details
- User Since
- Sep 15 2015, 12:37 AM (188 w, 9 h)
- Availability
- Available
- LDAP User
- Unknown
- MediaWiki User
- Eileenmcnaughton [ Global Accounts ]
Tue, Apr 16
@Jgreen looks good & any time is fine - it affects the icon on the browser tab - ie
Sat, Apr 13
@MBeat33 I feel like once you have loaded the file you should be able to make changes on the filter tab & add additional filters without losing the list of ids? I see a date filter - not so sure about the others
opps a few patches against the wrong phab there
@LeanneS I think there is a bug in the fallback in order by when it's not in the output columns - I can dig further if it's a problem but in the meantime I've added it to the output columns
I re-ran the fix. It cleared them all out except for ~650 phones where there is no phone_type_id - I'm going to leave these out of of scope & close the phab rather than extending scope to cover them
Ok new version & new run - here is before
Thu, Apr 4
opps we lost this & is is in review
Wed, Apr 3
(is that just soooo 2001 to say that?)
ug my bad
Discussed on fortnightly - closing
Notes from tech talk look at changes on staging
Tue, Apr 2
I got the cancel_reason field we discussed added upstream
These have been cleared out so looks good
Mon, Apr 1
drush vget | grep omni civicrm_repair_omnirecipient_last_processed_timestamp: "2017-10-29 00:00:00"
@LeanneS did you check this out (just looking to see if any of the things in the done column are closable)
@LeanneS did you dig anymore into this. Just wondering if we should keep it open
Ok we are down to 0 here now
@MBeat33 I assume this q "how soon can I test this on real Civi?" is out of date now?
Fri, Mar 29
This extension looks like it might be worth considering https://lab.civicrm.org/extensions/batchupdateactivitystatus - it gets past the 100 limit
Thu, Mar 28
Looks like it's crawling at the moment "2017-10-14 00:00:00'
Looks like I didn't link the bug number right https://gerrit.wikimedia.org/r/#/c/wikimedia/fundraising/crm/+/499689/
OK - I added checks for the data variants that were not covered - blank location types & primaries with more than one. I'm logging a follow on to make sense of the few blanks
[is_error] => 0
[version] => 3
[count] => 1
[id] => DuplicateLocation
[values] => Array
(
[DuplicateLocation] => Array
(
[email] => Array
(
[message] => 12326 contact/s have multiple email with the same location type
[example] => Array
(
[contact] => Array
(
[0] => 31134278
[1] => 31133115
[2] => 30992641
[3] => 28554744
[4] => 28464335
)Wed, Mar 27
OK another thought - I can see from your request to have the most recent on the right that you are keeping the most recent contact (not just transferring their details to the other contact). The question I have is whether it makes sense to 'make this work' given that both Major Gifts AND the automated script are keeping the older contact
On the middle name - I found an example - but it's showing the middle name ... civicrm/contact/merge?reset=1&cid=26469608&oid=30188795 -
@MBeat33 in the vein of things that are not technical but might help - do you ever use the button 'show/hide rows with the same details' (bottom button on this screen)
I've linked in https://phabricator.wikimedia.org/T188141 which relates to the middle name - I'm wondering if the issue with middle names is actually around confusion where the middle_name is in the first_name field - anyway some examples would help
Since I logged this the fact I think it' s not an issue anymore suggests it got fixed during the above efforts
Another one logged by Adam years ago that hasn't re-surfaced - killing
Let's kill this - the symptom went away > 3 years ago & doesn't seem to have come back
Tue, Mar 26
I had a go at getting some aggregates from existing data on staging. I added an index first & was able to get this data using a query that turned out to be surprisingly quick (< 20 seconds)
@MBeat33 There is something you can do right now to help you on the flip thing - I am pretty sure they are always sorted with lower id on the left & higher on the right - since they are sequential the lower id is created first. You CAN select them in bulk & 'flip' them see 'Flip selected duplicates' button in the screen shot to reverse that
I added phabs for the 2 things I noticed
https://phabricator.wikimedia.org/T219257
https://phabricator.wikimedia.org/T219258
@LeanneS long essay on the 2 contacts ^^
So contact 4970326
We first enabled logging (before we started deduping) on 2016-05-02
civicrm_repair_omnirecipient_last_processed_timestamp: "2017-10-09 00:00:00"
Mon, Mar 25
@DStrine FYI - this is not truly in 'doing' for me - I have patches merged upstream but I was thinking to wait for them to be deployed in the next civi update rather than put them through internal review to save work on wmf team
@DStrine FYI - this is not truly in 'doing' for me - I have patches pending review upstream that I'm hoping to get merged & then to deploy as part of our next civi update
Mar 21 2019
Mar 20 2019
Extension now at https://github.com/eileenmcnaughton/org.wikimedia.thethe
Also we might want to do some culling in sort name of known suffixes for the dedupe one
I've picked this up but have updated it to a narrower scope - ie. handling searching better for contacts leading with The (which was the example not issue before). Adam won't mind - he left fr-tech ;-)
Mar 19 2019
looks good to me