Page MenuHomePhabricator

Civi dedupe: multiple errors after 8/19 upgrade
Closed, ResolvedPublic

Description

We are seeing a range of issues when trying to dedupe today:

  1. Civi deduper is not loading the data for one column. @SHust loaded this query in Deduper and the left column does not load full details

Screen Shot 2020-08-20 at 12.06.33 PM.png (592×1 px, 463 KB)

  1. If we try to use the Safe Merge in Deduper, it hangs (for at least 10 mins) and does not complete.
  1. In the Legacy deduper, trying to merge generates an error message mentioning deletions. CIDs 348897738 and 44 are a pair that yields this output:

Screen Shot 2020-08-20 at 12.09.22 PM.png (158×490 px, 44 KB)

  1. All of the queries we run seem to be including CIDs that have already been merged. The screenshot in item 1 loads CIDs that were merged in 2019.

This is a pretty high priority task as multiple agents are unable to work, and may be affecting other teams as well (hi @RLewis)

Event Timeline

MBeat33 triaged this task as High priority.Aug 20 2020, 4:29 PM
MBeat33 renamed this task from Civi dedupe: multiple errors after 8/19 updgrade to Civi dedupe: multiple errors after 8/19 upgrade.Aug 20 2020, 4:41 PM
  1. We're also seeing different results from Quick Search versus Advanced Search. Rakhi noticed that if you search for the email address belonging to cid=468344, QS yields 5 items, AS yields 3.

Thanks @MBeat33 for creating this task. I was about to create a task about this.

I'm also seeing some issues when searching using the quick search, it seems to be showing all delete contacts for a contact we have previously merged.

Change 621590 had a related patch set uploaded (by Eileen; owner: Eileen):
[wikimedia/fundraising/crm/civicrm@master] Fix missing is_deleted in quicksearch query

https://gerrit.wikimedia.org/r/621590

Change 621590 merged by jenkins-bot:
[wikimedia/fundraising/crm/civicrm@master] Fix missing is_deleted in quicksearch query

https://gerrit.wikimedia.org/r/621590

I think all the dedupe issues are to do with the is_deleted filtering at this stage

Change 621600 had a related patch set uploaded (by Eileen; owner: Eileen):
[wikimedia/fundraising/crm/civicrm@master] Fix is_deleted missing on dedupe queries

https://gerrit.wikimedia.org/r/621600

Change 621600 merged by Eileen:
[wikimedia/fundraising/crm/civicrm@master] Fix is_deleted missing on dedupe queries

https://gerrit.wikimedia.org/r/621600