Page MenuHomePhabricator

Do some data integrity digging
Open, Needs TriagePublic

Description

We have some datachecks that we don't run routinely but in conjunction with finding a contact with 2 primary emails in T199747 I ran them & got some output

  • at least one of these is a known data issue that we have a ticket about but I think others have got new causes. Also we had one contact with 2 primary emails -seems unchecked here
drush cvapi data.check

Array
(
    [is_error] => 0
    [version] => 3
    [count] => 2
    [values] => Array
        (
            [PrimaryLocation] => Array
                (
                    [email] => Array
                        (
                            [message] => 74 contact/s have at least one email but none are marked as primary
                            [example] => Array
                                (
                                    [contact] => Array
                                        (
                                            [0] => 9126
                                            [1] => 10511
                                            [2] => 20415
                                            [3] => 21737
                                            [4] => 28293
                                        )

                                )

                        )

                    [phone] => Array
                        (
                            [message] => 4389 contact/s have at least one phone but none are marked as primary
                            [example] => Array
                                (
                                    [contact] => Array
                                        (
                                            [0] => 2442
                                            [1] => 2936
                                            [2] => 4368
                                            [3] => 4525
                                            [4] => 5780
                                        )

                                )

                        )

                    [address] => Array
                        (
                            [message] => 1254 contact/s have at least one address but none are marked as primary
                            [example] => Array
                                (
                                    [contact] => Array
                                        (
                                            [0] => 570
                                            [1] => 574
                                            [2] => 868
                                            [3] => 1806
                                            [4] => 2518
                                        )

                                )

                        )

                )

            [DuplicateLocation] => Array
                (
                    [email] => Array
                        (
                            [message] => 10881 contact/s have multiple email with the same location type
                            [example] => Array
                                (
                                    [contact] => Array
                                        (
                                            [0] => 377
                                            [1] => 2983
                                            [2] => 6041
                                            [3] => 8096
                                            [4] => 8265
                                        )

                                )

                        )

                    [phone] => Array
                        (
                            [message] => 125 contact/s have multiple phone with the same location type
                            [example] => Array
                                (
                                    [contact] => Array
                                        (
                                            [0] => 11
                                            [1] => 12
                                            [2] => 29
                                            [3] => 30
                                            [4] => 31
                                        )

                                )

                        )

                    [address] => Array
                        (
                            [message] => 63981 contact/s have multiple address with the same location type
                            [example] => Array
                                (
                                    [contact] => Array
                                        (
                                            [0] => 206
                                            [1] => 247
                                            [2] => 312
                                            [3] => 319
                                            [4] => 321
                                        )

                                )

                        )

                )

        )

)

Event Timeline

Hi all - looks like IBM hit another snag during the civi export/import. The database upload is showing the same file being uploaded for both the contact source and unsubscribes since 10/21 (file name: DatabaseUpdate-20181221081750.csv and Unsubscribes-20181221081750.csv). Please let me know if any further info is needed on my end.

@MNoorWMF OK, I got rid of a few more duplicate primary email addresses and was able to re-do the export for today. There seems to be a problem with manual merges that keeps causing this, so I'll look at the most recent changes to the merge code.