@Lydia_Pintscher @daniel do we want to goat ahead with this?

Good to go ahead if it was requested by the editors.

Agreed with @Lydia_Pintscher

Yes it was confirmed by the community, we can go

Okay, I need to look into the maintenance scripts and see if I can alter them to avoid having to rebuild the entire table when we make this change to the normalization!
This will probably mean making the scripts run only for titles that contain a select character.

For reference, in production this is how many titles contain the characters in question.

mysql:wikiadmin@10.64.16.18 [cognate_wiktionary]> select count(*) from cognate_titles where cgti_raw LIKE '%ʼ%';
+----------+
| count(*) |
+----------+
|     6322 |
+----------+
1 row in set (5.88 sec)

mysql:wikiadmin@10.64.16.18 [cognate_wiktionary]> select count(*) from cognate_titles where cgti_raw LIKE '%\'%';
+----------+
| count(*) |
+----------+
|   102570 |
+----------+
1 row in set (6.01 sec)

The patch for this ticket can be found @ https://gerrit.wikimedia.org/r/#/c/368205/
This has just been merged.
It will be deployed with the train next week and once deployed the maint script will have to be run. A dry-run version can be seen below.

mwscript extensions/Cognate/maintenance/recalculateCognateNormalizedHashes.php --wiki enwiktionary --dry-run

This script only has to be run once, for all wiktionaries, as the table being touched is shared by all wiktionaries.
I will run the maint script at some point after the train and confirm everything is working before closing the ticket

On beta:

addshore@deployment-tin:~$ mwscript extensions/Cognate/maintenance/recalculateCognateNormalizedHashes.php --wiki enwiktionary --batch-size 10000
Started processing...
Getting batch starting from -9208669415219601405
Calculating new hashes..
Performing 1 updates
1303 rows processed, 1 rows upserted
Getting batch starting from 9213466911507511073
Calculating new hashes..
Performing 0 updates
0 rows processed, 0 rows upserted
1 hashes recalculated
Done!

https://en.wiktionary.beta.wmflabs.org/wiki/c%CA%BCh & https://de.wiktionary.beta.wmflabs.org/wiki/c'h are now linked as expected.

Change 374956 had a related patch set uploaded (by Addshore; owner: Addshore):
[mediawiki/extensions/Cognate@master] Add waitForReplication to RecalculateCognateNormalizedHashes script

https://gerrit.wikimedia.org/r/374956

Change 374957 had a related patch set uploaded (by Addshore; owner: Addshore):
[mediawiki/extensions/Cognate@wmf/1.30.0-wmf.16] Add waitForReplication to RecalculateCognateNormalizedHashes script

https://gerrit.wikimedia.org/r/374957

Change 374957 merged by jenkins-bot:
[mediawiki/extensions/Cognate@wmf/1.30.0-wmf.16] Add waitForReplication to RecalculateCognateNormalizedHashes script

https://gerrit.wikimedia.org/r/374957

Mentioned in SAL (#wikimedia-operations) [2017-08-31T08:40:11Z] <addshore@tin> Synchronized php-1.30.0-wmf.16/extensions/Cognate/maintenance/recalculateCognateNormalizedHashes.php: T172987 [[gerrit:374957|Add waitForReplication to RecalculateCognateNormalizedHashes script]] (duration: 00m 47s)

Change 374956 merged by jenkins-bot:
[mediawiki/extensions/Cognate@master] Add waitForReplication to RecalculateCognateNormalizedHashes script

https://gerrit.wikimedia.org/r/374956

Mentioned in SAL (#wikimedia-operations) [2017-08-31T09:50:33Z] <addshore> addshore@terbium:~$ mwscript extensions/Cognate/maintenance/recalculateCognateNormalizedHashes.php --wiki enwiktionary --batch-size 1000000 # Should upsert 6326 rows T172987

Mentioned in SAL (#wikimedia-operations) [2017-08-31T09:57:33Z] <addshore> extensions/Cognate/maintenance/recalculateCognateNormalizedHashes.php run done, 6326 hashes recalculated, T172987