In reading up on the ligatures, I found another ligature (yod-yod-patah ײַ) that has several variants, one using a ligature from above (double-yod + patah ײַ), one with separate characters (yod + yod + patah ייַ), and a less common variant with the patah in the middle (yod + patah + yod יַי). It looks like icu_normalizer already converts the single-character form (ײַ) to one using the double-yod ligature (ײַ).

While we had planned to expand the deployment of the hiragana-to-katakana mapping from English to most other languages (though not Japanese), testing revealed that doing the mapping pre-tokenization interfered with the new ICU tokenizer's ability to parse Japanese text (on non-Japanese wikis).

In T362442#9714689, @Xaosflux wrote:

#REDIRECT [[Page#Anchor]] - going to it should still lead you to the Anchor, not to #top of that page - as is being done here.

Showing the canonical page title in the suggestion was a design decision that was made for Vector 2022, though it can be confusing when the full title isn't obviously related to the redirect title. T303013 has some potential heuristics for deciding when to show the redirect info. Feel free to chime in over there if you don't feel like your use case would be covered (the specific artificial example here would be covered).

Is this substantially different from T331389? ("...<nowiki> output in search result descriptions")

In T358495#9705136, @NMW03 wrote:

Not sure if this task fixes that, lowercasing I and dotted I (İ) returns different lowercase letters

Not getting automated tags for some reason, but this is included in 1.42.0-wmf.25, so it will be deployed soon.

Full write-up (and it's a lot!) is on MediaWiki.

The full write up is on MediaWiki.

This is done for commons and wikidata for the production clusters (eqiad and codfw) as a result of T342444. (wikidata hasn't reindexed in cloudelastic yet, but it is in the queue.)

Patch for review: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CirrusSearch/+/1011442

Swapping Assignee and Other Assignee with Erik, since he's still working on reindexing cloudelastic via the new update pipeline backfill mechanism.

Adding Erik as "other assignee" (never done that before) and increasing the points because Erik is doing more than usual for reindexing watching the cloudelastic reindex using the new update pipeline backfilling mechanism, and I've been doing more than usual gathering stats while fretting a bit over reindex speed.

@RKemper, it does look like it's deployed everywhere it should be!

I prioritized this task to have a smaller task to work on as a break after the ginormous T332337 and T356643, and to have something more interruptable to work on while T342444 is running in the background.

Moving this back to the backlog in favor of a smaller next harmonization project.

Full write up on MediaWiki.

T332337 has been comitted, so this is ready to go.

More detailed writeup (which partially overlaps the plugin docs) on MediaWiki.

Gerrit patch for the plugin (which wasn't added here automatically): https://gerrit.wikimedia.org/r/c/search/extra/+/972478

This happens across all wikis, not just cswiki.

Not sure what to do about Spark, but the Java 11 failure is arguably a feature, not a bug! The script that changed is Adlam, and Java 11 got smarter about it. Some of the other changes lsted there make me wonder what other texty corner cases are going to be affected by the upgrade.

Dev notes and details on Mediawiki.