While looking into unpacking the Greek analysis chain to add a filter for zero-length tokens (see the parent task: T203117), I ran into the fact that the Greek "lowercase" filter does more than lowercasing—it also converts final sigma (ς) to regular sigma (σ) and, very importantly, removes some very common Greek diacritics (particularly tonos, but also dialytika) that are not removed by ICU normalization (which usually replaces the lowercase filter in our analysis chains).

Rather than hack together a kludge to only address the Greek "text" analysis chain, I wanted to properly address language-specific lowercasing (which occurs for Turkish and Irish, too). Everywhere that we replace "lowercase" with "icu_normalization" we are losing out on this language-specific normalization. We already created a partial work around for Greek by enabling ICU Folding for the plain field, but the Greek "lowercase" normalization should actually happen in many other fields, too.

I'll report on the testing for Turkish and Irish here and the testing of Greek (along with the rest of the Greek testing) in the parent task.