Reindex Japanese-language wikis to use unpacked CJK analyzer
Closed, ResolvedPublic2 Estimated Story Points
Actions

Assigned To

Authored By

	TJones
	Jan 23 2023, 9:59 PM

Description

Once parent (T326822) is deployed, need to reindex for it to take effect.

Current wiki count for Japanese: 8 wikis

Status	Assigned	Task
Open	None	T318269 Test and analyze Kuromoji Japanese language analyzer
Resolved	TJones	T326822 Unpack CJK Analyzer
Resolved	TJones	T327720 Reindex Japanese-language wikis to use unpacked CJK analyzer

TJones set the point value for this task to 2.

TJones removed TJones as the assignee of this task.

Japanese wikis are reindexed, but I need to finish up my report.

Reindexing complete.

Full write up on Mediawiki.

Highlights:

Also ran Japanese Wiktionary query sample because Wiktionary content showed a lot more effect than Wikipedia content.. but queries for both were essentially unchanged.
One Wikipedia query (out of 3K) did actually go from no results to some results because of ICU folding.
Minor stop word changes (s and t are no longer stop words) got better results for the query s-hybrid, so that's nice.
Overall, very little direct impact, but we are still paying down technical debt!

Gehel closed this task as Resolved.Feb 17 2023, 2:53 PM