⚓ T325092 Unpack Brazilian (Portuguese) Elasticsearch Analyzer

	Subject	Repo	Branch	Lines +/-
	Unpack Brazilian Portuguese Analysis Chain	mediawiki/extensions/CirrusSearch	master	+129 -5

Status	Assigned	Task
Open	None	T219550 [EPIC] Harmonize language analysis across languages
Resolved	Gehel	T272606 [EPIC] Unpack all Elasticsearch analyzers
Resolved	TJones	T325092 Unpack Brazilian (Portuguese) Elasticsearch Analyzer
Resolved	TJones	T333398 Reindex brwikimedia to use new unpacked Brazlian Portuguese analysis chain

TJones created this task.Dec 13 2022, 7:00 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 13 2022, 7:00 PM

TJones triaged this task as Medium priority.Dec 13 2022, 7:00 PM

TJones added a parent task: T272606: [EPIC] Unpack all Elasticsearch analyzers.

TJones set the point value for this task to 2.

TJones moved this task from needs triage to Language Stuff on the Discovery-Search board.

TJones mentioned this in T272606: [EPIC] Unpack all Elasticsearch analyzers.

TJones raised the priority of this task from Medium to High.Mar 6 2023, 6:26 PM

TJones edited projects, added Discovery-Search (Current work); removed Discovery-Search.Mar 16 2023, 3:32 PM

TJones moved this task from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.Mar 20 2023, 4:34 PM

TJones claimed this task.Mar 27 2023, 3:13 PM

TJones moved this task from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.

Change 903713 had a related patch set uploaded (by Tjones; author: Tjones):

[mediawiki/extensions/CirrusSearch@master] Unpack Brazilian Portuguese Analysis Chain

https://gerrit.wikimedia.org/r/903713

gerritbot added a project: Patch-For-Review.Mar 28 2023, 8:33 PM

Full write up in Mediwiki.

Nothing too exciting implicit to the analyzer, but the difference between brazilian and portuguese is surprising, but unjustified by the differences in Brazilian and European Portuguese. Worth looking into. (Will open a ticket shortly.)

In a sample from the one wiki were brazilian is currently used, there is a small increase in words being analyzed the same due to ICU folding and ICU normalization.

TJones mentioned this in T333398: Reindex brwikimedia to use new unpacked Brazlian Portuguese analysis chain.Mar 28 2023, 8:41 PM

TJones mentioned this in T333401: Investigate using a better stemmer & stopwords for Portuguese wikis.Mar 28 2023, 8:57 PM

Change 903713 merged by jenkins-bot:

[mediawiki/extensions/CirrusSearch@master] Unpack Brazilian Portuguese Analysis Chain

https://gerrit.wikimedia.org/r/903713

Maintenance_bot removed a project: Patch-For-Review.Mar 29 2023, 10:30 AM

ReleaseTaggerBot added a project: MW-1.41-notes (1.41.0-wmf.3; 2023-04-03).Mar 29 2023, 11:00 AM

TJones moved this task from In Progress to To Be Deployed on the Discovery-Search (Current work) board.Mar 29 2023, 1:36 PM

TJones moved this task from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.Apr 10 2023, 3:16 PM

Gehel closed this task as Resolved.Apr 20 2023, 7:19 PM

TJones added a subtask: T333398: Reindex brwikimedia to use new unpacked Brazlian Portuguese analysis chain.May 1 2023, 6:02 PM