CirrusSearch: Problems on the Gujarati wikipedia that look like unicode normalization issues
Open, MediumPublic
Actions

Assigned To

None

Authored By

	• Manybubbles
	Nov 19 2013, 1:18 PM

Description

Hi Nik,

Thanks for deploying it on gu.wiki. I have been testing it so far and always found it more useful than normal search, but today I encountered an issue with this. Please see below 4 search results, 2 with cirrus search and 2 without, I think the results that I am getting with cirrus enabled are a bit unexpected. The term that I search is સૌરાષ્ટ્ર પ્રાંત

With Cirrus:
https://gu.wikipedia.org/w/index.php?search=%E0%AA%B8%E0%AB%8C%E0%AA%B0%E0%AA%BE%E0%AA%B7%E0%AB%8D%E0%AA%9F%E0%AB%8D%E0%AA%B0+%E0%AA%AA%E0%AB%8D%E0%AA%B0%E0%AA%BE%E0%AA%82%E0%AA%A4&button=&title=%E0%AA%B5%E0%AA%BF%E0%AA%B6%E0%AB%87%E0%AA%B7%3A%E0%AA%B6%E0%AB%8B%E0%AA%A7&srbackend=CirrusSearch

Without Cirrus:
https://gu.wikipedia.org/w/index.php?search=%E0%AA%B8%E0%AB%8C%E0%AA%B0%E0%AA%BE%E0%AA%B7%E0%AB%8D%E0%AA%9F%E0%AB%8D%E0%AA%B0+%E0%AA%AA%E0%AB%8D%E0%AA%B0%E0%AA%BE%E0%AA%82%E0%AA%A4&button=&title=%E0%AA%B5%E0%AA%BF%E0%AA%B6%E0%AB%87%E0%AA%B7%3A%E0%AA%B6%E0%AB%8B%E0%AA%A7

Search was for exact match with inverted comma: "સૌરાષ્ટ્ર પ્રાંત"

Without Cirrus:
https://gu.wikipedia.org/w/index.php?search=%22%E0%AA%B8%E0%AB%8C%E0%AA%B0%E0%AA%BE%E0%AA%B7%E0%AB%8D%E0%AA%9F%E0%AB%8D%E0%AA%B0+%E0%AA%AA%E0%AB%8D%E0%AA%B0%E0%AA%BE%E0%AA%82%E0%AA%A4%22&title=%E0%AA%B5%E0%AA%BF%E0%AA%B6%E0%AB%87%E0%AA%B7%3A%E0%AA%B6%E0%AB%8B%E0%AA%A7&fulltext=1

With Cirrus:
https://gu.wikipedia.org/w/index.php?search=%22%E0%AA%B8%E0%AB%8C%E0%AA%B0%E0%AA%BE%E0%AA%B7%E0%AB%8D%E0%AA%9F%E0%AB%8D%E0%AA%B0+%E0%AA%AA%E0%AB%8D%E0%AA%B0%E0%AA%BE%E0%AA%82%E0%AA%A4%22&title=%E0%AA%B5%E0%AA%BF%E0%AA%B6%E0%AB%87%E0%AA%B7%3A%E0%AA%B6%E0%AB%8B%E0%AA%A7&fulltext=1&srbackend=CirrusSearch

Version: unspecified
Severity: normal
See Also:
T41501

Details

Reference: bz57242

Related Objects

Mentioned In: T41501: Merging Unicode similar-looking characters in internal search (apostrophes, "x" and "×", etc)
Mentioned Here: T41501: Merging Unicode similar-looking characters in internal search (apostrophes, "x" and "×", etc)

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 2:23 AM

• bzimport added a project: CirrusSearch.

• bzimport set Reference to bz57242.

• bzimport added a subscriber: Unknown Object (MLST).

• Manybubbles created this task.Nov 19 2013, 1:18 PM

This took me forever to pickup but I see this:
[[સૌરાષ્ટ્ર| સૌરાષ્ટ્ર પ્રાંત]]માં
in the page source of one of the pages that lsearchd finds and cirrus doesn't. Cirrus sees the words સૌરાષ્ટ્ર પ્રાંતમાં which lsearchd sees સૌરાષ્ટ્ર પ્રાંત માં because it inserts a space after every link.

Tacsipacsi mentioned this in T41501: Merging Unicode similar-looking characters in internal search (apostrophes, "x" and "×", etc).Mar 21 2015, 8:33 PM

Tacsipacsi updated the task description. (Show Details)Mar 21 2015, 8:36 PM

Tacsipacsi set Security to None.

• Deskana unsubscribed.Mar 21 2015, 10:30 PM

Liuxinyu970226 subscribed.Apr 17 2015, 1:26 PM

• demon unsubscribed.Aug 19 2015, 4:07 PM

Restricted Application added a project: Discovery-ARCHIVED. · View Herald TranscriptAug 19 2015, 4:07 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript