@Nicolas_Raoul : This task should involve filling out the samples at https://github.com/nicolas-raoul/apps-android-commons/wiki/Fuzzy-category-search , right? 10 samples again maybe? As for the APIs, shall I start by testing the ones suggested here - http://opendata.stackexchange.com/questions/6151/fuzzy-search-of-mediawiki-commons-categories/6413#6413 ?

Yes, use the "Sample generation methodology" to generate 5 more samples.

I haven't tried the stackexchange answer but that would be a first method
(Method A?) to try indeed :-)

@Nicolas_Raoul Okay, will do, thanks. :) The stackexchange answer describes two separate methods I think - even though both use MediaWiki API, one uses action=query and the other uses action=opensearch. AFAIK I don't think you can run two actions in one API call.

Ah OK, we have methods A and B then :-)

@Nicolas_Raoul - I've filled up the GitHub wiki, does it look okay? '

How do you think we should compare the results of the various methods? I figure I'll search for each 'guessed category' string using the APIs and report how many of the 'actual categories' it found?

The procedure says "just looking at the image and image name" so for image 6 for instance "road of Chinawal-Savkheda" could be another guess.

@Nicolas_Raoul - Oh, right, thanks. :) I did look at the image name for most of them, but for some reason I missed it on that sample.

Yeah, the others are great!

So indeed the next step is to evaluate each method and score it.

@Nicolas_Raoul I've filled in the test results for Sample 1 and 4, is that what you had in mind for the evaluation?

Yes good!