Hello @Harej This is something I'll like to work on.

Awesome! Welcome! Are familiar with all of the interesting variants of Wiki markup that might imply an image? I think listing out all of the variants is a good place to start

I can do some research on that. Thanks for the swift reply @Halfak I'll get back to you.

If you get on IRC, join us in #wikimedia-ai on freenode. My team hangs out there while we work.

It looks like we define image links here: https://github.com/wikimedia/articlequality/blob/master/articlequality/feature_lists/enwiki.py#L64

I think we'll want to develop some strategy for processing <gallery> tags and anything else you find. That will probably need to go in our base framework somewhere around here: https://github.com/wikimedia/revscoring/blob/master/revscoring/features/wikitext/datasources/parsed.py#L14

We use mwparserfromhell (docs). I couldn't find an obvious way it handles <gallery> at a glance.

I saw this https://en.wikipedia.org/wiki/Wikipedia:Extended_image_syntax I think it has all of the extended Wiki markups for images.

From a quick scan of the page, it looks like there are two syntaxes:

• [[File:Something.jpg|...]]
• <gallery> ... </gallery>

From the notes that @Ragesoss gave us, we'll also want to capture images that appear in infoboxes. This can get interesting. Here's a chunk of markup from Accession of Albania to the European Union:

{{Infobox EU accession bid
| logo                =  
| status              = Candidate
| nation              = Albania
| national_denonym    = Albanian
| map                 = European Union Albania Locator.svg
...

We probably want to look for specific parameters of infoboxes and accept a set of file extensions.

Parameters:

• "image", "map", "file", etc.

Extensions:

• "jpg", "png", "svg", etc.

Great. It's all coming together in my head now. How do I get to test my code changes though, to ensure that they work. I'm about to assign myself this task and commence.

I'd add tests here: https://github.com/wikimedia/articlequality/blob/master/articlequality/feature_lists/tests/test_enwiki.py

I think you'll be able to get gallery tags by scanning and processing: revscoring.features.wikitext.revision.datasources.tags

Oh. I think "test" is the wrong word here. I meant "run". So how do I run the code and see my changes in action?

Here is a great reference :)

https://github.com/wikimedia/revscoring/blob/master/ipython/feature_engineering.ipynb

@Halfak I'll like to assign myself this task. Can I go ahead?

Hello @Halfak I think this task requires PRs on the revscoring and articlequality repos.

I just opened one for the revscoring repo: https://github.com/wikimedia/revscoring/pull/472

I rebuilt the models. See the result in this PR: https://github.com/wikimedia/articlequality/pull/104

It doesn't look like we're seeing any meaningful performance improvement, BUT I think this is still valuable because people use the features that ORES extracts in their own analysis.

I think its valuable too. I hope the performance didn't drop either?

No drop. I think it's good to merge.

@Ragesoss, any thoughts as the original filer?

Lovely!