Initiate Multilingual Readability Research (Q2)
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	MGerlach
	Oct 11 2021, 6:42 PM

Description

We have identified two different multilingual approaches to measuring readability of Wikipedia articles in T288239. For details see: https://meta.wikimedia.org/wiki/Research:Multilingual_Readability_Research#Identifying_a_set_of_candidate_approaches

During Q2 the aim is:

generate multilingual datasets with annotated labels for training and evaluation
~~exploratory analysis of datasets and implementation of baseline measures~~
explore options to add collaborators or scope out subtasks as internship projects

		Status	Subtype	Assigned	Task
		Open		MGerlach	T293028 [EPIC] Initiate Multilingual Readability Research
		Resolved		MGerlach	T293029 Initiate Multilingual Readability Research (Q2)

MGerlach removed a project: Epic.

Update week 2021-10-11:

wrote specifications for working on some subtasks as part of an internship (see this googledoc) and shared with Emily

Update week 2021-10-18:

Update week 2021-10-25:

Update week 2021-11-04:

Update week 2021-11-15:

Update 2021-12-13:

there are some administrative blockers to set up the contract. trying to figure out with intern and HR what can be done.

Update 2021-12-20:

completed pipeline to generate datasets (code available in https://github.com/martingerlach/readability )
- simple-en-wiki: large but only in English, all articles that are common in simplewiki and enwiki with their extracted text. final dataset contains 184k articles
- viki-wiki: small but multilingual data, few thousand articles that are common in vikidia and wikipedia. the english dataset contains 3200 articles.

Moving exploratory analysis to next quarter's work.