Mapping Wikidata lexicographical data within Wikisource text corpora, color-coding words by their lexical category (noun, verb, adjective, etc.) using data from Wikidata lexemes and their forms.
Words with no matching lexeme are left uncolored, making Wikidata lexicographical data gaps visible so the community can create the missing lexemes. In the long run this could also generate statistics on the lexicographical content of Wikisource, and potentially be implemented on-wiki (gadget/user script) so readers don't have to leave Wikisource.
Challenge: #7 — Stream data with Wikidata
Team: #07E Asie | Wikimania 2026 Team Challenges
Scope (Wikimania sprint)
Toolforge-hosted web tool. English Wikisource as test language; architecture should allow other languages later. On-wiki integration (hover pop-ups with lexeme details) and the statistics/analytics page are stretch goals for after Wikimania.
Workflow
- User enters an English Wikisource URL (to start and later for all Wikisource language domains)
- Tool retrieves the page text and tokenizes it into words
- Words are matched against Wikidata lexemes and forms
- Lexical categories are color-coded and displayed with a legend
- Unmatched words indicate data gaps in Wikidata
Subtasks
Overview:
- Decide on tool name
- Create GitLab repo
- Set up Toolforge tool account
- Backend: extract and tokenize text from Wikisource (API)
- Backend: retrieve lexicographical data from Wikidata
- Frontend: design UI layout (Codex)
- Frontend: implement color-coded display
- Test with sample Wikisource pages
- Documentation
- Showcase presentation


