Page MenuHomePhabricator
Create Task
Maniphest T195043

[Task] Implement RDF serialization for lexemes and forms
Closed, ResolvedPublic
Actions

Description

RDF serialization should be implemented in WikibaseLexeme in LexemeRdfBuilder

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Refactor entity resolution to allow more flexibilitymediawiki/extensions/Wikibasemaster+74 -46
Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and Sensesmediawiki/extensions/WikibaseLexememaster+128 -56
Allows EntityRdfBuilders to ask for other entities to be serializedmediawiki/extensions/Wikibasemaster+79 -1
Fix labels for Lexemesmediawiki/extensions/WikibaseLexememaster+2 -30
Implements RDF mapping of lexemes and forms including stubsmediawiki/extensions/WikibaseLexememaster+483 -68
Customize query in gerrit

Related Objects
Search...

Event Timeline

Tpt created this task.May 19 2018, 10:34 AM
Restricted Application added a project: Wikidata. · View Herald TranscriptMay 19 2018, 10:34 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Tpt renamed this task from [Task] Implement RDF serialization for lexemes to [Task] Implement RDF serialization for lexemes and forms.May 19 2018, 10:34 AM
Tpt added a parent task: T160259: [Story] RDF for Lexemes, Forms and Senses.
gerritbot subscribed.May 19 2018, 10:45 AM

Change 433953 had a related patch set uploaded (by Tpt; owner: Tpt):
[mediawiki/extensions/WikibaseLexeme@master] Beginning of implementation of lexemes and forms RDF serialization

https://gerrit.wikimedia.org/r/433953

gerritbot added a project: Patch-For-Review.May 19 2018, 10:45 AM
Tpt mentioned this in rEWLE5bb218b78f56: Beginning of implementation of lexemes and forms RDF serialization.May 19 2018, 10:47 AM
Tpt mentioned this in rEWLE4f164b8ae1bc: Implementation of lexemes and forms RDF serialization.May 19 2018, 12:31 PM
Lydia_Pintscher moved this task from incoming to features/bugs for next release (editor experience improvements) on the Wikidata Lexicographical data board.May 23 2018, 9:16 AM
Tpt mentioned this in rEWLEd843284c1a50: Implements RDF mapping of lexemes and forms including stubs.May 24 2018, 8:44 PM
Lydia_Pintscher triaged this task as Medium priority.May 27 2018, 5:56 PM
Tpt mentioned this in rEWLE94a64fd6560f: Implements RDF mapping of lexemes and forms including stubs.Jun 1 2018, 8:10 PM
gerritbot added a comment.Jun 11 2018, 4:08 PM

Change 433953 merged by jenkins-bot:
[mediawiki/extensions/WikibaseLexeme@master] Implements RDF mapping of lexemes and forms including stubs

https://gerrit.wikimedia.org/r/433953

ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-06-12 (1.32.0-wmf.8)).Jun 11 2018, 5:00 PM
Smalyshev subscribed.Jun 14 2018, 8:30 PM
Lucas_Werkmeister_WMDE subscribed.Jun 19 2018, 2:31 PM

Is there anything left to be done in this task? It looks to me like it might be done already :)

Tpt added a comment.Jun 19 2018, 2:50 PM

There is still to implement output of forms statements when the RDF representation of a lexeme is requested (i.e. Special:EntityData/L42.ttl) and the schema:inLanguage relation for lexemes.

Smalyshev added a comment.Jun 19 2018, 7:37 PM

While may be not strictly part of this task, has the question of dumps been covered? I.e. are lexemes supposed to be dumped together with other items, or in separate dump? Is there a task for setting that up, or it's supposed to happen automagically?

• Vvjjkkii renamed this task from [Task] Implement RDF serialization for lexemes and forms to gpcaaaaaaa.Jul 1 2018, 1:10 AM
• Vvjjkkii raised the priority of this task from Medium to High.
• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed subscribers: gerritbot, Aklapper.
CommunityTechBot renamed this task from gpcaaaaaaa to [Task] Implement RDF serialization for lexemes and forms.Jul 2 2018, 12:52 AM
CommunityTechBot lowered the priority of this task from High to Medium.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
CommunityTechBot added subscribers: gerritbot, Aklapper.
gerritbot added a comment.Aug 1 2018, 1:31 PM

Change 449718 had a related patch set uploaded (by Tpt; owner: Tpt):
[mediawiki/extensions/WikibaseLexeme@master] Implements RDF mapping of senses including stubs

https://gerrit.wikimedia.org/r/449718

Tpt mentioned this in rEWLE6d224ea24bd6: Implements RDF mapping of senses including stubs.Aug 1 2018, 1:32 PM
Tpt mentioned this in rEWLE4ea0547e79d2: Implements RDF mapping of senses including stubs.Aug 1 2018, 1:48 PM
Lydia_Pintscher subscribed.Aug 2 2018, 5:22 PM

Can we close this when the Senses support is handled in T200901? Or is there something else missing here?

Tpt added a comment.Aug 2 2018, 5:26 PM

There is still one feature missing: outputting statements on form and senses when the RDF representation of a lexeme is required (e.g. on Special:EntityData/L12.nt).

Smalyshev added a comment.Aug 2 2018, 5:30 PM

outputting statements on form and senses when the RDF representation of a lexeme is required

This would be important for WDQS integration too. Also, I understand it's still disabled on both wikidata and test.wikidata. We may want to enable it at least of test.wikidata for testing?

Tpt added a comment.Aug 2 2018, 5:31 PM

Also, I understand it's still disabled on both wikidata and test.wikidata.

It seems to be enabled now : https://www.wikidata.org/entity/L42.nt

Smalyshev added a comment.Aug 2 2018, 5:32 PM

Weird, when I try .ttl it says:

RDF export is disabled for this type of entity: lexeme.

Lydia_Pintscher moved this task from features/bugs for next release (editor experience improvements) to incoming on the Wikidata Lexicographical data board.Aug 3 2018, 8:08 AM
gerritbot added a comment.Aug 8 2018, 5:56 AM

Change 451012 had a related patch set uploaded (by Tpt; owner: Tpt):
[mediawiki/extensions/Wikibase@master] Allows EntityRdfBuilders to ask for other entities to be serialized

https://gerrit.wikimedia.org/r/451012

gerritbot added a comment.Aug 8 2018, 6:25 AM

Change 451234 had a related patch set uploaded (by Tpt; owner: Tpt):
[mediawiki/extensions/WikibaseLexeme@master] Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and Senses

https://gerrit.wikimedia.org/r/451234

Tpt mentioned this in rEWLEf8f5c3528a38: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….Aug 8 2018, 6:29 AM
gerritbot added a comment.Aug 21 2018, 12:10 AM

Change 454182 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[mediawiki/extensions/Wikibase@master] Refactor entity resolution to allow more flexibility

https://gerrit.wikimedia.org/r/454182

Smalyshev added a subtask: T201885: Lexeme RDF export has labels repeated several times.Aug 21 2018, 9:16 PM
Tpt mentioned this in T200901: [Task] Implement RDF serialization for senses.Aug 23 2018, 7:13 AM
Smalyshev mentioned this in rEWLEdcfad43e7b4f: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….Aug 24 2018, 1:05 AM
gerritbot added a comment.Aug 24 2018, 10:06 PM

Change 455252 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[mediawiki/extensions/WikibaseLexeme@master] Fix labels for Lexemes

https://gerrit.wikimedia.org/r/455252

Diffusion mentioned this in rEWLE2c870765003b: Fix labels for Lexemes.Aug 24 2018, 10:12 PM
Diffusion mentioned this in rEWLEfd09ec4dd394: Fix labels for Lexemes.
Diffusion mentioned this in rEWLEa3bc44945e1c: Fix labels for Lexemes.Aug 24 2018, 10:36 PM
Tpt mentioned this in rEWLE56c44f19fc82: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….Aug 25 2018, 7:08 PM
Tpt mentioned this in rEWLE0663db289ecd: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….Aug 30 2018, 6:06 PM
Lydia_Pintscher moved this task from incoming to features/bugs for next release (querying and searching) on the Wikidata Lexicographical data board.Sep 1 2018, 7:01 PM
gerritbot added a comment.Sep 3 2018, 11:49 AM

Change 455252 merged by jenkins-bot:
[mediawiki/extensions/WikibaseLexeme@master] Fix labels for Lexemes

https://gerrit.wikimedia.org/r/455252

ReleaseTaggerBot edited projects, added MW-1.32-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)); removed MW-1.32-notes (WMF-deploy-2018-06-12 (1.32.0-wmf.8)).Sep 3 2018, 12:00 PM
Tpt mentioned this in rEWLEba8cd39f9fb1: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….Sep 4 2018, 11:42 AM
Tpt mentioned this in rEWLE667e2b68b55f: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….Sep 4 2018, 11:47 AM
Tpt mentioned this in rEWLE0cd03f292a6d: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….
gerritbot added a comment.Sep 17 2018, 9:59 PM

Change 451012 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Allows EntityRdfBuilders to ask for other entities to be serialized

https://gerrit.wikimedia.org/r/451012

ReleaseTaggerBot edited projects, added MW-1.32-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)); removed MW-1.32-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)).Sep 17 2018, 10:00 PM
Smalyshev mentioned this in rEWLE53167be519a3: Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and….Sep 17 2018, 10:02 PM
gerritbot added a comment.Sep 17 2018, 11:31 PM

Change 451234 merged by jenkins-bot:
[mediawiki/extensions/WikibaseLexeme@master] Uses EntityMentionListener::subEntityMentioned to properly serialize Forms and Senses

https://gerrit.wikimedia.org/r/451234

Smalyshev closed this task as Resolved.Sep 20 2018, 11:35 PM
Smalyshev claimed this task.

I think this is done.

Smalyshev closed subtask T201885: Lexeme RDF export has labels repeated several times as Resolved.Sep 20 2018, 11:36 PM
gerritbot added a comment.Oct 6 2018, 4:58 AM

Change 454182 abandoned by Smalyshev:
Refactor entity resolution to allow more flexibility

Reason:
Not going this direction

https://gerrit.wikimedia.org/r/454182

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits