Wikidata has a lot of references. It'd be great to have tools to allow checking if those references actually say what we claim and flag problematic references.
The work in T156389 might be relevant.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T90870 selfcontained projects around Wikidata (tracking) | |||
| Open | None | T90881 Framework for checking sources on Wikidata (Does the source actually say what we claim it says?) |
Event Timeline
Comment Actions
@maiarocg: Hi and welcome! You claimed this task a while ago. How is it going? Do you need any help with anything?
Comment Actions
Hi all
This problem is called Natural Language Inference (NLI) also known as textual entitlement . It is a super hot problem now in the NLP community, but imho research is still far away from producing usable tools in the Wikipedia context. This also requires a lot of computational resources (GPUs) to train.
Anyhow, I'm exploring if would be possible to create a usable API where you could send a claim and a document and the API will tell the relation between those pieces (confirm, reject, no information). I think the algorithm won't work well with subtle issues (eg. the references is talking about the main topic of the item, but does not content the specific information about the claim), but could be able to catch if the document (reference) is completely unrelated.
I'll keep you updated.
Comment Actions
Removing task assignee due to inactivity, as this open task has been assigned for more than two years. See the email sent to the task assignee on February 06th 2022 (and T295729).
Please assign this task to yourself again if you still realistically [plan to] work on this task - it would be welcome.
If this task has been resolved in the meantime, or should not be worked on ("declined"), please update its task status via "Add Action… 🡒 Change Status".
Also see https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for tips how to best manage your individual work in Phabricator.
Comment Actions
I am still working on this task as part of my PhD. I am now in the experimentation phase. I will update this ticket once that is finished and the first results come.
Comment Actions
@maiarocg: Removing task assignee as this open task has been assigned for more than two years - see the email sent to all task assignees on 2024-04-15.
Please assign this task to yourself again if you still realistically [plan to] work on this task - it would be welcome! :)
If this task has been resolved in the meantime, or should not be worked on by anybody ("declined"), please update its task status via "Add Action… 🡒 Change Status".
Also see https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for tips how to best manage your individual work in Phabricator. Thanks!