| diego | |
| Aug 10 2023, 7:29 PM |
| F37499941: Screenshot from 2023-08-15 21-51-26.png | |
| Aug 16 2023, 2:48 AM |
| F37481691: Screenshot from 2023-08-14 20-04-30.png | |
| Aug 15 2023, 12:14 AM |
| F37481692: Screenshot from 2023-08-14 20-04-52.png | |
| Aug 15 2023, 12:14 AM |
In this task we list improvements and bugs to be solve on the Annotool.
Please report bugs here.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | diego | T333892 Develop a new generation of ML models for Wikidata | |||
| Resolved | diego | T328813 Develop a ML-based service to detect vandalism on Wikidata | |||
| Resolved | diego | T341820 Evaluate and improve the Revert Risk model for Wikidata. | |||
| Resolved | None | T344016 Improvements to Annotool | |||
| Resolved | BUG REPORT | • MunizaA | T343973 Fix relative links for Qids in Annotool | ||
| Resolved | • MunizaA | T344152 Allow users to edit annotations in Annotool | |||
| Resolved | • MunizaA | T348666 Add randomization to the revision order showed in Annotool | |||
| Resolved | None | T349739 [Annotool] Include additional information on private project exports |
In the description you list "Remove list of languages". Instead of removing the drop-down box, can it not instead be made functional, i.e. only display tasks in the chosen language? For example, I'm only proficient in English, so it is likely better for me to focus on tasks in English, rather than additionally displaying Spanish, German, etc. Being able to choose which language these training tasks are from would be useful.
That filter is not really language but wiki_db, and it's designed for evaluating revision on Wikipedia projects. I'll update the description, thanks.
It'd be great if there were an "undo" button after you evaluate a given edit, in case you misclick.
A revision of the review scope or indication of changes may be needed to better address what may lead to false annotations for hijacked Qids where the label and description have changed prior to the statement that is being compared. At face value the statement change looks like it is a simple mark as a revert, but viewing the edit history there was a series of edits which changed many statements changing the entire context of the Qid.
For instance: https://www.wikidata.org/wiki/Q117409403?oldid=1918143489
Thanks for the input. In order to make the annotations as much useful as possible for training the algorithm, it would be good to have labels that are not too specific, and can generalize as much as possible. Do you think that something like: "long-term vandalism" or "hijacked item" could be a good name for the phenomena that you are describing ?
Hi @diego
I think "hijacked item" makes more sense as the label, long-term vandalism to me sounds more like the item is frequently vandalized rather than an instance of hijacking (which could occur multiple times in the history of an item).
My previous comment was aimed at raising that there may be a need for thinking about what types of cues and information are presented to the users via the Annotool UI that would aid in detecting such a hijack and encourage investigating the Qid history instead of relying on the Name and Label presented. It may be just as simple as noting the label and/or description was changed by the same user for which the statement under review is being checked, or adding a count of the number of times the label and/or description changed since some point in time, or how long it has been since the labels field and/or how long since the description was changed before the statement being assessed was edited. A more recent edit may provide an indication of the inertia of the Qid is lower and may need for more review than if the label had been there for months or never changed.
It may be worth adding to the existing links a "Qid history" button ie to https://www.wikidata.org/w/index.php?title=Q117409403&action=history on the same lines as the label following the existing buttons like (1901202637) button in this image. as (Qid history)
@MunizaA , could we please add an action to finish a project? By finish I mean to keep the project data, but stop showing in the front-end.
@MunizaA / @KHernandez-WMF : Hi, the Due Date set for this open task passed a while ago.
Could you please either update or reset the Due Date (by clicking ), or set the status of this task to resolved in case this task is done? Thanks!
@diego the work needed to resolve this task is trivial but as far as I know, we're not running any campaigns on Annotool at the moment. If that is indeed the case, would it make sense to move this to the freezer and pick it back up once that changes? Thanks!
Moving to freezer per Muniza's comment above. If that changes, please bring it back to Research-->Backlog lane for prioritization.