Page MenuHomePhabricator
Create Task
Maniphest T336801

Multilingual library for extracting template citations from wikicode
Open, Needs TriagePublic
Actions

Description

  • Title of the proposal: Multilingual library for extracting (automatic) citations from wikicode
  • Description: Retrieving citations from Wikipedia articles is a challenging task since Wikipedia API does not provide citations directly. In consequence, many large-scale studies of references in Wikipedia develop their own parsers (Kaffee & Elsahar, 2021; Singh et al., 2020 ; Lewoniewski et al. 2017). The usual approach is to parse the wikitext but the diversity in citation template names and parameter names between languages challenges the use of one parser for all Wikipedias.
  • Username for contact: @Nidiah
  • Language of the team (English, Arabic, etc.): TBD
  • Prerequisites: Some knowledge about the format of references and citation templates in Wikipedia.
  • Any other details to share?:
  • Interested? Add your username below:

Event Timeline

Nidiah created this task.May 16 2023, 6:28 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 16 2023, 6:28 PM
Pablo subscribed.May 16 2023, 7:05 PM
Nidiah moved this task from Backlog to Hacking projects on the Wikimedia-Hackathon-2023 board.May 16 2023, 9:46 PM
diegodlh added subscribers: Harej, diegodlh.May 17 2023, 9:08 AM

@Pablo mentioned the tool https://github.com/internetarchive/iare. A couple months ago there was https://internetarchive.github.io/ware/, which seemed to be a frontend using IARE on the background. However, the site is down now, and the repository (https://github.com/internetarchive/ware) redirects to the IARE repository. Maybe @Harej can provide further information?

Regarding the title of the task, do you think it would be better to change it to "template citations" instead of "automatic citations"? Once the citations has been generated automatically via Citoid (that's what I understood with "automatic citations"; but maybe I got it wrong), we can't know if the citation has been introduced automatically or manually. But based on the description of the task, it appears to me that you are referring to citations introduced as citation templates, instead of plain text. Did I get that correctly?

Nidiah added a comment.May 17 2023, 2:44 PM

Thank you for your comments, I'll change the title

Nidiah renamed this task from Multilingual library for extracting (automatic) citations from wikicode to Multilingual library for extracting template citations from wikicode.May 17 2023, 2:44 PM
diegodlh added a comment.May 18 2023, 9:47 PM

Also potentially related: https://wikicitations.wikibase.cloud/wiki/Main_Page

Vahurzpu subscribed.Jun 4 2023, 5:46 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits