Reported upstream: https://github.com/zotero/translators/issues/3190

It normally should do that, yes.

Deployed the pmid only fix, but Pubmed central seems to be working as well. They must have unblocked us before I even deployed? Sort of resolved but I want to fix pmc central and book urls as well.

I agree this would be helpful, but it requires us to pick a citation template since we don't actually have any way of deciding one in the absence of the itemType field from the returned metadata.

Kind of resolved (waiting for deploy) but the PR I did only prevents the translator from failing by just skipping the author which is not ideal, so leaving this open for now. The RDF produced by wikidata with the redirect is weird as well as it duplicates authors that aren't even affected, and that went away when the redirect was removed - might also be an upstream bug with the rdf from wikidata?

In T127354#9145039, @Dnshitobu wrote:

"Website" -> Wɛbesite

"Book" -> Gɔŋɔ

"Newspaper article" -> Lasebaarɛ gɔŋɔ

"Journal paper" (as in a scientific journal article or paper)-> Alagumgube gɔŋɔ

"Other work" (any other work to be cited other than the above options) -> Tuuma asi'a

In T127354#8921833, @Dnshitobu wrote:

In T127354#8890520, @Mvolz wrote:

In T127354#8887939, @Dnshitobu wrote:

Currently, we still no manual citation with no automatic citation, we would love to have the citation options of the Dagbani Wikipedia (dag.wikipedia.org)

In T127354#8887853, @Mvolz wrote:

In T127354#8884767, @Dnshitobu wrote:

Hello,
I wish to request support with setting up citations in the Gurene Wikipedia. (gur.wikipedia.org).

In T127354#8884663, @Shahadusadik wrote:

Please enable citoid at the Gurene Wikipedia. gur.wikipedia.org

For this we need to know what citation templates gur wiki uses.

I had a look to see what templates are used there, is this the only one? https://gur.wikipedia.org/wiki/T%C9%9Bmpileti:Cite_web

I note there that historically there was a different template for papers Tɛmpileti:Tlf but this seems to have been deleted? Are there any templates for academic papers or books that I haven't found?

Yes. So, the automatic citation feature depends on what templates the community uses for manual citations.

I notice dag wiki has for example Cite news, but gur has at some point merged the two... in order to set up things we would either need to use only Cite web, or if the community agrees they want it exactly like dag wiki we could import the other templates (it looks like they just imported the ones from en wiki mostly).

Thanks for the efforts. We would love to have the cite web, cite book, cite news and all the other templates that allows for automatic bibliographic citation for references. We look forward to the deployment procedure or processes.

In T343151#9110408, @ThurnerRupert wrote:

Would it be possible that ve does it xlient aide xoming feim my browser?

When I try as input the doi with the Automatic tab, it fills in the access date correctly and uses Vorlage:Litartur. It also works for Internetquelle citations.

Issue reported upstream: https://github.com/zotero/translators/issues/3108

In T344220#9101462, @Mvolz wrote:

In T344220#9095412, @Chlod wrote:

Looks like an upstream issue; attempting to save x using Zotero causes an error. Something related to the author fields. Looking into this...

Yup, get the error:

(1)(+0000000): Error: cleanAuthor: author must be a string

Error: cleanAuthor: author must be a string
    at Zotero.Utilities.Translate.cleanAuthor (/home/marielle/code/mediawiki/srv/zotero/modules/utilities/utilities.js:173:10)
    at Function.cleanAuthor (/home/marielle/code/mediawiki/srv/zotero/src/translation/sandboxManager.js:96:17)
    at eval (eval at <anonymous> (/home/marielle/code/mediawiki/srv/zotero/src/translation/sandboxManager.js:70:4), <anonymous>:259:26)
    at /home/marielle/code/mediawiki/srv/zotero/modules/translate/src/utilities_translate.js:414:5
    at processTicksAndRejections (internal/process/task_queues.js:95:5)

In T344220#9095412, @Chlod wrote:

Looks like an upstream issue; attempting to save x using Zotero causes an error. Something related to the author fields. Looking into this...

In T118773#9083122, @Mvolz wrote:

In T118773#9000769, @Framawiki wrote:

This is still happening daily with Author field containing facebook link, Ie https://fr.wikipedia.org/w/index.php?title=Lekima_Tagitagivalu&diff=prev&oldid=205847137 because <meta property="article:author" content="https://www.facebook.com/ActuRugby">.
I've made hundred of edits to remove these errors on frwiki: https://fr.wikipedia.org/w/index.php?title=Sp%C3%A9cial:Contributions/Framawiki&target=Framawiki&offset=20230706113753
At least Citoid should avoid using fields that are url.

Yeah, wow, that's really annoying.

This seems to have been introduced when we updated the Zotero translators; It's not supposed to happen, though, so that's a bug.

In T118773#9000769, @Framawiki wrote:

This is still happening daily with Author field containing facebook link, Ie https://fr.wikipedia.org/w/index.php?title=Lekima_Tagitagivalu&diff=prev&oldid=205847137 because <meta property="article:author" content="https://www.facebook.com/ActuRugby">.
I've made hundred of edits to remove these errors on frwiki: https://fr.wikipedia.org/w/index.php?title=Sp%C3%A9cial:Contributions/Framawiki&target=Framawiki&offset=20230706113753
At least Citoid should avoid using fields that are url.

At present, citoid wraps everything in a ref tag, which wikiquote doesn't use, so enabling it wouldn't be useful to enable there. And they haven't enabled VE on en wikiquote, anyway. Though you can enable the wikitext 2020 editor in preferences which in theory one could use it with.

Now deployed, yay! Thank you!

I tried all of the URLs/DOIs supplied on en wiki and they all work for me in chromium, and also from the api. (You can check the api independent browser / config here: https://en.wikipedia.org/api/rest_v1/#/Citation/getCitation)

Tagging in @Esanders as he might have a better sense of how these functions are supposed to be used and/or if there's a better alternative.

In T315771#8632084, @thiemowmde wrote:

I just had a quick look. There are about 10 lines of non-boilerplate PHP code in this extension. All it effectively does is conditionally loading JavaScript modules and configuration. To be honest I think there is nothing that would benefit from having PHPUnit test coverage.

Declined as no longer relevant due to T336297

Closing as we're not longer using this api.

In T336298#8890900, @Nemo_bis wrote:

I presume that Open Library is not as comprehensive (it's the same as any other downstream collection like Google Books, it doesn't contain all possible ISBNs).

Not a safe assumption. I don't know what you mean by "downstream" or "all possible", but OpenLibrary attempts to import all known ISBN codes with sufficient metadata. Some of their sources can be seen at:

• https://github.com/internetarchive/openlibrary/blob/master/openlibrary/templates/history/sources.html
• https://archive.org/details/ol_data

ISBNdb is more comprehensive, but their licensing is less clear.

I'm not sure how IA compares to LoC in terms of coverage?

LoC dumps get imported somewhat regularly, I'm not sure about updates between dump releases. It's possible to inspect the dumps to compare: https://openlibrary.org/developers/dumps

So I would second using Zotero's ISBN endpoint in Citoid. The Internet Archive cannot be better than that because the national libraries' catalogues are the reference for metadata of any book in print.

Yes and no. Zotero is great and we should use it wherever possible, but it's impractical to run it through hundreds of targets. So it would be far easier to target a meta-catalogue.

Not all national libraries are tasked with cataloguing the entire national book production, and those who do tend to be more active in the open data field, which means their data is more likely to be in OpenLibrary.

K10plus is amazing but it probably skews towards books published in USA/Europe. OpenLibrary can be a good default to cover anything else which we don't know where to search.

https://inventaire.io/add/scan also has this available for desktop using the webcam... maybe worth considering?

In T127354#8887939, @Dnshitobu wrote:

Currently, we still no manual citation with no automatic citation, we would love to have the citation options of the Dagbani Wikipedia (dag.wikipedia.org)

In T127354#8887853, @Mvolz wrote:

In T127354#8884767, @Dnshitobu wrote:

Hello,
I wish to request support with setting up citations in the Gurene Wikipedia. (gur.wikipedia.org).

In T127354#8884663, @Shahadusadik wrote:

Please enable citoid at the Gurene Wikipedia. gur.wikipedia.org

For this we need to know what citation templates gur wiki uses.

I had a look to see what templates are used there, is this the only one? https://gur.wikipedia.org/wiki/T%C9%9Bmpileti:Cite_web

I note there that historically there was a different template for papers Tɛmpileti:Tlf but this seems to have been deleted? Are there any templates for academic papers or books that I haven't found?

Oh, also, we should probably have a model for which roles we require 2FA to be set up in order to get the role. Thoughts? Developer and above I'd say?

In T336807#8883317, @dancy wrote:

In T336807#8882990, @Mvolz wrote:

One thing I wanted to flag up is that main branches can be protected so that only developer can merge, or either developer + maintainers can merge, or no one can merge.

To me it seems to me that people who have +2 on repos in gerrit should get the "maintainer" role, and then other people have the developer role, and we protect main branches such that only maintainers, not developers+maintainers have it?

That sounds right to me.

In T127354#8884767, @Dnshitobu wrote:

Hello,
I wish to request support with setting up citations in the Gurene Wikipedia. (gur.wikipedia.org).

One thing I wanted to flag up is that main branches can be protected so that only developer can merge, or either developer + maintainers can merge, or no one can merge.

Supplanted by T214802

In T336297#8867850, @Nux wrote:

In T336297#8859823, @Mvolz wrote:

In T336297#8846443, @Nux wrote:

Did you consider using LoC or some other national library?

Most if not all big libraries should support OAI-PMH. OAI can be used as a dump (kind of) to get all book descriptions and keep them on some Wikimedia server.

Most big libraries have some API which you could use directly to search for ISBN. Many probably use Z39.50 which is not very friendly, but doable for ISBN searches. Polish national library (BN) also has a custom API that support JSON, XML and MARC (but it is a custom API, so probably better for a local tool or gadget then a global search service).

Thanks for your suggestion! For the time being we have have enabled Zotero's ISBN endpoint internally which primarily uses Library of Congress (T336727)

With Zotero it would be possible to support other national libraries in addition by contributing a translator for them here: https://github.com/zotero/translators

Added support for the Polish National Library (BN):
https://github.com/zotero/translators/pull/3036

Would be great if you could add that for Wikipedia. LoC have some foreign records, but Wikipedia user reported that e.g. ISBN 8301136545 is missing (available in BN).

In T336298#8849499, @EpicPupper wrote:

In T336298#8846535, @DeirgeDel wrote:

Stupid question. Is the Open Library API https://openlibrary.org/dev/docs/api/books a usable alternative? In particular ISBN via the .json format?

I presume that Open Library is not as comprehensive (it's the same as any other downstream collection like Google Books, it doesn't contain all possible ISBNs).

In T336297#8846443, @Nux wrote:

Did you consider using LoC or some other national library?

Most if not all big libraries should support OAI-PMH. OAI can be used as a dump (kind of) to get all book descriptions and keep them on some Wikimedia server.

Most big libraries have some API which you could use directly to search for ISBN. Many probably use Z39.50 which is not very friendly, but doable for ISBN searches. Polish national library (BN) also has a custom API that support JSON, XML and MARC (but it is a custom API, so probably better for a local tool or gadget then a global search service).

Thank you so much! There's now a gitlab repo in prod! 🎉

Hmm, I also can't write to the target branch (master, currently) because it's protected.

That was almost good enough, but only being a developer means I don't have access to the settings tab, which means I can't set the default branch to "main" instead of master after I imported it, i.e. here: https://gitlab.wikimedia.org/repos/mediawiki/services/zotero-translators

Sorry, one more thing: I was trying to preserve the structure of the original url, which is nested further under services:

In T336578#8853306, @brennen wrote:

And the "pick a group or namespace" option doesn't seem to be anywhere on that page... permissions issue with my account maybe? (Do I need to be an owner, maybe, not just a developer?)

I enabled project creation for "Developers + Maintainers" for the moment - try now?

Sorry to re-open - it turns out I need this rather urgently (sorry) or, alternatively, someone to un-archive the old respository on gerrit: https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/zotero/translators,general

In T336578#8848571, @brennen wrote:

Granted access there - keep in mind it's early days on that namespace and things might get shuffled around a bit!

Thanks! I also need to move a repository into mediawiki/services ... I've requested permissions via the button to access the services group, is that all I need to do?