Citoid scrapes error page for Encore
Open, LowestPublic0 Estimated Story Points
Actions

Assigned To

None

Authored By

	• Halibutt
	Aug 12 2015, 12:09 AM

Description

I'm almost code-illiterate, but something seems fishy here. I was checking the new Encore OPAC system at Warsaw's National Library. It works great with Zotero: a book is correctly identified as a book, all the fields get imported correctly, it works like a charm. When I export the citation from Zotero using the native Wikipedia exporter, it looks like this:

{{Cite book| publisher = Wydawnictwo Wyższej Szkoły Przedsiębiorczości i Zarządzania im. Leona Koźmińskiego| isbn = 8389437503| last1 = Jemielniak| first1 = Dariusz| last2 = Latusek-Jurczak| first2 = Dominika| title = Zarządzanie: teoria i praktyka od podstaw: ćwiczenia| location = Warszawa| date = 2005}}

But using the very same link with Citoid returns a cite web template (or its' equivalent @ plwiki) filled with

"Exception". katalogi.bn.org.pl. Retrieved 2015-08-12.

The "Exception" links to this error page.

If I understand correctly, Citoid uses the very same translators Zotero does, so all links working in Zotero should also work in Citoid. Why aren't they?

Event Timeline

• Halibutt created this task.Aug 12 2015, 12:09 AM

• Halibutt raised the priority of this task from to Needs Triage.

• Halibutt updated the task description. (Show Details)

• Halibutt added a project: Citoid.

• Halibutt moved this task to Extension on the Citoid board.

• Halibutt subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 12 2015, 12:09 AM

• Halibutt updated the task description. (Show Details)Aug 12 2015, 12:13 AM

• Halibutt set Security to None.

Weird as it is, the very same links I checked a couple of minutes before (1, 2) now work - but they are interpreted as web pages (cite web) and not as books, even though Zotero interprets them as such correctly. The link I posted in the issue description above still does not work. I'm at a loss now...

Mvolz moved this task from Extension to Backlog on the Citoid board.Aug 12 2015, 8:44 AM

This looks like it might be the translator? https://github.com/zotero/translators/blob/master/Library%20Catalog%20(Encore).js

If so the issue is this: https://www.mediawiki.org/wiki/Citoid#Testing_for_the_translators_using_the_.22server.22_option_or_.27v.27_flag

I can look into getting it enabled on our local translator branch, see if it works.

Mvolz renamed this task from Link works in Zotero, Citoid gets lost to Enable encore translator (if it works).Aug 12 2015, 8:52 AM

Just tried it, the translator indeed does not work outside the browser. Sometimes they do but have survivable errors, in this case even when the translator is enabled, Zotero is unable to scrape the page. This is probably why the translator is not enabled for translation-server. Might have something to do with cookies. At any rate, this requires debugging/patching Zotero itself which probably will not happen anywhere in the near future.

Mvolz renamed this task from Enable encore translator (if it works) to Library Catalogue (Encore) translator does not work even when enabled.Aug 12 2015, 8:59 AM

Mvolz triaged this task as Lowest priority.

Mvolz moved this task from Backlog to Site specific issues on the Citoid board.

Thanks for letting me know. I filed a new issue at GitHub, perhaps the Zotero guys could shed some light on this problem.

EDIT/ Re-posted the issue at another repo

Changing title as we should investigate why the native scraper fails as well.

Thanks. Sadly it seems filing this at translation-server Github was a dead-end, apparently there's noone working on it. If only I paid more attention at my programming classes...

In this GitHub thread one of the guys suggested there is a workaround solution. Could anyone code-literate (Mvolz ?) take a look at the proposed solution? It seems relatively easy (as in: setting boolean value to "yes"), but is it working?
Cheers

Replied there, but no, already tried that.

Mvolz moved this task from Site specific issues to Service: Scraper & Validation on the Citoid board.Oct 28 2016, 3:11 PM

Restricted Application added a project: VisualEditor. · View Herald TranscriptOct 28 2016, 3:11 PM

Jdforrester-WMF moved this task from To Triage to External and Administrivia on the VisualEditor board.Nov 8 2016, 8:05 PM

Jdforrester-WMF set the point value for this task to 0.Feb 9 2017, 6:18 PM

Mvolz moved this task from Service: Scraper & Validation to Service on the Citoid board.Dec 11 2018, 11:30 AM

Citoid scrapes error page for EncoreOpen, LowestPublic0 Estimated Story PointsActions

Description

Event Timeline

Citoid scrapes error page for Encore
Open, LowestPublic0 Estimated Story Points
Actions