Maniphest T103238

Add crossref metadata request to lib/Scraper.js
Closed, ResolvedPublic8 Estimated Story Points
Actions

Assigned To

Authored By

	Mvolz
	Jun 20 2015, 6:30 PM

Tags

Referenced Files

None

Subscribers

Description

If a DOI is in the initial citation, use crossref to request additional metadata.

Sample query: http://search.crossref.org/dois?q=10.5555%2F12345678

Details

	Subject	Repo	Branch	Lines +/-
	Add crossref data to scraper	mediawiki/services/citoid	master	+821 -113

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Mvolz	T94209 Results of a test with 10 random DOIs from en.wiki on the Beta site
		Resolved		Mvolz	T103238 Add crossref metadata request to lib/Scraper.js
		Resolved		Mvolz	T95295 Create a cleaner import and export of natively scraped and zotero scraped citations
		Resolved		Mvolz	T75993 Promisify Citoid and base it on service-template-node / service-runner
		Resolved		Mvolz	T96363 Promisify html-metadata
		Resolved		Mvolz	T104174 Add COinS scraping to html-metadata

Event Timeline

Mvolz created this task.Jun 20 2015, 6:30 PM

Mvolz raised the priority of this task from to Needs Triage.

Mvolz updated the task description. (Show Details)

Mvolz added a project: Citoid.

Mvolz moved this task to IO Tasks on the Citoid board.

Mvolz subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 20 2015, 6:30 PM

Mvolz added a subtask: T95295: Create a cleaner import and export of natively scraped and zotero scraped citations.Jun 20 2015, 6:31 PM

Mvolz triaged this task as High priority.Jun 20 2015, 6:36 PM

Mvolz set Security to None.

• Elitre subscribed.Jun 21 2015, 5:03 AM

Mvolz added a parent task: T94209: Results of a test with 10 random DOIs from en.wiki on the Beta site.Jun 22 2015, 10:01 AM

Mvolz mentioned this in T95434: Ensure DOI, PMID, and PMCID are in the resultant citation when they're the requested format.Jun 25 2015, 1:33 AM

Mvolz moved this task from IO Tasks to Service: Scraper & Validation on the Citoid board.Jun 25 2015, 2:14 AM

Mvolz updated the task description. (Show Details)Jun 29 2015, 10:05 AM

Mvolz added a subtask: T104174: Add COinS scraping to html-metadata.

Mvolz claimed this task.Jul 1 2015, 1:39 PM

Change 222601 had a related patch set uploaded (by Mvolz):
[WIP] Add crossref data to scraper

https://gerrit.wikimedia.org/r/222601

gerritbot added a project: Patch-For-Review.Jul 3 2015, 2:09 PM

Mvolz closed subtask T104174: Add COinS scraping to html-metadata as Resolved.Jul 12 2015, 10:38 AM

Mvolz reopened this task as Open.Jul 12 2015, 7:09 PM

Mvolz closed this task as a duplicate of T105645: Better support for doi's from aanda.org.

Mvolz merged tasks: T105646: Better support for doi's from thieme-connect.de, T105645: Better support for doi's from aanda.org.

Mvolz added a subscriber: Josve05a.

Change 222601 merged by Mobrovac:
Add crossref data to scraper

https://gerrit.wikimedia.org/r/222601

• mobrovac mentioned this in rGCIT5aeb0fc83afc: Add crossref data to scraper.Jul 16 2015, 10:06 AM

• mobrovac moved this task from Service: Scraper & Validation to IO Tasks on the Citoid board.Jul 16 2015, 10:06 AM

• mobrovac moved this task from IO Tasks to Waiting on Deploy on the Citoid board.

• mobrovac closed subtask T95295: Create a cleaner import and export of natively scraped and zotero scraped citations as Resolved.Jul 16 2015, 11:23 AM

Deployed, resolving.

• mobrovac removed a project: Patch-For-Review.Jul 16 2015, 11:27 AM

• mobrovac removed a subscriber: gerritbot.

Jdforrester-WMF added a project: VisualEditor 2015/16 Q1 blockers.Jul 16 2015, 1:36 PM

Jdforrester-WMF edited a custom field.

Jdforrester-WMF moved this task from Nominated to Done on the VisualEditor 2015/16 Q1 blockers board.

Jdforrester-WMF added a project: VisualEditor.Jul 16 2015, 3:24 PM

Jdforrester-WMF moved this task from To Triage to TR1: Releases on the VisualEditor board.Jul 16 2015, 3:25 PM

Josve05a mentioned this in T106201: STICKY: Report failing DOIs or URLs here..Jul 18 2015, 1:56 AM

Jdforrester-WMF removed a project: VisualEditor 2015/16 Q1 blockers.Jul 21 2015, 6:29 PM