Add option for Munger to sanitize data to strictly match RDF standards
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	Smalyshev
	May 18 2019, 5:13 PM

Description

Some URLs in RDF data from Wikidata contain invalid Unicode. This works with Blazegraph, but other tools are less permissive. So, there should be a way for Munger to ensure that IRIs generated by it are conformant to standards, in particular, be in NFKC form. Example error:

[line: 818877, col: 10] Bad IRI: <http://docs.sevsovet.com.ua/index.php?option=com_k2&view=item&id=312:№-3657-от-160812г-о-реализации-положений-закона-украины-об-основах-государственной-языковой-политики-в-городе-севастополе> Code: 47/NOT_NFKC in QUERY: The IRI is not in Unicode Normal Form KC.
[line: 818877, col: 10] Bad IRI: <http://docs.sevsovet.com.ua/index.php?option=com_k2&view=item&id=312:№-3657-от-160812г-о-реализации-положений-закона-украины-об-основах-государственной-языковой-политики-в-городе-севастополе> Code: 56/COMPATIBILITY_CHARACTER in QUERY: Bad character

Event Timeline

Smalyshev created this task.May 18 2019, 5:13 PM

Restricted Application added a project: Wikidata. · View Herald TranscriptMay 18 2019, 5:13 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

We may also want for it to sanitize non-standard dates and other things that third-party solutions may find wrong, so that we'd be able to generate RDF that is acceptable to any tool.

Smalyshev moved this task from Incoming to Current work on the Wikidata-Query-Service board.Jun 4 2019, 7:06 AM

Smalyshev triaged this task as Medium priority.Jun 11 2019, 8:58 PM

Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint.

Smalyshev moved this task from Backlog to In progress on the Discovery-Wikidata-Query-Service-Sprint board.Jun 12 2019, 4:57 AM

Smalyshev renamed this task from Add option for Munger to sanitize IRIs to Add option for Munger to sanitize data to strictly match RDF standards.Jun 14 2019, 5:21 PM

Smalyshev removed a project: Discovery-Wikidata-Query-Service-Sprint.Jun 28 2019, 12:33 AM

Smalyshev updated the task description. (Show Details)

Smalyshev moved this task from Current work to Incoming on the Wikidata-Query-Service board.Jul 10 2019, 9:57 PM

Gehel moved this task from Incoming to Small Tasks on the Wikidata-Query-Service board.Feb 13 2020, 2:12 PM

Gehel closed this task as Declined.Sep 2 2021, 1:38 PM

Add option for Munger to sanitize data to strictly match RDF standardsClosed, DeclinedPublicActions

Description

Event Timeline

Add option for Munger to sanitize data to strictly match RDF standards
Closed, DeclinedPublic
Actions