"Failed to dump Q12129 (Value must be at most 127 characters long.)" when dumping Wikidata as TTL
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	hoo
	Feb 21 2018, 2:47 PM

Description

Command line:

/usr/bin/php5 /srv/mediawiki/multiversion/MWScript.php extensions/Wikibase/repo/maintenance/dumpRdf.php --wiki wikidatawiki --shard 4 --sharding-factor 6 --batch-size 1500 --format ttl --flavor full-dump --no-cache

yields:

[failed-to-dump]: Failed to dump Q12129 (Value must be at most 127 characters long.)

This didn't show up in Monday's JSON dump, so this is probably related to one of the recent edits:
https://www.wikidata.org/w/index.php?title=Q12129&type=revision&diff=635245443&oldid=631529032

Details

	Subject	Repo	Branch	Lines +/-
	Update data-values/number to 0.10.0	mediawiki/extensions/Wikibase	master	+1 -1

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T88728 Improve Wikimedia dumping infrastructure
Open	None	T88991 improve Wikidata dumps [tracking]
Resolved	hoo	T187888 "Failed to dump Q12129 (Value must be at most 127 characters long.)" when dumping Wikidata as TTL

Event Timeline

hoo created this task.Feb 21 2018, 2:47 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 21 2018, 2:47 PM

hoo added a parent task: T88991: improve Wikidata dumps [tracking].Feb 21 2018, 2:47 PM

Maybe already fixed by https://www.wikidata.org/w/index.php?title=Q12129&type=revision&diff=635245127&oldid=635244342

The message is from the DecimalValue constructor, which is used in the QuantityValue constructor. This situation can happen when an edit is made via the API, and a quantity is submitted as a floating point number instead of a string. The code in the DecimalValue that converts floats to strings, but does this in a way so it can violate it's own limitations. Basically: The float is converted to a string with 100 decimal places. If the number before the decimal point is longer than 27 characters, the conversion fails with said error message.

This is very closely related to T155910: Erroneous digits in QuantityValue. I already prepared a fix in https://github.com/DataValues/Number/pull/115, which might solve both issues.

Change 425777 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[mediawiki/extensions/Wikibase@master] Update data-values/number to 0.10.0

https://gerrit.wikimedia.org/r/425777

gerritbot added a project: Patch-For-Review.Apr 12 2018, 9:31 AM

Change 425777 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Update data-values/number to 0.10.0

https://gerrit.wikimedia.org/r/425777