Page MenuHomePhabricator

osmUpdate throws exceptions importing OSM Wikibase
Closed, ResolvedPublic

Description

Running runUpdate with an empty Blazegraph causes exceptions (of several types) when processing OSM wikibase data, e.g. Item:Q6. I also get similar errors when running without the -s flag. Quiet possibly this is a configuration problem of sorts, but not sure where to even begin looking. Thanks!

runUpdate.sh \
  -h http://blazegraph:9999 -s -- \
  --wikibaseUrl https://wiki.openstreetmap.org
  --conceptUri https://wiki.openstreetmap.org
  --entityNamespaces 120,122
04:49:24.613 [update 4] INFO  o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [http://wiki.openstreetmap.org/entity/statement/Q6-1a82f62d-442d-ab74-2558-7a443ac85074, http://wiki.openstreetmap.org/entity/Q6] while processing https://wiki.openstreetmap.org/entity/Q6.  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/

04:49:24.827 [update 6] INFO  o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [http://wiki.openstreetmap.org/entity/statement/Q6634-39B6AE97-4C15-4F5B-85C8-B6402C822C66, http://wiki.openstreetmap.org/entity/statement/Q6634-36307B0D-54B9-4F4F-844B-A667D13750D4, http://wiki.openstreetmap.org/entity/statement/Q6634-7B0757EC-DC43-4B2A-8181-0F57F3FF302B, http://wiki.openstreetmap.org/entity/Q6634, http://wiki.openstreetmap.org/entity/statement/Q6634-D75BE75A-75B4-4438-8CB4-5D75B6E2A16D, http://wiki.openstreetmap.org/entity/statement/Q6634-510F87B0-36B8-4C9A-BADB-6B75BC710E03, http://wiki.openstreetmap.org/entity/statement/Q6634-D62ACE81-72AD-4FD7-AD63-AB69A616DC48, http://wiki.openstreetmap.org/entity/statement/Q6634-F3FACF0A-89EB-49CF-ADC8-EB5A79F6673E, http://wiki.openstreetmap.org/entity/statement/Q6634-209245C4-D566-40C5-BCD1-BED1AD280331, http://wiki.openstreetmap.org/entity/statement/Q6634-81B27F8E-80EF-473C-87C7-4095611126F1] while processing https://wiki.openstreetmap.org/entity/Q6634.  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/

04:49:24.844 [update 1] INFO  o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [http://wiki.openstreetmap.org/entity/P10, http://wiki.openstreetmap.org/prop/reference/value/P10, http://wiki.openstreetmap.org/prop/qualifier/P10, http://wiki.openstreetmap.org/prop/statement/value/P10, http://wiki.openstreetmap.org/prop/direct/P10, http://wiki.openstreetmap.org/prop/reference/P10, http://wiki.openstreetmap.org/prop/novalue/P10, http://wiki.openstreetmap.org/prop/qualifier/value/P10, http://wiki.openstreetmap.org/prop/statement/P10, http://wiki.openstreetmap.org/prop/P10] while processing https://wiki.openstreetmap.org/entity/P10.  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/

04:49:24.867 [update 4] INFO  o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [http://wiki.openstreetmap.org/prop/statement/value/P24, http://wiki.openstreetmap.org/prop/qualifier/value/P24, http://wiki.openstreetmap.org/entity/P24, http://wiki.openstreetmap.org/prop/qualifier/P24, http://wiki.openstreetmap.org/prop/direct/P24, http://wiki.openstreetmap.org/prop/statement/P24, http://wiki.openstreetmap.org/entity/statement/P24-113273b1-414e-8b65-3559-ffa3451f3006, http://wiki.openstreetmap.org/prop/P24, http://wiki.openstreetmap.org/prop/reference/P24, http://wiki.openstreetmap.org/prop/novalue/P24, http://wiki.openstreetmap.org/prop/reference/value/P24] while processing https://wiki.openstreetmap.org/entity/P24.  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/

04:49:24.872 [update 7] INFO  o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [http://wiki.openstreetmap.org/prop/statement/value/P25, http://wiki.openstreetmap.org/entity/P25, http://wiki.openstreetmap.org/prop/qualifier/value/P25, http://wiki.openstreetmap.org/prop/statement/P25, http://wiki.openstreetmap.org/prop/qualifier/P25, http://wiki.openstreetmap.org/prop/direct/P25, http://wiki.openstreetmap.org/prop/reference/P25, http://wiki.openstreetmap.org/prop/P25, http://wiki.openstreetmap.org/prop/reference/value/P25, http://wiki.openstreetmap.org/prop/novalue/P25] while processing https://wiki.openstreetmap.org/entity/P25.  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/

04:49:24.878 [update 9] INFO  o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [http://wiki.openstreetmap.org/prop/novalue/P16, http://wiki.openstreetmap.org/prop/qualifier/value/P16, http://wiki.openstreetmap.org/entity/P16, http://wiki.openstreetmap.org/prop/reference/value/P16, http://wiki.openstreetmap.org/prop/reference/P16, http://wiki.openstreetmap.org/prop/P16, http://wiki.openstreetmap.org/prop/statement/P16, http://wiki.openstreetmap.org/prop/qualifier/P16, http://wiki.openstreetmap.org/entity/statement/P16-4d781dc6-47f5-0588-20cd-ca460e81e126, http://wiki.openstreetmap.org/prop/statement/value/P16, http://wiki.openstreetmap.org/prop/direct/P16] while processing https://wiki.openstreetmap.org/entity/P16.  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/

04:49:24.888 [update 8] INFO  o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [http://wiki.openstreetmap.org/entity/Q2, http://wiki.openstreetmap.org/entity/statement/Q2-a78a2eb1-4761-9736-7538-045e0526f3d5] while processing https://wiki.openstreetmap.org/entity/Q2.  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/

04:49:24.891 [update 5] WARN  org.wikidata.query.rdf.tool.Updater - Contained error syncing.  Giving up on Q12
org.wikidata.query.rdf.tool.rdf.Munger$BadSubjectException: Unrecognized subjects:  [http://wiki.openstreetmap.org/entity/Q12, http://wiki.openstreetmap.org/entity/statement/Q12-61972729-4e68-4290-2dc0-613107bdd7bc].  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/
	at org.wikidata.query.rdf.tool.rdf.Munger$MungeOperation.finishCommon(Munger.java:915)
	at org.wikidata.query.rdf.tool.rdf.Munger$MungeOperation.munge(Munger.java:467)
	at org.wikidata.query.rdf.tool.rdf.Munger.munge(Munger.java:223)
	at org.wikidata.query.rdf.tool.rdf.Munger.mungeWithValues(Munger.java:254)
	at org.wikidata.query.rdf.tool.Updater.handleChange(Updater.java:326)
	at org.wikidata.query.rdf.tool.Updater.lambda$handleChanges$0(Updater.java:191)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

04:49:24.892 [update 2] WARN  org.wikidata.query.rdf.tool.Updater - Contained error syncing.  Giving up on Q14
org.wikidata.query.rdf.tool.rdf.Munger$BadSubjectException: Unrecognized subjects:  [http://wiki.openstreetmap.org/entity/Q14, http://wiki.openstreetmap.org/entity/statement/Q14-85c4afbe-475a-99df-bd54-f0b110ae907d].  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/
	at org.wikidata.query.rdf.tool.rdf.Munger$MungeOperation.finishCommon(Munger.java:915)
	at org.wikidata.query.rdf.tool.rdf.Munger$MungeOperation.munge(Munger.java:467)
	at org.wikidata.query.rdf.tool.rdf.Munger.munge(Munger.java:223)
	at org.wikidata.query.rdf.tool.rdf.Munger.mungeWithValues(Munger.java:254)
	at org.wikidata.query.rdf.tool.Updater.handleChange(Updater.java:326)
	at org.wikidata.query.rdf.tool.Updater.lambda$handleChanges$0(Updater.java:191)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

04:49:24.897 [update 0] WARN  org.wikidata.query.rdf.tool.Updater - Contained error syncing.  Giving up on Q13
org.wikidata.query.rdf.tool.rdf.Munger$BadSubjectException: Unrecognized subjects:  [http://wiki.openstreetmap.org/entity/Q13, http://wiki.openstreetmap.org/entity/statement/Q13-f137653e-4fcd-9cad-cd45-0311ea45542a].  Expected only sitelinks and subjects starting with https://wiki.openstreetmap.org/wiki/Special:EntityData/ and https://wiki.openstreetmap.org/entity/
	at org.wikidata.query.rdf.tool.rdf.Munger$MungeOperation.finishCommon(Munger.java:915)
	at org.wikidata.query.rdf.tool.rdf.Munger$MungeOperation.munge(Munger.java:467)
	at org.wikidata.query.rdf.tool.rdf.Munger.munge(Munger.java:223)
	at org.wikidata.query.rdf.tool.rdf.Munger.mungeWithValues(Munger.java:254)
	at org.wikidata.query.rdf.tool.Updater.handleChange(Updater.java:326)
	at org.wikidata.query.rdf.tool.Updater.lambda$handleChanges$0(Updater.java:191)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

Event Timeline

Yurik created this task.Nov 19 2018, 5:04 AM
Restricted Application added a project: Wikidata. · View Herald TranscriptNov 19 2018, 5:04 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Yurik closed this task as Resolved.Nov 19 2018, 4:02 PM
Yurik claimed this task.

Turns out the --conceptUri http://wiki.openstreetmap.org should have been http instead of https. Thanks @Smalyshev for your help!