Page MenuHomePhabricator

Failure of wdqs-updater after data import
Closed, ResolvedPublic

Description

During data reload on wdqs1002, wdqs-updater crashed. It was finally restarted (most probably by systemd) and is now continuing the import. Investigation is required to understand why this failed and if the data we have imported is in a sufficiently good state.

Some part of a stacktrace that seems relevant:

Apr 29 13:03:09 wdqs1002 bash[25295]: Caused by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.IllegalStateException: Already assigned: old=LiteralExtensionIV [delegate=XSDInteger(2353913150770005286438421076410748154383590900191743279819), datatype=Vocab(44)], new=LiteralExtensionIV [delegate=XSDInteger(2353913150770005286438421076410748045481917097629504765952), datatype=Vocab(44)[http://www.opengis.net/ont/geosparql#wktLiteral]], this: "<http://www.wikidata.org/entity/Q37748736> Point(49.15724288 14.178844672)"^^<http://www.opengis.net/ont/geosparql#wktLiteral>
Apr 29 13:03:09 wdqs1002 bash[25295]: at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Apr 29 13:03:09 wdqs1002 bash[25295]: at java.util.concurrent.FutureTask.get(FutureTask.java:188)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:552)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:460)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.task.ApiTaskForIndexManager.call(ApiTaskForIndexManager.java:68)
Apr 29 13:03:09 wdqs1002 bash[25295]: at java.util.concurrent.FutureTask.run(FutureTask.java:262)
Apr 29 13:03:09 wdqs1002 bash[25295]: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
Apr 29 13:03:09 wdqs1002 bash[25295]: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
Apr 29 13:03:09 wdqs1002 bash[25295]: ... 1 more
Apr 29 13:03:09 wdqs1002 bash[25295]: Caused by: org.openrdf.query.UpdateExecutionException: java.lang.IllegalStateException: Already assigned: old=LiteralExtensionIV [delegate=XSDInteger(2353913150770005286438421076410748154383590900191743279819), datatype=Vocab(44)], new=LiteralExtensionIV [delegate=XSDInteger(2353913150770005286438421076410748045481917097629504765952), datatype=Vocab(44)[http://www.opengis.net/ont/geosparql#wktLiteral]], this: "<http://www.wikidata.org/entity/Q37748736> Point(49.15724288 14.178844672)"^^<http://www.opengis.net/ont/geosparql#wktLiteral>
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1934)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1536)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1501)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:714)
Apr 29 13:03:09 wdqs1002 bash[25295]: ... 4 more
Apr 29 13:03:09 wdqs1002 bash[25295]: Caused by: java.lang.IllegalStateException: Already assigned: old=LiteralExtensionIV [delegate=XSDInteger(2353913150770005286438421076410748154383590900191743279819), datatype=Vocab(44)], new=LiteralExtensionIV [delegate=XSDInteger(2353913150770005286438421076410748045481917097629504765952), datatype=Vocab(44)[http://www.opengis.net/ont/geosparql#wktLiteral]], this: "<http://www.wikidata.org/entity/Q37748736> Point(49.15724288 14.178844672)"^^<http://www.opengis.net/ont/geosparql#wktLiteral>
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.model.BigdataValueImpl.setIV(BigdataValueImpl.java:139)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.internal.LexiconConfiguration.createInlineIV(LexiconConfiguration.java:527)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.lexicon.LexiconRelation.getInlineIV(LexiconRelation.java:3343)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.lexicon.LexiconRelation.addTerms(LexiconRelation.java:1798)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.store.AbstractTripleStore.getAccessPath(AbstractTripleStore.java:3257)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.store.AbstractTripleStore.getAccessPath(AbstractTripleStore.java:3203)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:3276)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2961)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.addOrRemoveStatement(AST2BOpUpdate.java:2233)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertDeleteInsert(AST2BOpUpdate.java:1050)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:443)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:293)
Apr 29 13:03:09 wdqs1002 bash[25295]: at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1072)
Apr 29 13:03:09 wdqs1002 bash[25295]: ... 9 more
Apr 29 13:03:09 wdqs1002 bash[25295]: at org.wikidata.query.rdf.tool.rdf.RdfRepository.execute(RdfRepository.java:592)
Apr 29 13:03:10 wdqs1002 bash[25295]: at org.wikidata.query.rdf.tool.rdf.RdfRepository.syncFromChanges(RdfRepository.java:387)
Apr 29 13:03:10 wdqs1002 bash[25295]: at org.wikidata.query.rdf.tool.Update.handleChanges(Update.java:345)
Apr 29 13:03:10 wdqs1002 bash[25295]: at org.wikidata.query.rdf.tool.Update.run(Update.java:282)
Apr 29 13:03:10 wdqs1002 bash[25295]: at org.wikidata.query.rdf.tool.Update.main(Update.java:120)

Event Timeline

Smalyshev claimed this task.

Fixed, looks like case of loading wrongly munged dump.