Page MenuHomePhabricator
Paste P9750

blazegraph import failure (curl client stalled, all threads waiting)
ActivePublic

Authored by dcausse on Nov 26 2019, 10:58 AM.
Tags
None
Referenced Files
F31290546: raw.txt
Nov 26 2019, 11:04 AM
F31290524: raw.txt
Nov 26 2019, 11:03 AM
F31290399: raw.txt
Nov 26 2019, 10:58 AM
Subscribers
Waiting threads:
"com.bigdata.journal.WriteExecutorService$MyLockManager1" #70 daemon prio=5 os_prio=0 tid=0x00007f59ccd0a800 nid=0x7c5c waiting on condition [0x00007f5abc102000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f5be9653598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at com.bigdata.concurrent.NonBlockingLockManagerWithNewDesign$AcceptTask.awaitStateChange(NonBlockingLockManagerWithNewDesign.java:2161)
at com.bigdata.concurrent.NonBlockingLockManagerWithNewDesign$AcceptTask.run(NonBlockingLockManagerWithNewDesign.java:2055)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
"com.bigdata.rwstore.RWStore$11" #69 daemon prio=5 os_prio=0 tid=0x00007f59fff00800 nid=0x7c5b waiting on condition [0x00007f5abc403000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f5be96b9f10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at com.bigdata.io.writecache.WriteCacheService$WriteTask.awaitDirtyBuffer(WriteCacheService.java:1317)
at com.bigdata.io.writecache.WriteCacheService$WriteTask.doRun(WriteCacheService.java:1004)
at com.bigdata.io.writecache.WriteCacheService$WriteTask.call(WriteCacheService.java:923)
at com.bigdata.io.writecache.WriteCacheService$WriteTask.call(WriteCacheService.java:895)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
-----------------------------------------------
-----------------------------------------------
Logs:
-----------------------------------------------
-----------------------------------------------
10:16:24.543 [qtp226170135-1420] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000401.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
10:23:32.148 [qtp226170135-1492] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000402.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
10:29:21.709 [qtp226170135-1499] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000403.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
10:34:20.365 [qtp226170135-1492] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000404.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
-----------------------------------------------
-----------------------------------------------
Original logs (first failure):
-----------------------------------------------
-----------------------------------------------
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - %msg %mdc%n%rEx{1,QUERY_TIMEOUT,SYNTAX_ERROR}
16:14:50.632 [qtp226170135-20945] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000540.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
16:31:38.967 [qtp226170135-20798] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000541.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
16:41:14.511 [qtp226170135-20923] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000540.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
16:56:20.045 [qtp226170135-20679] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000541.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
17:19:18.851 [qtp226170135-20756] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000542.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
17:26:31.518 [qtp226170135-21506] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000543.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
17:33:40.679 [qtp226170135-20945] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000544.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
18:03:26.784 [qtp226170135-20945] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000545.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
18:32:33.661 [qtp226170135-20945] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000546.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
18:32:56.918 [Thread-3] INFO o.w.q.r.b.t.ThrottlingFilter - ThrottlingFilter MBean org.wikidata.query.rdf.blazegraph.throttling.ThrottlingFilter:filterName=throttling-filter unregistered.
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - %msg %mdc%n%rEx{1,QUERY_TIMEOUT,SYNTAX_ERROR}
18:33:04.743 [main] WARN com.bigdata.Banner - Defaulting log level to WARN: com.bigdata
18:33:06.499 [main] WARN com.bigdata.rdf.ServiceProviderHook - Running.
18:33:06.653 [main] INFO o.w.q.r.b.mwapi.MWApiServiceFactory - Loading MWAPI service configuration from /srv/deployment/wdqs/wdqs/mwservices.json
18:33:06.765 [main] INFO o.w.q.r.b.mwapi.MWApiServiceFactory - Registered 4 services.
18:33:06.806 [main] WARN c.b.r.s.sparql.PrefixDeclProcessor - Configured prefix: PREFIX psn: http://www.wikidata.org/prop/statement/value-normalized/
18:33:06.807 [main] WARN c.b.r.s.sparql.PrefixDeclProcessor - Configured prefix: PREFIX pqn: http://www.wikidata.org/prop/qualifier/value-normalized/
18:33:06.807 [main] WARN c.b.r.s.sparql.PrefixDeclProcessor - Configured prefix: PREFIX prn: http://www.wikidata.org/prop/reference/value-normalized/
18:33:06.807 [main] WARN c.b.r.s.sparql.PrefixDeclProcessor - Configured prefix: PREFIX mwapi: https://www.mediawiki.org/ontology#API/
18:33:06.808 [main] WARN c.b.r.s.sparql.PrefixDeclProcessor - Configured prefix: PREFIX gas: http://www.bigdata.com/rdf/gas#
18:33:06.809 [main] INFO o.w.q.r.b.WikibaseContextListener - Wikibase services initialized.
18:33:06.825 [main] INFO o.w.q.r.b.t.ThrottlingFilter - Loaded 7 patterns from patterns.txt
18:33:06.826 [main] INFO o.w.q.r.b.t.ThrottlingFilter - Loaded 7 patterns from agents.txt
18:33:06.830 [main] INFO o.w.q.r.b.t.ThrottlingFilter - ThrottlingFilter MBean registered as org.wikidata.query.rdf.blazegraph.throttling.ThrottlingFilter:filterName=throttling-filter.
18:41:53.614 [qtp226170135-31] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000540.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
18:53:12.484 [qtp226170135-35] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}, query=SPARQL-UPDATE: updateStr=LOAD <file:///srv/wdqs/munged//wikidump-000000541.ttl.gz> req.requestURI=/bigdata/namespace/wdq/sparql, req.xForwardedFor=null, req.queryString=null, req.method=POST, req.remoteHost=localhost, req.requestURL=http://localhost:9999/bigdata/namespace/wdq/sparql, req.userAgent=curl/7.52.1
com.bigdata.util.ChecksumError: offset=501224882176,nbytes=16,expected=-110458524,actual=584386059
at com.bigdata.io.writecache.WriteCacheService._readFromLocalDiskIntoNewHeapByteBuffer(WriteCacheService.java:3783)
Wrapped by: java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2321)
Wrapped by: java.lang.RuntimeException: addr=-105894753 : cause=java.lang.IllegalStateException: Error reading from WriteCache addr: 501224882176 length: 12, writeCacheDebug: No WriteCache debug info
at com.bigdata.rwstore.RWStore.getData(RWStore.java:2399)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706
at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:5425)
Wrapped by: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3134)
Wrapped by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1080)
Wrapped by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
Wrapped by: java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: Problem with entry at -99105051800239706: lastRootBlock=rootBlock{ rootBlock=0, challisField=540, version=3, nextOffset=35776523638082164, localTime=1574265747218 [Wednesday, November 20, 2019 4:02:27 PM UTC], firstCommitTime=1573811488208 [Friday, November 15, 2019 9:51:28 AM UTC], lastCommitTime=1574265740627 [Wednesday, November 20, 2019 4:02:20 PM UTC], commitCounter=540, commitRecordAddr={off=NATIVE:-36991349,len=422}, commitRecordIndexAddr={off=NATIVE:-5888027,len=220}, blockSequence=25748, quorumToken=-1, metaBitsAddr=35406031592883186, metaStartAddr=9004625, storeType=RW, uuid=da5ad168-7da2-4536-8135-ea8739a33831, offsetBits=42, checksum=-1607062625, createTime=1573811486718 [Friday, November 15, 2019 9:51:26 AM UTC], closeTime=0}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)

Event Timeline

dcausse edited the content of this paste. (Show Details)

What FS is used to store wikidata.jnl file? And what is underlying physical disk? What is OS exact version?
Blazegraph applies heavy load on disk, so it might be a combination of heavy stress writes and reads, resulting in either overheating of the physical disk, leading to errors, or OS layer bugs in FS or NVMe drivers.