Page MenuHomePhabricator
Files F158322

dumpJournal
Smalyshev (Stas Malyshev)
Actions

Authored By
Smalyshev
Apr 28 2015, 9:48 PM
Size
20 KB
Referenced Files
None
Subscribers
None

dumpJournal
View Options

File: blazegraph.jnl
Length: 62415699968
Last Modified: Tue Apr 28 19:04:01 UTC 2015
Opening (read-only): blazegraph.jnl
BlazeGraph(TM) Graph Engine
Flexible
Reliable
Affordable
Web-Scale Computing for the Enterprise
Copyright SYSTAP, LLC 2006-2015. All rights reserved.
db01.eqiad.wmflabs
Tue Apr 28 20:23:06 UTC 2015
Linux/3.16.0-4-amd64 amd64
Intel Xeon E312xx (Sandy Bridge) Family 6 Model 42 Stepping 1, GenuineIntel #CPU=8
Oracle Corporation 1.7.0_75
freeMemory=244777336
buildVersion=1.5.1
Dependency License
ICU http://source.icu-project.org/repos/icu/icu/trunk/license.html
bigdata-ganglia http://www.apache.org/licenses/LICENSE-2.0.html
blueprints-core https://github.com/tinkerpop/blueprints/blob/master/LICENSE.txt
colt http://acs.lbl.gov/software/colt/license.html
commons-codec http://www.apache.org/licenses/LICENSE-2.0.html
commons-fileupload http://www.apache.org/licenses/LICENSE-2.0.html
commons-io http://www.apache.org/licenses/LICENSE-2.0.html
commons-logging http://www.apache.org/licenses/LICENSE-2.0.html
dsiutils http://www.gnu.org/licenses/lgpl-2.1.html
fastutil http://www.apache.org/licenses/LICENSE-2.0.html
flot http://www.opensource.org/licenses/mit-license.php
high-scale-lib http://creativecommons.org/licenses/publicdomain
httpclient http://www.apache.org/licenses/LICENSE-2.0.html
httpclient-cache http://www.apache.org/licenses/LICENSE-2.0.html
httpcore http://www.apache.org/licenses/LICENSE-2.0.html
httpmime http://www.apache.org/licenses/LICENSE-2.0.html
jackson-core http://www.apache.org/licenses/LICENSE-2.0.html
jetty http://www.apache.org/licenses/LICENSE-2.0.html
jquery https://github.com/jquery/jquery/blob/master/MIT-LICENSE.txt
log4j http://www.apache.org/licenses/LICENSE-2.0.html
lucene http://www.apache.org/licenses/LICENSE-2.0.html
nanohttp http://elonen.iki.fi/code/nanohttpd/#license
rexster-core https://github.com/tinkerpop/rexster/blob/master/LICENSE.txt
river http://www.apache.org/licenses/LICENSE-2.0.html
servlet-api http://www.apache.org/licenses/LICENSE-2.0.html
sesame http://www.openrdf.org/download.jsp
slf4j http://www.slf4j.org/license.html
zookeeper http://www.apache.org/licenses/LICENSE-2.0.html
INFO: com.bigdata.util.config.LogUtil: Configure: jar:file:/srv/blazegraph/bigdata-1.5.1.jar!/log4j.properties
magic=e6b4c275
version=1
extent=62415699968(59524M), userExtent=62415699280(59524M), bytesAvailable=-3775669208098637(-3600758751M), nextOffset=3775731623797917
rootBlock{ rootBlock=0, challisField=2740925, version=3, nextOffset=3775731623797917, localTime=1430247841782 [Tuesday, April 28, 2015 7:04:01 PM UTC], firstCommitTime=1428692901050 [Friday, April 10, 2015 7:08:21 PM UTC], lastCommitTime=1430247841781 [Tuesday, April 28, 2015 7:04:01 PM UTC], commitCounter=2740925, commitRecordAddr={off=NATIVE:-165623078,len=422}, commitRecordIndexAddr={off=NATIVE:-155674208,len=220}, blockSequence=1, quorumToken=-1, metaBitsAddr=2455328113296235, metaStartAddr=952388, storeType=RW, uuid=f8287971-835c-4bb1-9b83-215d38565a61, offsetBits=42, checksum=-498521427, createTime=1428691460132 [Friday, April 10, 2015 6:44:20 PM UTC], closeTime=0}
rootBlock{ rootBlock=1, challisField=2740924, version=3, nextOffset=3775731623797159, localTime=1430247841609 [Tuesday, April 28, 2015 7:04:01 PM UTC], firstCommitTime=1428692901050 [Friday, April 10, 2015 7:08:21 PM UTC], lastCommitTime=1430247841588 [Tuesday, April 28, 2015 7:04:01 PM UTC], commitCounter=2740924, commitRecordAddr={off=NATIVE:-165623077,len=422}, commitRecordIndexAddr={off=NATIVE:-155674207,len=220}, blockSequence=182, quorumToken=-1, metaBitsAddr=2449158929646443, metaStartAddr=952388, storeType=RW, uuid=f8287971-835c-4bb1-9b83-215d38565a61, offsetBits=42, checksum=1733634552, createTime=1428691460132 [Friday, April 10, 2015 6:44:20 PM UTC], closeTime=0}
The current root block is #0
-------------------------
RWStore Allocator Summary
-------------------------
AllocatorSize AllocatorCount SlotsAllocated %SlotsAllocated SlotsRecycled SlotChurn SlotsInUse %SlotsInUse MeanAllocation SlotsReserved %SlotsUnused BytesReserved BytesAppData %SlotWaste %AppData %StoreFile %TotalWaste %FileWaste
64 6008 44881895 6.05 2301465 1.05 42580430 30.09 38 43065344 1.13 2756182016 1736588919 36.99 3.49 4.79 12.95 1.77
128 9889 75831672 10.22 4982086 1.07 70849586 50.07 92 70882816 0.05 9073000448 6585790385 27.41 13.25 15.76 31.60 4.32
192 66 1097739 0.15 638994 2.39 458745 0.32 162 467968 1.97 89849856 75788710 15.65 0.15 0.16 0.18 0.02
320 61 23591148 3.18 23404237 126.22 186911 0.13 226 437248 57.25 139919360 52266402 62.65 0.11 0.24 1.11 0.15
512 885 13873848 1.87 7676677 2.24 6197171 4.38 425 6342144 2.29 3247177728 2560760640 21.14 5.15 5.64 8.72 1.19
768 202 32100955 4.33 30817468 25.01 1283487 0.91 648 1447936 11.36 1112014848 697436823 37.28 1.40 1.93 5.27 0.72
1024 1485 62833450 8.47 52613953 6.15 10219497 7.22 929 10644480 3.99 10899947520 9632695811 11.63 19.38 18.94 16.10 2.20
2048 1366 399146420 53.82 390906806 48.44 8239614 5.82 1489 9791488 15.85 20052967424 18306478513 8.71 36.84 34.84 22.19 3.03
3072 121 67004375 9.03 66433288 117.33 571087 0.40 2387 867328 34.16 2664431616 705895399 73.51 1.42 4.63 24.88 3.40
4096 19 10022248 1.35 9931670 110.65 90578 0.06 3487 136192 33.49 557842432 503593526 9.72 1.01 0.97 0.69 0.09
8192 119 11257741 1.52 10423208 13.49 834533 0.59 6105 850944 1.93 6970933248 8836460599 -26.76 17.78 12.11 -23.70 -3.24
-------------------------
BLOBS
-------------------------
Bucket(K) Allocations Allocated Deletes Deleted Current Data Mean Churn
16 1919050 19979012159 1694048 17836854759 225002 2142157400 10410 8.53
32 241318 4871286501 239192 4828640318 2126 42646183 20186 113.51
64 3672 132313617 3662 131986351 10 327266 36033 367.20
128 1 91920 0 0 1 91920 91920 1.00
256 0 0 7 1505808 -7 -1505808 0 0.00
512 0 0 32 13450336 -32 -13450336 0 0.00
1024 0 0 66 46453384 -66 -46453384 0 0.00
2048 1 1087856 41 61969908 -40 -60882052 1087856 -0.03
4096 0 0 9 23104832 -9 -23104832 0 0.00
8192 0 0 1 5111008 -1 -5111008 0 0.00
16384 0 0 1 10435348 -1 -10435348 0 0.00
32768 0 0 0 0 0 0 0 0.00
65536 0 0 0 0 0 0 0 0.00
2097151 0 0 0 0 0 0 0 0.00
There are 2 commit points.
CommitRecord{timestamp=1430247841781, commitCounter=2740925, roots=[-668615623600766756, -711345673408085676, -676907697915822064, -211119117434749, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]}
name=__globalRowStore
Checkpoint{indexType=BTree,height=1,nnodes=1,nleaves=9,nentries=186,counter=0,addrRoot=-711345651933249204,addrMetadata=-70385924045614,addrBloomFilter=0,addrCheckpoint=-668615602125930276}
addrMetadata=0, name=__globalRowStore, indexType=BTree, indexUUID=2698e631-38a9-4ab0-a2c4-9ac84198f25e, branchingFactor=32, pmd=null, btreeClassName=com.bigdata.btree.BTree, checkpointClass=com.bigdata.btree.Checkpoint, nodeKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@9fda160{ratio=8}, btreeRecordCompressorFactory=N/A, tupleSerializer=com.bigdata.btree.DefaultTupleSerializer{, keyBuilderFactory=com.bigdata.btree.keys.DefaultKeyBuilderFactory{ initialCapacity=0, collator=ICU, locale=en_US, strength=null, decomposition=null}, leafKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@6a6daabf{ratio=8}, leafValuesCoder=com.bigdata.btree.raba.codec.CanonicalHuffmanRabaCoder@45e5182f}, conflictResolver=N/A, deleteMarkers=false, versionTimestamps=false, versionTimestampFilters=false, isolatable=false, rawRecords=false, maxRecLen=256, bloomFilterFactory=N/A, overflowHandler=N/A, splitHandler=com.bigdata.sparse.LogicalRowSplitHandler@4396d982, indexSegmentBranchingFactor=512, indexSegmentBufferNodes=false, indexSegmentRecordCompressorFactory=N/A, asynchronousIndexWriteConfiguration=com.bigdata.btree.AsynchronousIndexWriteConfiguration{ masterQueueCapacity=5000, masterChunkSize=10000, masterChunkTimeoutNanos=50000000, sinkIdleTimeoutNanos=9223372036854775807, sinkPollTimeoutNanos=50000000, sinkQueueCapacity=5000, sinkChunkSize=10000, sinkChunkTimeoutNanos=9223372036854775807}, scatterSplitConfiguration=com.bigdata.btree.ScatterSplitConfiguration{enabled=true, percentOfSplitThreshold=0.25, dataServiceCount=0, indexPartitionCount=0}
com.bigdata.btree.BTreePageStats{indexType=BTree,m=32,nnodes=1,nleaves=9,nrawRecs=0,nodeBytes=332,minNodeBytes=332,maxNodeBytes=332,leafBytes=8851,minLeafBytes=631,maxLeafBytes=1441,rawRecBytes=0,bytesPerNode=332,bytesPerLeaf=983,bytesPerRawRec=0,nerrors=0,slot_64=0.0,slot_128=0.0,slot_192=0.0,slot_320=0.0,slot_512=0.1,slot_768=0.3,slot_1024=0.1,slot_2048=0.5,slot_3072=0.0,slot_4096=0.0,slot_8192=0.0,blobs=0.0,newM=422}
name=wdq.lex.BLOBS
Checkpoint{indexType=BTree,height=2,nnodes=9,nleaves=682,nentries=60478,counter=0,addrRoot=-706544088949718894,addrMetadata=-21474835649,addrBloomFilter=0,addrCheckpoint=-668615400262467364}
addrMetadata=0, name=wdq.lex.BLOBS, indexType=BTree, indexUUID=f4029c01-b088-4f27-b026-d39e3d175cfc, branchingFactor=128, pmd=null, btreeClassName=com.bigdata.btree.BTree, checkpointClass=com.bigdata.btree.Checkpoint, nodeKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@688557ee{ratio=8}, btreeRecordCompressorFactory=N/A, tupleSerializer=com.bigdata.rdf.lexicon.BlobsTupleSerializer{, keyBuilderFactory=com.bigdata.btree.keys.ASCIIKeyBuilderFactory{ initialCapacity=8}, leafKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@a4fffde{ratio=8}, leafValuesCoder=com.bigdata.btree.raba.codec.SimpleRabaCoder@a274d1c}, conflictResolver=N/A, deleteMarkers=false, versionTimestamps=false, versionTimestampFilters=false, isolatable=false, rawRecords=true, maxRecLen=0, bloomFilterFactory=N/A, overflowHandler=N/A, splitHandler=N/A, indexSegmentBranchingFactor=512, indexSegmentBufferNodes=false, indexSegmentRecordCompressorFactory=N/A, asynchronousIndexWriteConfiguration=com.bigdata.btree.AsynchronousIndexWriteConfiguration{ masterQueueCapacity=5000, masterChunkSize=10000, masterChunkTimeoutNanos=50000000, sinkIdleTimeoutNanos=9223372036854775807, sinkPollTimeoutNanos=50000000, sinkQueueCapacity=5000, sinkChunkSize=10000, sinkChunkTimeoutNanos=9223372036854775807}, scatterSplitConfiguration=com.bigdata.btree.ScatterSplitConfiguration{enabled=true, percentOfSplitThreshold=0.25, dataServiceCount=0, indexPartitionCount=0}
com.bigdata.btree.BTreePageStats{indexType=BTree,m=128,nnodes=9,nleaves=682,nrawRecs=60478,nodeBytes=9018,minNodeBytes=146,maxNodeBytes=1295,leafBytes=1186179,minLeafBytes=1177,maxLeafBytes=2506,rawRecBytes=20739805,bytesPerNode=1002,bytesPerLeaf=1739,bytesPerRawRec=342,nerrors=0,slot_64=0.0,slot_128=0.0,slot_192=0.0,slot_320=0.0,slot_512=0.0,slot_768=0.0,slot_1024=0.0,slot_2048=0.76,slot_3072=0.23,slot_4096=0.0,slot_8192=0.0,blobs=0.0,newM=659}
name=wdq.lex.ID2TERM
Checkpoint{indexType=BTree,height=4,nnodes=18010,nleaves=1152790,nentries=73778666,counter=0,addrRoot=-711310059539267496,addrMetadata=-17179868349,addrBloomFilter=0,addrCheckpoint=-668615447507107620}
addrMetadata=0, name=wdq.lex.ID2TERM, indexType=BTree, indexUUID=fda1df27-533d-4389-bfe2-be36b0394966, branchingFactor=128, pmd=null, btreeClassName=com.bigdata.btree.BTree, checkpointClass=com.bigdata.btree.Checkpoint, nodeKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@1deaca69{ratio=8}, btreeRecordCompressorFactory=N/A, tupleSerializer=com.bigdata.rdf.lexicon.Id2TermTupleSerializer{, keyBuilderFactory=com.bigdata.btree.keys.ASCIIKeyBuilderFactory{ initialCapacity=9}, leafKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@218ec2d7{ratio=8}, leafValuesCoder=com.bigdata.btree.raba.codec.SimpleRabaCoder@2399c277}, conflictResolver=N/A, deleteMarkers=false, versionTimestamps=false, versionTimestampFilters=false, isolatable=false, rawRecords=true, maxRecLen=16, bloomFilterFactory=N/A, overflowHandler=N/A, splitHandler=N/A, indexSegmentBranchingFactor=512, indexSegmentBufferNodes=false, indexSegmentRecordCompressorFactory=N/A, asynchronousIndexWriteConfiguration=com.bigdata.btree.AsynchronousIndexWriteConfiguration{ masterQueueCapacity=5000, masterChunkSize=10000, masterChunkTimeoutNanos=50000000, sinkIdleTimeoutNanos=9223372036854775807, sinkPollTimeoutNanos=50000000, sinkQueueCapacity=5000, sinkChunkSize=10000, sinkChunkTimeoutNanos=9223372036854775807}, scatterSplitConfiguration=com.bigdata.btree.ScatterSplitConfiguration{enabled=true, percentOfSplitThreshold=0.25, dataServiceCount=0, indexPartitionCount=0}
com.bigdata.btree.BTreePageStats{indexType=BTree,m=128,nnodes=18010,nleaves=1152790,nrawRecs=67546782,nodeBytes=14899117,minNodeBytes=88,maxNodeBytes=1829,leafBytes=1266100823,minLeafBytes=970,maxLeafBytes=1996,rawRecBytes=4626084539,bytesPerNode=827,bytesPerLeaf=1098,bytesPerRawRec=68,nerrors=0,slot_64=0.0,slot_128=0.0,slot_192=0.0,slot_320=0.0,slot_512=0.0,slot_768=0.0,slot_1024=0.01,slot_2048=0.98,slot_3072=0.0,slot_4096=0.0,slot_8192=0.0,blobs=0.0,newM=888}
name=wdq.lex.TERM2ID
Checkpoint{indexType=BTree,height=3,nnodes=9867,nleaves=857439,nentries=73778666,counter=73778666,addrRoot=-462055768569410699,addrMetadata=-70390219012899,addrBloomFilter=0,addrCheckpoint=-668615464686976804}
addrMetadata=0, name=wdq.lex.TERM2ID, indexType=BTree, indexUUID=e246eecf-bbfe-4450-8528-5c51ee4ad333, branchingFactor=128, pmd=null, btreeClassName=com.bigdata.btree.BTree, checkpointClass=com.bigdata.btree.Checkpoint, nodeKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@48ae27b0{ratio=8}, btreeRecordCompressorFactory=N/A, tupleSerializer=com.bigdata.rdf.lexicon.Term2IdTupleSerializer{, keyBuilderFactory=com.bigdata.btree.keys.DefaultKeyBuilderFactory{ initialCapacity=0, collator=ICU, locale=en_US, strength=null, decomposition=null}, leafKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@21afb917{ratio=8}, leafValuesCoder=com.bigdata.btree.raba.codec.FixedLengthValueRabaCoder@17a0a648}, conflictResolver=N/A, deleteMarkers=false, versionTimestamps=false, versionTimestampFilters=false, isolatable=false, rawRecords=false, maxRecLen=256, bloomFilterFactory=N/A, overflowHandler=N/A, splitHandler=N/A, indexSegmentBranchingFactor=512, indexSegmentBufferNodes=false, indexSegmentRecordCompressorFactory=N/A, asynchronousIndexWriteConfiguration=com.bigdata.btree.AsynchronousIndexWriteConfiguration{ masterQueueCapacity=5000, masterChunkSize=10000, masterChunkTimeoutNanos=50000000, sinkIdleTimeoutNanos=9223372036854775807, sinkPollTimeoutNanos=50000000, sinkQueueCapacity=5000, sinkChunkSize=10000, sinkChunkTimeoutNanos=9223372036854775807}, scatterSplitConfiguration=com.bigdata.btree.ScatterSplitConfiguration{enabled=true, percentOfSplitThreshold=0.25, dataServiceCount=0, indexPartitionCount=0}
com.bigdata.btree.BTreePageStats{indexType=BTree,m=128,nnodes=9867,nleaves=857439,nrawRecs=0,nodeBytes=18161371,minNodeBytes=907,maxNodeBytes=8847,leafBytes=4237260356,minLeafBytes=1085,maxLeafBytes=42016,rawRecBytes=0,bytesPerNode=1840,bytesPerLeaf=4941,bytesPerRawRec=0,nerrors=0,slot_64=0.0,slot_128=0.0,slot_192=0.0,slot_320=0.0,slot_512=0.0,slot_768=0.0,slot_1024=0.0,slot_2048=0.2,slot_3072=0.19,slot_4096=0.06,slot_8192=0.38,blobs=0.14,newM=312}
name=wdq.solutionSets.%s1
Checkpoint{indexType=Stream,nnodes=0,nleaves=0,nentries=3093,counter=0,addrRoot=-283343519412625538,addrMetadata=-283389196389841655,addrBloomFilter=-283262408955264007,addrCheckpoint=-36326833389348}
addrMetadata=0, name=wdq.solutionSets.%s1, indexType=Stream, indexUUID=e57227f1-58f7-4efa-bce2-10b2be799041, branchingFactor=32, pmd=null, btreeClassName=com.bigdata.btree.BTree, checkpointClass=com.bigdata.btree.Checkpoint, nodeKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@40d672c5{ratio=8}, btreeRecordCompressorFactory=N/A, tupleSerializer=com.bigdata.btree.DefaultTupleSerializer{, keyBuilderFactory=com.bigdata.btree.keys.DefaultKeyBuilderFactory{ initialCapacity=0, collator=ICU, locale=en_US, strength=null, decomposition=null}, leafKeysCoder=com.bigdata.btree.raba.codec.FrontCodedRabaCoder$DefaultFrontCodedRabaCoder@3f0904c4{ratio=8}, leafValuesCoder=com.bigdata.btree.raba.codec.CanonicalHuffmanRabaCoder@69180030}, conflictResolver=N/A, deleteMarkers=false, versionTimestamps=false, versionTimestampFilters=false, isolatable=false, rawRecords=false, maxRecLen=256, bloomFilterFactory=N/A, overflowHandler=N/A, splitHandler=N/A, indexSegmentBranchingFactor=512, indexSegmentBufferNodes=false, indexSegmentRecordCompressorFactory=N/A, asynchronousIndexWriteConfiguration=com.bigdata.btree.AsynchronousIndexWriteConfiguration{ masterQueueCapacity=5000, masterChunkSize=10000, masterChunkTimeoutNanos=50000000, sinkIdleTimeoutNanos=9223372036854775807, sinkPollTimeoutNanos=50000000, sinkQueueCapacity=5000, sinkChunkSize=10000, sinkChunkTimeoutNanos=9223372036854775807}, scatterSplitConfiguration=com.bigdata.btree.ScatterSplitConfiguration{enabled=true, percentOfSplitThreshold=0.25, dataServiceCount=0, indexPartitionCount=0}, streamClassName=com.bigdata.bop.solutions.SolutionSetStream, streamCompressionType=Zip

File Metadata

Mime Type
text/plain
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
154053
Default Alt Text
dumpJournal (20 KB)

Event Timeline

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL