Masterwork From Distant Lands
ActivePublic
Actions

Authored by ProdPasteBot on Jul 6 2016, 11:57 AM.

Tags

None

Referenced Files

	F4244186: Masterwork From Distant Lands
	Jul 6 2016, 11:57 AM

Subscribers

None

	INFO [MemtableFlushWriter:404] 2016-07-06 11:47:46,177 Memtable.java:382 - Completed flushing /srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-tmp-ka-25373-Data.db (0.000KiB) for commitlog position ReplayPosition(segmentId=1467734948851, position=11167676)
	INFO [CompactionExecutor:996] 2016-07-06 11:47:46,681 CompactionTask.java:274 - Compacted 2 sstables to [/srv/cassandra-c/data/local_group_default_T_mobileapps_lead/data-13482db08e0b11e5adc765f8a3ffd5d4/local_group_default_T_mobileapps_lead-data-ka-255,]. 89,074,993 bytes to 88,919,279 (~99% of original) in 46,803ms = 1.811850MB/s. 80,609 total partitions merged to 80,609. Partition merge counts were {1:80609, }
	INFO [CompactionExecutor:996] 2016-07-06 11:47:46,683 ColumnFamilyStore.java:905 - Enqueuing flush of compactions_in_progress: 293 (0%) on-heap, 210 (0%) off-heap
	INFO [MemtableFlushWriter:405] 2016-07-06 11:47:46,683 Memtable.java:347 - Writing Memtable-compactions_in_progress@1233203153(0.156KiB serialized bytes, 7 ops, 0%/0% of on/off-heap limit)
	INFO [MemtableFlushWriter:405] 2016-07-06 11:47:46,684 Memtable.java:382 - Completed flushing /srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-tmp-ka-25374-Data.db (0.000KiB) for commitlog position ReplayPosition(segmentId=1467734948851, position=11309995)
	INFO [CompactionExecutor:996] 2016-07-06 11:47:47,132 CompactionTask.java:141 - Compacting [SSTableReader(path='/srv/cassandra-c/data/local_group_default_T_mobileapps_lead/data-13482db08e0b11e5adc765f8a3ffd5d4/local_group_default_T_mobileapps_lead-data-ka-230-Data.db'), SSTableReader(path='/srv/cassandra-c/data/local_group_default_T_mobileapps_lead/data-13482db08e0b11e5adc765f8a3ffd5d4/local_group_default_T_mobileapps_lead-data-ka-236-Data.db')]
	INFO [CompactionExecutor:996] 2016-07-06 11:47:56,929 ColumnFamilyStore.java:905 - Enqueuing flush of compactions_in_progress: 149 (0%) on-heap, 20 (0%) off-heap
	INFO [MemtableFlushWriter:404] 2016-07-06 11:47:56,929 Memtable.java:347 - Writing Memtable-compactions_in_progress@1840999663(0.008KiB serialized bytes, 1 ops, 0%/0% of on/off-heap limit)
	INFO [MemtableFlushWriter:404] 2016-07-06 11:47:56,930 Memtable.java:382 - Completed flushing /srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-tmp-ka-25375-Data.db (0.000KiB) for commitlog position ReplayPosition(segmentId=1467734948851, position=17450860)
	INFO [CompactionExecutor:996] 2016-07-06 11:47:57,482 CompactionTask.java:274 - Compacted 2 sstables to [/srv/cassandra-c/data/local_group_default_T_mobileapps_lead/data-13482db08e0b11e5adc765f8a3ffd5d4/local_group_default_T_mobileapps_lead-data-ka-256,]. 17,080,181 bytes to 16,586,330 (~97% of original) in 10,350ms = 1.528305MB/s. 18,587 total partitions merged to 18,581. Partition merge counts were {1:18575, 2:6, }
	INFO [CompactionExecutor:996] 2016-07-06 11:47:57,483 CompactionTask.java:141 - Compacting [SSTableReader(path='/srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-25372-Data.db'), SSTableReader(path='/srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-25375-Data.db'), SSTableReader(path='/srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-25374-Data.db'), SSTableReader(path='/srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-25373-Data.db'), SSTableReader(path='/srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-25371-Data.db')]
	INFO [CompactionExecutor:996] 2016-07-06 11:47:58,319 CompactionTask.java:274 - Compacted 5 sstables to [/srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-25376,]. 1,220 bytes to 774 (~63% of original) in 836ms = 0.000883MB/s. 13 total partitions merged to 9. Partition merge counts were {1:9, 2:2, }
	INFO [CompactionExecutor:996] 2016-07-06 11:47:58,320 ColumnFamilyStore.java:905 - Enqueuing flush of compactions_in_progress: 293 (0%) on-heap, 210 (0%) off-heap
	INFO [MemtableFlushWriter:405] 2016-07-06 11:47:58,320 Memtable.java:347 - Writing Memtable-compactions_in_progress@1635680852(0.156KiB serialized bytes, 7 ops, 0%/0% of on/off-heap limit)
	INFO [MemtableFlushWriter:405] 2016-07-06 11:47:58,321 Memtable.java:382 - Completed flushing /srv/cassandra-c/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-tmp-ka-25377-Data.db (0.000KiB) for commitlog position ReplayPosition(segmentId=1467734948851, position=18041680)
	INFO [CompactionExecutor:996] 2016-07-06 11:47:58,902 CompactionTask.java:141 - Compacting [SSTableReader(path='/srv/cassandra-c/data/local_group_default_T_mobileapps_lead/data-13482db08e0b11e5adc765f8a3ffd5d4/local_group_default_T_mobileapps_lead-data-ka-256-Data.db'), SSTableReader(path='/srv/cassandra-c/data/local_group_default_T_mobileapps_lead/data-13482db08e0b11e5adc765f8a3ffd5d4/local_group_default_T_mobileapps_lead-data-ka-213-Data.db')]
	INFO [StreamReceiveTask:925] 2016-07-06 11:48:13,494 StreamResultFuture.java:180 - [Stream #e2271d20-42ca-11e6-bec9-09a5662464fd] Session with /10.64.48.139 is complete
	WARN [StreamReceiveTask:925] 2016-07-06 11:48:13,542 StreamResultFuture.java:207 - [Stream #e2271d20-42ca-11e6-bec9-09a5662464fd] Stream failed
	ERROR [main] 2016-07-06 11:48:13,545 CassandraDaemon.java:581 - Exception encountered during startup
	java.lang.RuntimeException: Error during boostrap: Stream failed
	at org.apache.cassandra.dht.BootStrapper.bootstrap(BootStrapper.java:86) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.service.StorageService.bootstrap(StorageService.java:1166) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:944) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:740) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:617) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:389) [apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:564) [apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:653) [apache-cassandra-2.1.13.jar:2.1.13]
	Caused by: org.apache.cassandra.streaming.StreamException: Stream failed
	at org.apache.cassandra.streaming.management.StreamEventJMXNotifier.onFailure(StreamEventJMXNotifier.java:85) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172) ~[guava-16.0.jar:na]
	at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) ~[guava-16.0.jar:na]
	at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) ~[guava-16.0.jar:na]
	at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) ~[guava-16.0.jar:na]
	at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202) ~[guava-16.0.jar:na]
	at org.apache.cassandra.streaming.StreamResultFuture.maybeComplete(StreamResultFuture.java:208) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.streaming.StreamResultFuture.handleSessionComplete(StreamResultFuture.java:184) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.streaming.StreamSession.closeSession(StreamSession.java:415) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.streaming.StreamSession.maybeCompleted(StreamSession.java:691) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.streaming.StreamSession.taskCompleted(StreamSession.java:652) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:179) ~[apache-cassandra-2.1.13.jar:2.1.13]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_91]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_91]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_91]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_91]
	at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_91]
	WARN [StorageServiceShutdownHook] 2016-07-06 11:48:13,627 Gossiper.java:1463 - No local state or state is in silent shutdown, not announcing shutdown
	INFO [StorageServiceShutdownHook] 2016-07-06 11:48:13,628 MessagingService.java:734 - Waiting for messaging service to quiesce
	INFO [ACCEPT-/10.64.48.131] 2016-07-06 11:48:13,628 MessagingService.java:1018 - MessagingService has terminated the accept() thread
	INFO [ACCEPT-/10.64.48.131] 2016-07-06 11:48:13,665 MessagingService.java:1018 - MessagingService has terminated the accept() thread

Event Timeline

ProdPasteBot edited the content of this paste. (Show Details)Jul 6 2016, 11:57 AM

ProdPasteBot changed the title of this paste from untitled to Masterwork From Distant Lands.

fgiunchedi mentioned this in T139362: High storage utilization on restbase1014.eqiad.wmnet.Jul 6 2016, 11:58 AM

Masterwork From Distant LandsActivePublicActions

Event Timeline

Masterwork From Distant Lands
ActivePublic
Actions