Page MenuHomePhabricator
Paste P6811

45e329e0-216c-11e8-b786-237a199d4b45
ActivePublic

Authored by Eevans on Mar 7 2018, 2:07 PM.
Tags
None
Referenced Files
F14623124: 45e329e0-216c-11e8-b786-237a199d4b45
Mar 7 2018, 2:08 PM
F14623108: fa6d0170-219d-11e8-a28a-1d583f325411
Mar 7 2018, 2:07 PM
Subscribers
None
eevans@restbase1007:~$ sudo ./traces --cqlshrc=/etc/cassandra-a/cqlshrc --hostname restbase1007-a.eqiad.wmnet events --id 45e329e0-216c-11e8-b786-237a199d4b45
1 |2018-03-06 18:29:14.751 +0000 UTC | restbase1012-c.eqiad.wmnet | 138 | Native-Transport-Requests-7 | reading data from restbase1013-a.eqiad.wmnet.
2 |2018-03-06 18:29:14.751 +0000 UTC | restbase1012-c.eqiad.wmnet | 186 | Native-Transport-Requests-7 | reading digest from restbase1014-b.eqiad.wmnet.
3 |2018-03-06 18:29:14.755 +0000 UTC | restbase1012-c.eqiad.wmnet | 5026 | Native-Transport-Requests-7 | speculating read retry on restbase1010-b.eqiad.wmnet.
4 |2018-03-06 18:29:15.352 +0000 UTC | restbase1012-c.eqiad.wmnet | 5127 | MessagingService-Outgoing-restbase1010-b.eqiad.wmnet/10.64.0.115-Small | Sending READ message to restbase1010-b.eqiad.wmnet/10.64.0.115
5 |2018-03-06 18:29:15.353 +0000 UTC | restbase1010-b.eqiad.wmnet | 9 | MessagingService-Incoming-/10.64.32.79 | READ message received from restbase1012-c.eqiad.wmnet.
6 |2018-03-06 18:29:15.353 +0000 UTC | restbase1012-c.eqiad.wmnet | 602888 | MessagingService-Outgoing-restbase1014-b.eqiad.wmnet/10.64.48.136-Small | Sending READ message to restbase1014-b.eqiad.wmnet/10.64.48.136
7 |2018-03-06 18:29:15.353 +0000 UTC | restbase1010-b.eqiad.wmnet | 139 | ReadStage-2 | Executing single-partition query on data
8 |2018-03-06 18:29:15.353 +0000 UTC | restbase1012-c.eqiad.wmnet | 603037 | MessagingService-Outgoing-restbase1013-a.eqiad.wmnet/10.64.32.205-Small | Sending READ message to restbase1013-a.eqiad.wmnet/10.64.32.205
9 |2018-03-06 18:29:15.353 +0000 UTC | restbase1010-b.eqiad.wmnet | 353 | ReadStage-2 | Acquiring sstable references
10 |2018-03-06 18:29:15.353 +0000 UTC | restbase1010-b.eqiad.wmnet | 535 | ReadStage-2 | Merging memtable contents
11 |2018-03-06 18:29:15.353 +0000 UTC | restbase1010-b.eqiad.wmnet | 562 | ReadStage-2 | Key cache hit for sstable 2649
12 |2018-03-06 18:29:15.353 +0000 UTC | restbase1010-b.eqiad.wmnet | 662 | ReadStage-2 | Read 1 live and 0 tombstone cells
13 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 8 | MessagingService-Incoming-/10.64.32.79 | READ message received from restbase1012-c.eqiad.wmnet.
14 |2018-03-06 18:29:15.354 +0000 UTC | restbase1010-b.eqiad.wmnet | 697 | ReadStage-2 | Enqueuing response to restbase1012-c.eqiad.wmnet.
15 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 18 | MessagingService-Incoming-/10.64.32.79 | READ message received from restbase1012-c.eqiad.wmnet.
16 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 135 | ReadStage-2 | Executing single-partition query on data
17 |2018-03-06 18:29:15.354 +0000 UTC | restbase1010-b.eqiad.wmnet | 1087 | MessagingService-Outgoing-restbase1012-c.eqiad.wmnet/10.64.32.204-Small | Sending REQUEST_RESPONSE message to restbase1012-c.eqiad.wmnet/10.64.32.204
18 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 108 | ReadStage-1 | Executing single-partition query on data
19 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 191 | ReadStage-2 | Acquiring sstable references
20 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 163 | ReadStage-1 | Acquiring sstable references
21 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 217 | ReadStage-2 | Merging memtable contents
22 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 202 | ReadStage-1 | Merging memtable contents
23 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 247 | ReadStage-2 | Bloom filter allows skipping sstable 2687
24 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 265 | ReadStage-1 | Bloom filter allows skipping sstable 1872
25 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 274 | ReadStage-2 | Key cache hit for sstable 2683
26 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 293 | ReadStage-1 | Bloom filter allows skipping sstable 1867
27 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 368 | ReadStage-2 | Read 1 live and 0 tombstone cells
28 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 323 | ReadStage-1 | Key cache hit for sstable 1863
29 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 389 | ReadStage-2 | Read 1 live and 0 tombstone cells
30 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 418 | ReadStage-1 | Read 1 live and 0 tombstone cells
31 |2018-03-06 18:29:15.354 +0000 UTC | restbase1014-b.eqiad.wmnet | 401 | ReadStage-2 | Enqueuing response to restbase1012-c.eqiad.wmnet.
32 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 438 | ReadStage-1 | Enqueuing response to restbase1012-c.eqiad.wmnet.
33 |2018-03-06 18:29:15.354 +0000 UTC | restbase1013-a.eqiad.wmnet | 497 | MessagingService-Outgoing-restbase1012-c.eqiad.wmnet/10.64.32.204-Small | Sending REQUEST_RESPONSE message to restbase1012-c.eqiad.wmnet/10.64.32.204
34 |2018-03-06 18:29:15.355 +0000 UTC | restbase1014-b.eqiad.wmnet | 462 | MessagingService-Outgoing-restbase1012-c.eqiad.wmnet/10.64.32.204-Small | Sending REQUEST_RESPONSE message to restbase1012-c.eqiad.wmnet/10.64.32.204
35 |2018-03-06 18:29:15.355 +0000 UTC | restbase1012-c.eqiad.wmnet | 604717 | MessagingService-Incoming-/10.64.0.112 | REQUEST_RESPONSE message received from restbase1010-b.eqiad.wmnet.
36 |2018-03-06 18:29:15.356 +0000 UTC | restbase1012-c.eqiad.wmnet | 605178 | RequestResponseStage-16 | Processing response from restbase1010-b.eqiad.wmnet.
37 |2018-03-06 18:29:15.357 +0000 UTC | restbase1012-c.eqiad.wmnet | 607056 | MessagingService-Incoming-/10.64.32.80 | REQUEST_RESPONSE message received from restbase1013-a.eqiad.wmnet.
38 |2018-03-06 18:29:15.358 +0000 UTC | restbase1012-c.eqiad.wmnet | 607282 | RequestResponseStage-20 | Processing response from restbase1013-a.eqiad.wmnet.
39 |2018-03-06 18:29:15.362 +0000 UTC | restbase1012-c.eqiad.wmnet | 10 | MessagingService-Incoming-/10.64.48.133 | REQUEST_RESPONSE message received from restbase1014-b.eqiad.wmnet.
40 |2018-03-06 18:29:15.362 +0000 UTC | restbase1012-c.eqiad.wmnet | 96 | RequestResponseStage-9 | Processing response from restbase1014-b.eqiad.wmnet.
41 |2018-03-06 18:29:15.362 +0000 UTC | restbase1012-c.eqiad.wmnet | 312 | RequestResponseStage-9 | Initiating read-repair
eevans@restbase1007:~$

Event Timeline

Eevans changed the title of this paste from fa6d0170-219d-11e8-a28a-1d583f325411 to 45e329e0-216c-11e8-b786-237a199d4b45.
Eevans edited the content of this paste. (Show Details)