Page MenuHomePhabricator

Remove Parsoid-JS tables from Cassandra
Open, MediumPublic

Description

We're not going back to Parsoid-JS and the tables in Cassandra are now unreachable, so the can be dropped.

Event Timeline

Pchelolo created this task.Thu, Jan 9, 3:39 PM
Eevans triaged this task as Medium priority.Fri, Jan 10, 7:34 PM
Eevans updated the task description. (Show Details)

OK, here is what I propose applying; Review appreciated!

production
commons_T_parsoid
commons_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU
enwiki_T_parsoid
enwiki_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU
others_T_parsoid
others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU
wikipedia_T_parsoid
wikipedia_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU

1drop_commons_T_parsoid:
2 statement: |
3 DROP KEYSPACE IF EXISTS "commons_T_parsoid"
4
5drop_commons_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
6 statement: |
7 DROP KEYSPACE IF EXISTS "commons_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"
8
9drop_enwiki_T_parsoid:
10 statement: |
11 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid"
12
13drop_enwiki_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
14 statement: |
15 DROP KEYSPACE IF EXISTS "enwiki_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"
16
17drop_others_T_parsoid:
18 statement: |
19 DROP KEYSPACE IF EXISTS "others_T_parsoid"
20
21drop_others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
22 statement: |
23 DROP KEYSPACE IF EXISTS "others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"
24
25drop_wikipedia_T_parsoid:
26 statement: |
27 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid"
28
29drop_wikipedia_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
30 statement: |
31 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"

dev
commons_T_parsoid
commons_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU
commons_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04
commons_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy
commons_T_parsoid__ng_html
commons_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0
commons_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLO
commons_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH
commons_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv
enwiki_T_parsoid
enwiki_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU
enwiki_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04
enwiki_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy8
enwiki_T_parsoid__ng_html
enwiki_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0
enwiki_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLOQ
enwiki_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH5
enwiki_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv1
others_T_parsoid
others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU
others_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04
others_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy8
others_T_parsoid__ng_html
others_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0
others_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLOQ
others_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH5
others_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv1
wikipedia_T_parsoid
wikipedia_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU
wikipedia_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP
wikipedia_T_parsoid__ng_data2pfX88WDfxDffCFHoTUD
wikipedia_T_parsoid__ng_html
wikipedia_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWS
wikipedia_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJs
wikipedia_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PP
wikipedia_T_parsoid_stash_wikitextf0PBY8UXqY8Uui

1drop_commons_T_parsoid:
2 statement: |
3 DROP KEYSPACE IF EXISTS "commons_T_parsoid"
4
5drop_commons_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
6 statement: |
7 DROP KEYSPACE IF EXISTS "commons_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"
8
9drop_commons_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04:
10 statement: |
11 DROP KEYSPACE IF EXISTS "commons_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04"
12
13drop_commons_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy:
14 statement: |
15 DROP KEYSPACE IF EXISTS "commons_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy"
16
17drop_commons_T_parsoid__ng_html:
18 statement: |
19 DROP KEYSPACE IF EXISTS "commons_T_parsoid__ng_html"
20
21drop_commons_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0:
22 statement: |
23 DROP KEYSPACE IF EXISTS "commons_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0"
24
25drop_commons_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLO:
26 statement: |
27 DROP KEYSPACE IF EXISTS "commons_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLO"
28
29drop_commons_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH:
30 statement: |
31 DROP KEYSPACE IF EXISTS "commons_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH"
32
33drop_commons_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv:
34 statement: |
35 DROP KEYSPACE IF EXISTS "commons_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv"
36
37drop_enwiki_T_parsoid:
38 statement: |
39 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid"
40
41drop_enwiki_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
42 statement: |
43 DROP KEYSPACE IF EXISTS "enwiki_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"
44
45drop_enwiki_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04:
46 statement: |
47 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04"
48
49drop_enwiki_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy8:
50 statement: |
51 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy8"
52
53drop_enwiki_T_parsoid__ng_html:
54 statement: |
55 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid__ng_html"
56
57drop_enwiki_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0:
58 statement: |
59 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0"
60
61drop_enwiki_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLOQ:
62 statement: |
63 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLOQ"
64
65drop_enwiki_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH5:
66 statement: |
67 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH5"
68
69drop_enwiki_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv1:
70 statement: |
71 DROP KEYSPACE IF EXISTS "enwiki_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv1"
72
73drop_others_T_parsoid:
74 statement: |
75 DROP KEYSPACE IF EXISTS "others_T_parsoid"
76
77drop_others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
78 statement: |
79 DROP KEYSPACE IF EXISTS "others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"
80
81drop_others_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04:
82 statement: |
83 DROP KEYSPACE IF EXISTS "others_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP04"
84
85drop_others_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy8:
86 statement: |
87 DROP KEYSPACE IF EXISTS "others_T_parsoid__ng_data2pfX88WDfxDffCFHoTUDoy8"
88
89drop_others_T_parsoid__ng_html:
90 statement: |
91 DROP KEYSPACE IF EXISTS "others_T_parsoid__ng_html"
92
93drop_others_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0:
94 statement: |
95 DROP KEYSPACE IF EXISTS "others_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWSp0"
96
97drop_others_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLOQ:
98 statement: |
99 DROP KEYSPACE IF EXISTS "others_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJsLOQ"
100
101drop_others_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH5:
102 statement: |
103 DROP KEYSPACE IF EXISTS "others_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PPlH5"
104
105drop_others_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv1:
106 statement: |
107 DROP KEYSPACE IF EXISTS "others_T_parsoid_stash_wikitextf0PBY8UXqY8UuiDv1"
108
109drop_wikipedia_T_parsoid:
110 statement: |
111 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid"
112
113drop_wikipedia_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
114 statement: |
115 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"
116
117drop_wikipedia_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP:
118 statement: |
119 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid__ng_4iO7iu2BPZmvx5_7kxNNNqVP"
120
121drop_wikipedia_T_parsoid__ng_data2pfX88WDfxDffCFHoTUD:
122 statement: |
123 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid__ng_data2pfX88WDfxDffCFHoTUD"
124
125drop_wikipedia_T_parsoid__ng_html:
126 statement: |
127 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid__ng_html"
128
129drop_wikipedia_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWS:
130 statement: |
131 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid__ngwEOh2HlqL6lr8QbNVKv1eSoWS"
132
133drop_wikipedia_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJs:
134 statement: |
135 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid_stash_dataWH8IDUS9SGI6LPpsJs"
136
137drop_wikipedia_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PP:
138 statement: |
139 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid_stash_htmlmXxc_uDhgnFQAdM8PP"
140
141drop_wikipedia_T_parsoid_stash_wikitextf0PBY8UXqY8Uui:
142 statement: |
143 DROP KEYSPACE IF EXISTS "wikipedia_T_parsoid_stash_wikitextf0PBY8UXqY8Uui"

NOTE: Yikes; This environment must be really out of date!
deployment-prep
others_T_parsoid
others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU

1drop_others_T_parsoid:
2 statement: |
3 DROP KEYSPACE IF EXISTS "others_T_parsoid"
4
5drop_others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU:
6 statement: |
7 DROP KEYSPACE IF EXISTS "others_T_parsoidd3o5Dn1wcj_Xve2tXe4_rtmeWSU"

Mentioned in SAL (#wikimedia-operations) [2020-01-10T20:03:37Z] <urandom> drop legacy Parsoid/JS storage keyspaces, production env -- T242344

Eevans added a comment.EditedFri, Jan 10, 8:27 PM

The tables have been dropped in all 3 environments. The only thing remaining is to clear the snapshots (and actually reclaim the space). Out of an abundance of caution, I'll sit on this for a couple days and close the ticket once complete.

One additional thing worth noting: The restrouter deployment in k8s still has code deployed that connects to these tables, and it is now in a failed state. This isn't used in production anywhere so doesn't present an immediate problem. I'll open a separate issue with serviceops to figure out next steps.