Page MenuHomePhabricator
Create Task
Maniphest T230792

Create Parsoid/PHP tables in Cassandra
Closed, ResolvedPublic
Actions

Description

We need another set of tables in order to store/retrieve Parsoid/PHP HTML alongside the existing Parsoid/JS. These new buckets will be named parsoidphp and parsoidphp-stash, respectively (better naming ideas welcomed).

parsoidphpparsoidphp-stash
enwikienwiki_T_parsoidphpenwiki_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw
commonscommons_T_parsoidphpcommons_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw
wikipediawikipedia_T_parsoidphpwikipedia_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnF
othersothers_T_parsoidphpothers_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw

Related Objects
Search...

Event Timeline

• mobrovac created this task.Aug 20 2019, 11:50 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 20 2019, 11:50 AM
• mobrovac added a comment.Aug 20 2019, 12:25 PM

Here are the creation statements:

P8938 RESTBase Parsoid/PHP tables
1###
2## `others` STORAGE GROUP BLOCK
3###
4
5# parsoidphp-stash
6create_others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
7 statement: |
8 CREATE KEYSPACE IF NOT EXISTS "others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw"
9 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
10
11create_meta_others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
12 statement: |
13 CREATE TABLE IF NOT EXISTS "others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".meta (
14 key text PRIMARY KEY,
15 value text
16 ) WITH bloom_filter_fp_chance = 0.1
17 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
18 AND comment = ''
19 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
20 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
21 AND crc_check_chance = 1.0
22 AND dclocal_read_repair_chance = 0.1
23 AND default_time_to_live = 0
24 AND gc_grace_seconds = 864000
25 AND max_index_interval = 2048
26 AND memtable_flush_period_in_ms = 0
27 AND min_index_interval = 128
28 AND read_repair_chance = 0.0
29 AND speculative_retry = '99PERCENTILE';
30
31create_data_others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
32 statement: |
33 CREATE TABLE IF NOT EXISTS "others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".data (
34 "_domain" text,
35 key text,
36 headers text,
37 tid timeuuid,
38 value blob,
39 PRIMARY KEY (("_domain", key))
40 ) WITH bloom_filter_fp_chance = 0.01
41 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
42 AND comment = ''
43 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
44 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
45 AND crc_check_chance = 1.0
46 AND dclocal_read_repair_chance = 0.1
47 AND default_time_to_live = 86400
48 AND gc_grace_seconds = 864000
49 AND max_index_interval = 2048
50 AND memtable_flush_period_in_ms = 0
51 AND min_index_interval = 128
52 AND read_repair_chance = 0.0
53 AND speculative_retry = '99PERCENTILE';
54
55# parsoidphp
56create_others_T_parsoidphp:
57 statement: |
58 CREATE KEYSPACE IF NOT EXISTS "others_T_parsoidphp"
59 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
60
61create_meta_others_T_parsoidphp:
62 statement: |
63 CREATE TABLE IF NOT EXISTS "others_T_parsoidphp".meta (
64 key text PRIMARY KEY,
65 value text
66 ) WITH bloom_filter_fp_chance = 0.1
67 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
68 AND comment = ''
69 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
70 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
71 AND crc_check_chance = 1.0
72 AND dclocal_read_repair_chance = 0.1
73 AND default_time_to_live = 0
74 AND gc_grace_seconds = 864000
75 AND max_index_interval = 2048
76 AND memtable_flush_period_in_ms = 0
77 AND min_index_interval = 128
78 AND read_repair_chance = 0.0
79 AND speculative_retry = '99PERCENTILE';
80
81create_data_others_T_parsoidphp:
82 statement: |
83 CREATE TABLE IF NOT EXISTS "others_T_parsoidphp".data (
84 "_domain" text,
85 key text,
86 headers text,
87 tid timeuuid,
88 value blob,
89 PRIMARY KEY (("_domain", key))
90 ) WITH bloom_filter_fp_chance = 0.01
91 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
92 AND comment = ''
93 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
94 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
95 AND crc_check_chance = 1.0
96 AND dclocal_read_repair_chance = 0.1
97 AND default_time_to_live = 0
98 AND gc_grace_seconds = 864000
99 AND max_index_interval = 2048
100 AND memtable_flush_period_in_ms = 0
101 AND min_index_interval = 128
102 AND read_repair_chance = 0.0
103 AND speculative_retry = '99PERCENTILE';
104
105
106###
107## `wikipedia` STORAGE GROUP BLOCK
108###
109
110# parsoidphp-stash
111create_wikipedia_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnF:
112 statement: |
113 CREATE KEYSPACE IF NOT EXISTS "wikipedia_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnF"
114 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
115
116create_meta_wikipedia_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnF:
117 statement: |
118 CREATE TABLE IF NOT EXISTS "wikipedia_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnF".meta (
119 key text PRIMARY KEY,
120 value text
121 ) WITH bloom_filter_fp_chance = 0.1
122 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
123 AND comment = ''
124 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
125 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
126 AND crc_check_chance = 1.0
127 AND dclocal_read_repair_chance = 0.1
128 AND default_time_to_live = 0
129 AND gc_grace_seconds = 864000
130 AND max_index_interval = 2048
131 AND memtable_flush_period_in_ms = 0
132 AND min_index_interval = 128
133 AND read_repair_chance = 0.0
134 AND speculative_retry = '99PERCENTILE';
135
136create_data_wikipedia_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnF:
137 statement: |
138 CREATE TABLE IF NOT EXISTS "wikipedia_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnF".data (
139 "_domain" text,
140 key text,
141 headers text,
142 tid timeuuid,
143 value blob,
144 PRIMARY KEY (("_domain", key))
145 ) WITH bloom_filter_fp_chance = 0.01
146 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
147 AND comment = ''
148 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
149 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
150 AND crc_check_chance = 1.0
151 AND dclocal_read_repair_chance = 0.1
152 AND default_time_to_live = 86400
153 AND gc_grace_seconds = 864000
154 AND max_index_interval = 2048
155 AND memtable_flush_period_in_ms = 0
156 AND min_index_interval = 128
157 AND read_repair_chance = 0.0
158 AND speculative_retry = '99PERCENTILE';
159
160# parsoidphp
161create_wikipedia_T_parsoidphp:
162 statement: |
163 CREATE KEYSPACE IF NOT EXISTS "wikipedia_T_parsoidphp"
164 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
165
166create_meta_wikipedia_T_parsoidphp:
167 statement: |
168 CREATE TABLE IF NOT EXISTS "wikipedia_T_parsoidphp".meta (
169 key text PRIMARY KEY,
170 value text
171 ) WITH bloom_filter_fp_chance = 0.1
172 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
173 AND comment = ''
174 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
175 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
176 AND crc_check_chance = 1.0
177 AND dclocal_read_repair_chance = 0.1
178 AND default_time_to_live = 0
179 AND gc_grace_seconds = 864000
180 AND max_index_interval = 2048
181 AND memtable_flush_period_in_ms = 0
182 AND min_index_interval = 128
183 AND read_repair_chance = 0.0
184 AND speculative_retry = '99PERCENTILE';
185
186create_data_wikipedia_T_parsoidphp:
187 statement: |
188 CREATE TABLE IF NOT EXISTS "wikipedia_T_parsoidphp".data (
189 "_domain" text,
190 key text,
191 headers text,
192 tid timeuuid,
193 value blob,
194 PRIMARY KEY (("_domain", key))
195 ) WITH bloom_filter_fp_chance = 0.01
196 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
197 AND comment = ''
198 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
199 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
200 AND crc_check_chance = 1.0
201 AND dclocal_read_repair_chance = 0.1
202 AND default_time_to_live = 0
203 AND gc_grace_seconds = 864000
204 AND max_index_interval = 2048
205 AND memtable_flush_period_in_ms = 0
206 AND min_index_interval = 128
207 AND read_repair_chance = 0.0
208 AND speculative_retry = '99PERCENTILE';
209
210
211###
212## `commons` STORAGE GROUP BLOCK
213###
214
215# parsoidphp-stash
216create_commons_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
217 statement: |
218 CREATE KEYSPACE IF NOT EXISTS "commons_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw"
219 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
220
221create_meta_commons_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
222 statement: |
223 CREATE TABLE IF NOT EXISTS "commons_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".meta (
224 key text PRIMARY KEY,
225 value text
226 ) WITH bloom_filter_fp_chance = 0.1
227 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
228 AND comment = ''
229 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
230 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
231 AND crc_check_chance = 1.0
232 AND dclocal_read_repair_chance = 0.1
233 AND default_time_to_live = 0
234 AND gc_grace_seconds = 864000
235 AND max_index_interval = 2048
236 AND memtable_flush_period_in_ms = 0
237 AND min_index_interval = 128
238 AND read_repair_chance = 0.0
239 AND speculative_retry = '99PERCENTILE';
240
241create_data_commons_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
242 statement: |
243 CREATE TABLE IF NOT EXISTS "commons_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".data (
244 "_domain" text,
245 key text,
246 headers text,
247 tid timeuuid,
248 value blob,
249 PRIMARY KEY (("_domain", key))
250 ) WITH bloom_filter_fp_chance = 0.01
251 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
252 AND comment = ''
253 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
254 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
255 AND crc_check_chance = 1.0
256 AND dclocal_read_repair_chance = 0.1
257 AND default_time_to_live = 86400
258 AND gc_grace_seconds = 864000
259 AND max_index_interval = 2048
260 AND memtable_flush_period_in_ms = 0
261 AND min_index_interval = 128
262 AND read_repair_chance = 0.0
263 AND speculative_retry = '99PERCENTILE';
264
265# parsoidphp
266create_commons_T_parsoidphp:
267 statement: |
268 CREATE KEYSPACE IF NOT EXISTS "commons_T_parsoidphp"
269 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
270
271create_meta_commons_T_parsoidphp:
272 statement: |
273 CREATE TABLE IF NOT EXISTS "commons_T_parsoidphp".meta (
274 key text PRIMARY KEY,
275 value text
276 ) WITH bloom_filter_fp_chance = 0.1
277 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
278 AND comment = ''
279 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
280 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
281 AND crc_check_chance = 1.0
282 AND dclocal_read_repair_chance = 0.1
283 AND default_time_to_live = 0
284 AND gc_grace_seconds = 864000
285 AND max_index_interval = 2048
286 AND memtable_flush_period_in_ms = 0
287 AND min_index_interval = 128
288 AND read_repair_chance = 0.0
289 AND speculative_retry = '99PERCENTILE';
290
291create_data_commons_T_parsoidphp:
292 statement: |
293 CREATE TABLE IF NOT EXISTS "commons_T_parsoidphp".data (
294 "_domain" text,
295 key text,
296 headers text,
297 tid timeuuid,
298 value blob,
299 PRIMARY KEY (("_domain", key))
300 ) WITH bloom_filter_fp_chance = 0.01
301 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
302 AND comment = ''
303 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
304 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
305 AND crc_check_chance = 1.0
306 AND dclocal_read_repair_chance = 0.1
307 AND default_time_to_live = 0
308 AND gc_grace_seconds = 864000
309 AND max_index_interval = 2048
310 AND memtable_flush_period_in_ms = 0
311 AND min_index_interval = 128
312 AND read_repair_chance = 0.0
313 AND speculative_retry = '99PERCENTILE';
314
315
316###
317## `enwiki` STORAGE GROUP BLOCK
318###
319
320# parsoidphp-stash
321create_enwiki_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
322 statement: |
323 CREATE KEYSPACE IF NOT EXISTS "enwiki_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw"
324 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
325
326create_meta_enwiki_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
327 statement: |
328 CREATE TABLE IF NOT EXISTS "enwiki_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".meta (
329 key text PRIMARY KEY,
330 value text
331 ) WITH bloom_filter_fp_chance = 0.1
332 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
333 AND comment = ''
334 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
335 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
336 AND crc_check_chance = 1.0
337 AND dclocal_read_repair_chance = 0.1
338 AND default_time_to_live = 0
339 AND gc_grace_seconds = 864000
340 AND max_index_interval = 2048
341 AND memtable_flush_period_in_ms = 0
342 AND min_index_interval = 128
343 AND read_repair_chance = 0.0
344 AND speculative_retry = '99PERCENTILE';
345
346create_data_enwiki_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
347 statement: |
348 CREATE TABLE IF NOT EXISTS "enwiki_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".data (
349 "_domain" text,
350 key text,
351 headers text,
352 tid timeuuid,
353 value blob,
354 PRIMARY KEY (("_domain", key))
355 ) WITH bloom_filter_fp_chance = 0.01
356 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
357 AND comment = ''
358 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
359 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
360 AND crc_check_chance = 1.0
361 AND dclocal_read_repair_chance = 0.1
362 AND default_time_to_live = 86400
363 AND gc_grace_seconds = 864000
364 AND max_index_interval = 2048
365 AND memtable_flush_period_in_ms = 0
366 AND min_index_interval = 128
367 AND read_repair_chance = 0.0
368 AND speculative_retry = '99PERCENTILE';
369
370# parsoidphp
371create_enwiki_T_parsoidphp:
372 statement: |
373 CREATE KEYSPACE IF NOT EXISTS "enwiki_T_parsoidphp"
374 WITH replication = {'class': 'NetworkTopologyStrategy', 'codfw': '3', 'eqiad': '3'} AND durable_writes = true;
375
376create_meta_enwiki_T_parsoidphp:
377 statement: |
378 CREATE TABLE IF NOT EXISTS "enwiki_T_parsoidphp".meta (
379 key text PRIMARY KEY,
380 value text
381 ) WITH bloom_filter_fp_chance = 0.1
382 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
383 AND comment = ''
384 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
385 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
386 AND crc_check_chance = 1.0
387 AND dclocal_read_repair_chance = 0.1
388 AND default_time_to_live = 0
389 AND gc_grace_seconds = 864000
390 AND max_index_interval = 2048
391 AND memtable_flush_period_in_ms = 0
392 AND min_index_interval = 128
393 AND read_repair_chance = 0.0
394 AND speculative_retry = '99PERCENTILE';
395
396create_data_enwiki_T_parsoidphp:
397 statement: |
398 CREATE TABLE IF NOT EXISTS "enwiki_T_parsoidphp".data (
399 "_domain" text,
400 key text,
401 headers text,
402 tid timeuuid,
403 value blob,
404 PRIMARY KEY (("_domain", key))
405 ) WITH bloom_filter_fp_chance = 0.01
406 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
407 AND comment = ''
408 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
409 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
410 AND crc_check_chance = 1.0
411 AND dclocal_read_repair_chance = 0.1
412 AND default_time_to_live = 0
413 AND gc_grace_seconds = 864000
414 AND max_index_interval = 2048
415 AND memtable_flush_period_in_ms = 0
416 AND min_index_interval = 128
417 AND read_repair_chance = 0.0
418 AND speculative_retry = '99PERCENTILE';

They are analogous to the ones used for creating the simplified Parsoid tables T221528: Create new Parsoid tables.

@Eevans @Pchelolo please review.

• mobrovac mentioned this in T230791: Have a Mechanism for Storing and Retrieving Parsoid HTML from JS and PHP.Aug 20 2019, 12:27 PM
• Pchelolo added a comment.Aug 20 2019, 2:27 PM

LGTM. We will also need statements for creating tables in beta.

• mobrovac added a comment.Aug 20 2019, 3:04 PM
In T230792#5424813, @Pchelolo wrote:

LGTM. We will also need statements for creating tables in beta.

That's the others section in the paste above; the names are identical.

• Pchelolo added a comment.Aug 20 2019, 3:05 PM

That's the others section in the paste above; the names are identical.

Yes, but replication strategies are not.

• mobrovac added a comment.Aug 20 2019, 3:13 PM
In T230792#5425009, @Pchelolo wrote:

That's the others section in the paste above; the names are identical.

Yes, but replication strategies are not.

Excellent point. Here they are:

P8939 RESTBase Parsoid/PHP tables - Beta
1###
2## `others` STORAGE GROUP BLOCK
3###
4
5# parsoidphp-stash
6create_others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
7 statement: |
8 CREATE KEYSPACE IF NOT EXISTS "others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw"
9 WITH replication = {'class': 'NetworkTopologyStrategy', 'datacenter1': '3'} AND durable_writes = true;
10
11create_meta_others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
12 statement: |
13 CREATE TABLE IF NOT EXISTS "others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".meta (
14 key text PRIMARY KEY,
15 value text
16 ) WITH bloom_filter_fp_chance = 0.1
17 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
18 AND comment = ''
19 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
20 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
21 AND crc_check_chance = 1.0
22 AND dclocal_read_repair_chance = 0.1
23 AND default_time_to_live = 0
24 AND gc_grace_seconds = 864000
25 AND max_index_interval = 2048
26 AND memtable_flush_period_in_ms = 0
27 AND min_index_interval = 128
28 AND read_repair_chance = 0.0
29 AND speculative_retry = '99PERCENTILE';
30
31create_data_others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw:
32 statement: |
33 CREATE TABLE IF NOT EXISTS "others_T_parsoidphpAetaDBIXR_iWCeS5MknjkVQgnFw".data (
34 "_domain" text,
35 key text,
36 headers text,
37 tid timeuuid,
38 value blob,
39 PRIMARY KEY (("_domain", key))
40 ) WITH bloom_filter_fp_chance = 0.01
41 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
42 AND comment = ''
43 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
44 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
45 AND crc_check_chance = 1.0
46 AND dclocal_read_repair_chance = 0.1
47 AND default_time_to_live = 86400
48 AND gc_grace_seconds = 864000
49 AND max_index_interval = 2048
50 AND memtable_flush_period_in_ms = 0
51 AND min_index_interval = 128
52 AND read_repair_chance = 0.0
53 AND speculative_retry = '99PERCENTILE';
54
55# parsoidphp
56create_others_T_parsoidphp:
57 statement: |
58 CREATE KEYSPACE IF NOT EXISTS "others_T_parsoidphp"
59 WITH replication = {'class': 'NetworkTopologyStrategy', 'datacenter1': '3'} AND durable_writes = true;
60
61create_meta_others_T_parsoidphp:
62 statement: |
63 CREATE TABLE IF NOT EXISTS "others_T_parsoidphp".meta (
64 key text PRIMARY KEY,
65 value text
66 ) WITH bloom_filter_fp_chance = 0.1
67 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
68 AND comment = ''
69 AND compaction = {'class': 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy'}
70 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
71 AND crc_check_chance = 1.0
72 AND dclocal_read_repair_chance = 0.1
73 AND default_time_to_live = 0
74 AND gc_grace_seconds = 864000
75 AND max_index_interval = 2048
76 AND memtable_flush_period_in_ms = 0
77 AND min_index_interval = 128
78 AND read_repair_chance = 0.0
79 AND speculative_retry = '99PERCENTILE';
80
81create_data_others_T_parsoidphp:
82 statement: |
83 CREATE TABLE IF NOT EXISTS "others_T_parsoidphp".data (
84 "_domain" text,
85 key text,
86 headers text,
87 tid timeuuid,
88 value blob,
89 PRIMARY KEY (("_domain", key))
90 ) WITH bloom_filter_fp_chance = 0.01
91 AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
92 AND comment = ''
93 AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
94 AND compression = {'chunk_length_in_kb': '32', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
95 AND crc_check_chance = 1.0
96 AND dclocal_read_repair_chance = 0.1
97 AND default_time_to_live = 0
98 AND gc_grace_seconds = 864000
99 AND max_index_interval = 2048
100 AND memtable_flush_period_in_ms = 0
101 AND min_index_interval = 128
102 AND read_repair_chance = 0.0
103 AND speculative_retry = '99PERCENTILE';

Eevans triaged this task as Medium priority.Aug 20 2019, 3:21 PM
Eevans edited projects, added Platform Team Workboards (Clinic Duty Team); removed Platform Team Workboards (Green).
Eevans moved this task from Inbox to Ready (WIP:5) on the Platform Team Workboards (Clinic Duty Team) board.
Eevans added a comment.Aug 20 2019, 3:38 PM

LGTM

Eevans claimed this task.Aug 20 2019, 3:39 PM
Eevans moved this task from Ready (WIP:5) to Doing(WIP:5) on the Platform Team Workboards (Clinic Duty Team) board.
Stashbot added a comment.Aug 20 2019, 3:45 PM

Mentioned in SAL (#wikimedia-releng) [2019-08-20T15:45:40Z] <urandom> creating Parsoid/PHP storage schema in deployment-prep -- T230792

Stashbot added a comment.Aug 20 2019, 3:49 PM

Mentioned in SAL (#wikimedia-operations) [2019-08-20T15:49:35Z] <urandom> creating Parsoid/PHP storage schema in restbase-dev -- T230792

Eevans added a comment.Aug 20 2019, 3:54 PM

This has been applied to the deployment-prep and restbase-dev environment; Do you want to test before applying to production? Since the hardware replacements, that tends to go quickly/smoothly these days.

• mobrovac changed the task status from Open to Stalled.Aug 20 2019, 3:56 PM
In T230792#5425202, @Eevans wrote:

This has been applied to the deployment-prep and restbase-dev environment; Do you want to test before applying to production? Since the hardware replacements, that tends to go quickly/smoothly these days.

Wow that was fast! Thanks @Eevans . Let's not go to prod just yet, we have no code to test against currently, so let's wait until then.

Eevans moved this task from Doing(WIP:5) to Inbox on the Platform Team Workboards (Clinic Duty Team) board.Aug 20 2019, 4:00 PM
ssastry moved this task from Backlog to Non-parsing Team Work on the Parsoid-PHP board.Aug 29 2019, 3:29 PM
• mobrovac moved this task from Inbox to Backlog on the Platform Team Workboards (Clinic Duty Team) board.Sep 3 2019, 12:15 PM
• WDoranWMF moved this task from Backlog to Inbox on the Platform Team Workboards (Clinic Duty Team) board.Sep 11 2019, 5:39 PM
daniel moved this task from Inbox to Backlog on the Platform Team Workboards (Clinic Duty Team) board.Oct 8 2019, 9:57 AM
Stashbot added a comment.Oct 15 2019, 12:24 PM

Mentioned in SAL (#wikimedia-operations) [2019-10-15T12:24:44Z] <mobrovac> restbase add parsoidphp tables in prod - T230792

• mobrovac closed this task as Resolved.Oct 15 2019, 12:33 PM
• mobrovac moved this task from Backlog to Done on the Platform Team Workboards (Clinic Duty Team) board.

All of the tables now exist, resolving.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits