Page MenuHomePhabricator

Stop growth of text table by storing ES addresses in content table
Closed, ResolvedPublic

Description

First step in addressing the parent ticket. And at least reducing the growth rate of s1 and s8

Event Timeline

Ladsgroup triaged this task as Medium priority.Apr 15 2024, 5:25 PM
Ladsgroup created this task.
Ladsgroup moved this task from Triage to Ready on the DBA board.

Change #1020948 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[mediawiki/core@master] SqlBlobStore: Directly store ES addresses in content table

https://gerrit.wikimedia.org/r/1020948

Change #1020948 merged by jenkins-bot:

[mediawiki/core@master] SqlBlobStore: Directly store ES addresses in content table

https://gerrit.wikimedia.org/r/1020948

https://en.wikipedia.beta.wmflabs.org/w/index.php?title=BeforeEach-name-0.8802907327901288-I%C3%B1t%C3%ABrn%C3%A2ti%C3%B4n%C3%A0liz%C3%A6ti%C3%B8n&oldid=620186

MariaDB [enwiki]> select * from content where content_id = 547295;
+------------+--------------+---------------------------------+---------------+------------------------------------------+
| content_id | content_size | content_sha1                    | content_model | content_address                          |
+------------+--------------+---------------------------------+---------------+------------------------------------------+
|     547295 |           66 | lp53apdzyatqddqr5uvcrzn8cecx7m0 |             1 | es:DB://cluster1/692465?flags=utf-8,gzip |
+------------+--------------+---------------------------------+---------------+------------------------------------------+
1 row in set (0.001 sec)
root@deployment-db14:/srv/sqldata/enwiki# ls -l | grep -i text
-rw-r----- 1 mysql mysql       973 Feb 26 21:36 aft_article_answer_text.frm
-rw-r----- 1 mysql mysql     65536 Feb 26 21:32 aft_article_answer_text.ibd
-rw-r----- 1 mysql mysql      1001 Feb 26 21:36 text.frm
-rw-r----- 1 mysql mysql 432013312 May  4 19:21 text.ibd
-rw-r----- 1 mysql mysql      1001 Feb 26 21:36 unittest_external_text.frm
-rw-r----- 1 mysql mysql     65536 Feb 26 21:32 unittest_external_text.ibd

Everything works as expected.

Change #1028865 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[mediawiki/core@wmf/1.43.0-wmf.3] Partial cherry-pick of I9d8409fdbd757e

https://gerrit.wikimedia.org/r/1028865

Change #1028865 merged by jenkins-bot:

[mediawiki/core@wmf/1.43.0-wmf.3] Partial cherry-pick of I9d8409fdbd757e

https://gerrit.wikimedia.org/r/1028865

Mentioned in SAL (#wikimedia-operations) [2024-05-07T19:18:53Z] <jhuneidi@deploy1002> Started scap: Backport for [[gerrit:1028865|Partial cherry-pick of I9d8409fdbd757e (T361398 T362566)]]

Mentioned in SAL (#wikimedia-operations) [2024-05-07T19:21:29Z] <jhuneidi@deploy1002> ladsgroup and jhuneidi: Backport for [[gerrit:1028865|Partial cherry-pick of I9d8409fdbd757e (T361398 T362566)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-05-07T19:34:33Z] <jhuneidi@deploy1002> Finished scap: Backport for [[gerrit:1028865|Partial cherry-pick of I9d8409fdbd757e (T361398 T362566)]] (duration: 15m 39s)

Ladsgroup moved this task from In progress to Done on the DBA board.

Everything is fine. That's fishy. I close this ticket for now.