Current sizes as of 7th July:

wikidata

-rw-r--r-- 1 dump dump 644M Jul  7 06:21 dump.s8.2020-07-07--05-55-29/wikidatawiki.cu_changes.00000.sql.gz
-rw-r--r-- 1 dump dump 655M Jul  7 06:21 dump.s8.2020-07-07--05-55-29/wikidatawiki.cu_changes.00001.sql.gz
-rw-r--r-- 1 dump dump 649M Jul  7 06:21 dump.s8.2020-07-07--05-55-29/wikidatawiki.cu_changes.00002.sql.gz
-rw-r--r-- 1 dump dump 638M Jul  7 06:22 dump.s8.2020-07-07--05-55-29/wikidatawiki.cu_changes.00003.sql.gz

commonswiki

-rw-r--r-- 1 dump dump 1.1G Jul  7 02:25 dump.s4.2020-07-07--02-00-08/commonswiki.cu_changes.00000.sql.gz

enwiki

-rw-r--r-- 1 dump dump 1.4G Jul  7 02:57 dump.s1.2020-07-07--02-30-21/enwiki.cu_changes.sql.gz

@Huji Is there a similar task for tracking table bloat from login attempts data?

@Niharika not yet. We are still two steps away from that data getting into CU tables (step one, step two). Also, that feature will be initially turned on for a small subset of wikis, so we will have to do a more targeted evaluation of DB size growth. Lastly, we don't want that feature to be enabled within the next 2-3 weeks (not that it would, anyway) because those select wikis will then have two features enabled in close proximity in time, and monitoring their data growth will cause confusion.

In T257223#6293268, @Huji wrote:

@Niharika not yet. We are still two steps away from that data getting into CU tables (step one, step two). Also, that feature will be initially turned on for a small subset of wikis, so we will have to do a more targeted evaluation of DB size growth. Lastly, we don't want that feature to be enabled within the next 2-3 weeks (not that it would, anyway) because those select wikis will then have two features enabled in close proximity in time, and monitoring their data growth will cause confusion.

Got it. Thank you for clarifying.

@Marostegui can I ask you to provide an update every Tuesday?

Will do my best!

14th July:

-rw-r--r-- 1 dump dump 1.1G Jul 14 00:46 dump.s4.2020-07-14--00-20-39/commonswiki.cu_changes.00000.sql.gz


-rw-r--r-- 1 dump dump 640M Jul 14 03:56 dump.s8.2020-07-14--03-29-39/wikidatawiki.cu_changes.00000.sql.gz
-rw-r--r-- 1 dump dump 654M Jul 14 03:55 dump.s8.2020-07-14--03-29-39/wikidatawiki.cu_changes.00001.sql.gz
-rw-r--r-- 1 dump dump 645M Jul 14 03:56 dump.s8.2020-07-14--03-29-39/wikidatawiki.cu_changes.00002.sql.gz
-rw-r--r-- 1 dump dump 642M Jul 14 03:55 dump.s8.2020-07-14--03-29-39/wikidatawiki.cu_changes.00003.sql.gz



-rw-r--r-- 1 dump dump 1.4G Jul 14 01:18 dump.s1.2020-07-14--00-52-21/enwiki.cu_changes.sql.gz

21st July:

-rw-r--r-- 1 dump dump 1.1G Jul 21 00:26 dump.s4.2020-07-21--00-00-01/commonswiki.cu_changes.00000.sql.gz


-rw-r--r-- 1 dump dump 632M Jul 21 00:25 dump.s8.2020-07-21--00-00-01/wikidatawiki.cu_changes.00000.sql.gz
-rw-r--r-- 1 dump dump 645M Jul 21 00:26 dump.s8.2020-07-21--00-00-01/wikidatawiki.cu_changes.00001.sql.gz
-rw-r--r-- 1 dump dump 635M Jul 21 00:26 dump.s8.2020-07-21--00-00-01/wikidatawiki.cu_changes.00002.sql.gz
-rw-r--r-- 1 dump dump 642M Jul 21 00:26 dump.s8.2020-07-21--00-00-01/wikidatawiki.cu_changes.00003.sql.gz

-rw-r--r-- 1 dump dump 1.4G Jul 21 01:15 dump.s1.2020-07-21--00-49-29/enwiki.cu_changes.sql.gz

@Marostegui is it okay that we are looking at the GZipped file size? Could there be an edge case where the unzipped file size has grown significantly, but GZip has done such a fantastic job with the compression that the compressed file size had not changed by much?

We have some alerts on the backups that measure the delta between weekly backups and that has been working fine lately, so I wouldn't expect that to be an issue here. If we want to be double sure, I can also take a look at the uncompressed files.

Couldn't help it.

Oh well. When we get to the similar task that has to do with the addition of the login logs to the CU logs, I will make sure to call you for help with naming the task ;)

Just wanted to say thanks to everyone for the hard work

@Marostegui assuming that numbers you pull tomorrow are not drastically different than the last 3 weeks, we could mark this task as resolved; after all, our plan was to monitor this for about one month.

@Marostegui am I reading this right that none of the tables' compressed sizes changed, and other than 07-07->07-14 on wikidata, every week saw either a slight shrink or no change to the uncompressed size? I.e. the thanks data made basically no impact?

Correct, no noticiable impact on disk size

In T257223#6340333, @Marostegui wrote:

Thanks everyone!

I bet @Niharika would have appreciated it if you had written that as "Thanks everyone!" ;)

But seriously, thank you for taking the lead on this.

Haha. Thanks all! Great work here. :)