Page MenuHomePhabricator

Reduce size of analytics/superset/deploy.git Gerrit repo
Closed, ResolvedPublic

Description

The https://gerrit.wikimedia.org/g/analytics/superset/deploy/ repository takes 4.7GB on disk, that is certainly too large.

sudo -u gerrit2 git -C /srv/gerrit/git/analytics/superset/deploy.git count-objects -vH
count: 0
size: 0 bytes
in-pack: 4174
packs: 2
size-pack: 4.63 GiB
prune-packable: 0
garbage: 0
size-garbage: 0 bytes

The repository stores python wheels intended for deployment, example of largest files:

b0434aa4dd12   68MiB artifacts/buster/apache_superset-0.31.0rc20_wikimedia1-py3-none-any.whl
3942f93056dd   68MiB artifacts/buster/apache_superset-0.31.0rc18_wikimedia1-py3-none-any.whl
688abce80db1   68MiB artifacts/buster/apache_superset-0.31.0rc18_wikimedia1-py3-none-any.whl
1d2a977f591d   68MiB artifacts/buster/apache_superset-0.31.0rc18_wikimedia1-py3-none-any.whl
bf0ce5a620b2   61MiB artifacts/buster/pyarrow-0.17.1-cp37-cp37m-manylinux1_x86_64.whl
f9f58de049f0   60MiB artifacts/buster/pyarrow-0.16.0-cp37-cp37m-manylinux1_x86_64.whl
38c71cde8cef   56MiB artifacts/buster/pyarrow-0.15.1-cp37-cp37m-manylinux1_x86_64.whl
a07a6d5e7e0c   56MiB artifacts/buster/pyarrow-0.14.1-cp37-cp37m-manylinux1_x86_64.whl
268a5e7a9d34   54MiB artifacts/stretch/superset-0.26.3_wikimedia1-py3-none-any.whl
0bc71f6ce762   54MiB artifacts/stretch/superset-0.26.3_wikimedia1-py3-none-any.whl
7f9e42932693   54MiB artifacts/stretch/superset-0.26.3_wikimedia1-py3-none-any.whl
cdb6dc6ec7f6   54MiB artifacts/stretch/superset-0.26.3_wikimedia2-py3-none-any.whl
7497eece9b56   54MiB artifacts/stretch/superset-0.26.3_wikimedia2-py3-none-any.whl
5a8ffcbd45cd   53MiB artifacts/bullseye/apache_superset-3.1.0-py3-none-any.whl
d20d797847ec   53MiB artifacts/bullseye/apache_superset-3.1.0-py3-none-any.whl
edd76c62cc4a   53MiB artifacts/bullseye/apache_superset-3.1.0-py3-none-any.whl
eea43e71f7ec   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
e870e0aa6978   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
b9e7ac4fbbde   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
9ecb94f920ed   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
92b320ae0425   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
88f4501d9d8a   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
53d6bfd12bac   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
5341f12c7364   51MiB artifacts/buster/superset-0.29.0rc7-py3-none-any.whl
4a23ac175350   50MiB artifacts/stretch/superset-0.28.1-py3-none-any.whl
d4697a3397b1   50MiB artifacts/buster/apache_superset-0.31.0rc20_wikimedia1-py3-none-any.whl
c13b191ddd3c   49MiB artifacts/jessie/superset-0.20.6-py2-none-any.whl
4e974d2d2f56   49MiB artifacts/jessie/superset-0.20.6-py3-none-any.whl
baa7e6633625   49MiB artifacts/stretch/superset-0.26.3-py3-none-any.whl
ad162bf1af28   49MiB artifacts/stretch/superset-0.26.3-py3-none-any.whl
f679b3469579   47MiB artifacts/bullseye/apache_superset-3.0.2-py3-none-any.whl
7e027829a12f   46MiB artifacts/bullseye/apache_superset-2.1.1-py3-none-any.whl
5939d30e9c41   46MiB artifacts/bullseye/apache_superset-2.1.1-py3-none-any.whl
118ec8af32c1   46MiB artifacts/bullseye/apache_superset-2.1.1-py3-none-any.whl
38ef21f04034   46MiB artifacts/bullseye/apache_superset-2.1.1-py3-none-any.whl
b7d1ca05858b   46MiB artifacts/buster/apache_superset-0.36.0-py3-none-any.whl
dc0cbc183667   46MiB artifacts/buster/apache_superset-0.36.0-py3-none-any.whl
dac83bbc8fa3   46MiB artifacts/buster/apache_superset-0.36.0-py3-none-any.whl
b0c39570d7e5   46MiB artifacts/buster/apache_superset-0.36.0-py3-none-any.whl
3cda81f92d86   46MiB artifacts/buster/apache_superset-0.36.0-py3-none-any.whl
dc21a59bf632   46MiB artifacts/buster/apache_superset-0.36.0-py3-none-any.whl
0b98f794157a   46MiB artifacts/buster/apache_superset-0.36.0-py3-none-any.whl
2a10a809139f   45MiB artifacts/buster/apache_superset-0.32.0-py3-none-any.whl
eb0cbf76873f   44MiB artifacts/buster/apache_superset-0.31.0rc15-py3-none-any.whl
a03fbe2d5ceb   44MiB artifacts/buster/apache_superset-0.31.0rc15-py3-none-any.whl
f36040b0ec0e   43MiB artifacts/bullseye/apache_superset-2.0.1-py3-none-any.whl
33a52bfca80e   43MiB artifacts/bullseye/apache_superset-2.0.1-py3-none-any.whl

I suspect the repository might not be used anymore? I suspect it has been migrated to GitLab. Given it was used solely to store artifacts, I propose we delete it from Gerrit?

Event Timeline

I think we can delete it without any issue. @BTullis do you concur?

Agreed. Please feel free to delete it from Gerrit. We no longer need it. Thanks @hashar for checking.

The new version in GitLab only stores the pipeline config files, so we have a much lower footprint there, too.

Mentioned in SAL (#wikimedia-releng) [2025-10-28T10:32:29Z] <hashar> gerrit: deleted analytics/superset/deploy (4.7GB, no more used) # T406856

hashar claimed this task.

I have deleted the repository which freed some disk space and will make operating Gerrit slightly easier. Thank you for having taken the time to confirm the deletion :]