Hi @bd808 thanks for the response.
Fri, Nov 20
Thu, Nov 19
Wed, Nov 18
@Envlh I have made some calculations about how much space we may need in the future here. If you could please check the assumptions, that'd be good.
For reference, the WHGI snapshot data.
maximilianklein@whgi:~/snapshot_data$ du -sh . 75G .
Thanks. I will make a new quota request for a custom flavour for that other server. As far as this ticket goes, I believe it is complete.
Mon, Nov 16
Sun, Nov 15
Wed, Nov 11
@Envlh , see T267499 . In order to get more disk space we need to propose a custom size. Do remember the GB sizes of the different tables in denelezh? We're going to need much more since we'll be storing all our dump history as well. Maybe a better way to estimate is from the CSV sizes per week?
P.S. I am running a database on this new machine, which I expect to contain around 300-500GB of data to start. I know the flavour comes equipped with 160GB, and I read about how to enable the extra disk-space with the puppet role. What is the correct way to use more disk-space, for a database context, exceeding the flavour-definition? I can imagine putting it on the NFS (slow), or creating another volume in horizon (can't see how to do that in the interface or with wikitech). Please advise, thanks in advance.
Tue, Nov 10
Sun, Nov 8
Fri, Nov 6
Fri, Oct 30
Thu, Oct 29
Wed, Oct 28
Oct 17 2020
Oct 12 2020
Oct 8 2020
Oct 7 2020
Oct 5 2020
maybe try using https://flask-sqlalchemy-session.readthedocs.io/en/v1.1/
or diy with https://flask-sqlalchemy-session.readthedocs.io/en/v1.1/
Oct 2 2020
Oct 1 2020
Sep 28 2020
Sep 25 2020
Sep 23 2020
@Envlh do you use a dockerize image of mysql 8, or install it from package, or use a general cli-installer?
Sep 22 2020
Sep 13 2020
remaining items here: https://docs.google.com/document/d/1aXaeyL6sTWYVAs6lrgAnC9N2bvYwB5OBsjDZp6rVnBs/edit
Sep 12 2020
Definite requirement: transform KPI table from long to wide
Definite requirement: updated schema
- Can you explain the KPI quadruple loop is to generate every possible metric, is that correct? https://framagit.org/wikimedia-france/denelezh-core/-/blob/master/scripts/import.php#L113
- Which parts are slow?
- Which parts are you unhappy with?
Sep 11 2020
Definite requirement: Backfiller
Whatever the future schema is, allow previous data from WHGI and Denelezh to be filled in retroactively.
Definite Requirement: include whgi-needed data