Page MenuHomePhabricator
Feed Advanced Search

Fri, Nov 20

notconfusing updated the task description for T263703: dev-ops - create server and mysql server.
Fri, Nov 20, 6:31 PM · Humaniki

Thu, Nov 19

notconfusing added a comment to T268190: Custom Flavour for Wikidumpparse Cloud VPS project.

Hi @bd808 thanks for the response.

Thu, Nov 19, 9:02 PM · cloud-services-team (Kanban), Humaniki, Cloud-VPS (Quota-requests)

Wed, Nov 18

notconfusing created T268190: Custom Flavour for Wikidumpparse Cloud VPS project.
Wed, Nov 18, 11:04 PM · cloud-services-team (Kanban), Humaniki, Cloud-VPS (Quota-requests)
notconfusing added a comment to T263703: dev-ops - create server and mysql server.

@Envlh I have made some calculations about how much space we may need in the future here. If you could please check the assumptions, that'd be good.

Wed, Nov 18, 7:06 PM · Humaniki
notconfusing added a comment to T263703: dev-ops - create server and mysql server.

For reference, the WHGI snapshot data.

maximilianklein@whgi:~/snapshot_data$ du -sh .
75G     .
Wed, Nov 18, 6:12 PM · Humaniki
notconfusing added a comment to T267499: Request increased quota for wikidumpparse Cloud VPS project.

Thanks. I will make a new quota request for a custom flavour for that other server. As far as this ticket goes, I believe it is complete.

Wed, Nov 18, 6:05 PM · Cloud-VPS (Quota-requests)

Mon, Nov 16

notconfusing updated the task description for T264825: backend extras.
Mon, Nov 16, 10:24 PM · Humaniki
notconfusing updated the task description for T263703: dev-ops - create server and mysql server.
Mon, Nov 16, 1:53 AM · Humaniki
notconfusing updated the task description for T263703: dev-ops - create server and mysql server.
Mon, Nov 16, 1:52 AM · Humaniki

Sun, Nov 15

notconfusing updated the task description for T267880: dump inserter.
Sun, Nov 15, 11:59 PM · Humaniki
notconfusing created T267880: dump inserter.
Sun, Nov 15, 10:11 PM · Humaniki
notconfusing updated the task description for T264825: backend extras.
Sun, Nov 15, 7:14 PM · Humaniki
notconfusing created T267875: advanced search f/e extras.
Sun, Nov 15, 7:13 PM · Humaniki
notconfusing updated the task description for T267423: metrics generation extras.
Sun, Nov 15, 4:34 PM · Humaniki

Wed, Nov 11

notconfusing added a comment to T263703: dev-ops - create server and mysql server.

@Envlh , see T267499 . In order to get more disk space we need to propose a custom size. Do remember the GB sizes of the different tables in denelezh? We're going to need much more since we'll be storing all our dump history as well. Maybe a better way to estimate is from the CSV sizes per week?

Wed, Nov 11, 10:57 PM · Humaniki
notconfusing added a comment to T267499: Request increased quota for wikidumpparse Cloud VPS project.

P.S. I am running a database on this new machine, which I expect to contain around 300-500GB of data to start. I know the flavour comes equipped with 160GB, and I read about how to enable the extra disk-space with the puppet role. What is the correct way to use more disk-space, for a database context, exceeding the flavour-definition? I can imagine putting it on the NFS (slow), or creating another volume in horizon (can't see how to do that in the interface or with wikitech). Please advise, thanks in advance.

Wed, Nov 11, 12:00 AM · Cloud-VPS (Quota-requests)

Tue, Nov 10

notconfusing added a comment to T267499: Request increased quota for wikidumpparse Cloud VPS project.

Thank you so much @Andrew and @Bstorm!

Tue, Nov 10, 10:35 PM · Cloud-VPS (Quota-requests)

Sun, Nov 8

notconfusing updated the task description for T263703: dev-ops - create server and mysql server.
Sun, Nov 8, 11:41 PM · Humaniki
notconfusing updated the task description for T263703: dev-ops - create server and mysql server.
Sun, Nov 8, 8:59 PM · Humaniki
notconfusing created T267499: Request increased quota for wikidumpparse Cloud VPS project.
Sun, Nov 8, 8:34 PM · Cloud-VPS (Quota-requests)

Fri, Nov 6

notconfusing updated the task description for T264825: backend extras.
Fri, Nov 6, 10:34 PM · Humaniki
notconfusing updated the task description for T264825: backend extras.
Fri, Nov 6, 6:27 PM · Humaniki
notconfusing created T267423: metrics generation extras.
Fri, Nov 6, 5:14 PM · Humaniki
notconfusing updated the task description for T264459: Schema extras.
Fri, Nov 6, 5:13 PM · Humaniki

Fri, Oct 30

notconfusing updated the task description for T266897: alpha release checklist.
Fri, Oct 30, 6:16 PM · Humaniki
notconfusing created T266897: alpha release checklist.
Fri, Oct 30, 6:15 PM · Humaniki
notconfusing updated the task description for T264654: Handle Fetching Data in Front End .
Fri, Oct 30, 6:12 PM · Humaniki
notconfusing updated the task description for T264650: API backend framework.
Fri, Oct 30, 2:23 PM · Humaniki

Thu, Oct 29

notconfusing updated the task description for T264459: Schema extras.
Thu, Oct 29, 12:25 AM · Humaniki
notconfusing moved T263703: dev-ops - create server and mysql server from beta backlog (mvp) to alpha backlog (mmvp) on the Humaniki board.
Thu, Oct 29, 12:20 AM · Humaniki
notconfusing moved T262719: Advanced Search View from beta backlog (mvp) to alpha backlog (mmvp) on the Humaniki board.
Thu, Oct 29, 12:20 AM · Humaniki
notconfusing moved T264377: metrics generation framework from beta backlog (mvp) to alpha backlog (mmvp) on the Humaniki board.
Thu, Oct 29, 12:19 AM · Humaniki
notconfusing updated the task description for T264650: API backend framework.
Thu, Oct 29, 12:18 AM · Humaniki

Wed, Oct 28

notconfusing updated the task description for T264825: backend extras.
Wed, Oct 28, 6:01 PM · Humaniki

Oct 17 2020

notconfusing updated the task description for T264825: backend extras.
Oct 17 2020, 9:53 PM · Humaniki
notconfusing updated the task description for T264825: backend extras.
Oct 17 2020, 9:53 PM · Humaniki

Oct 12 2020

notconfusing updated the task description for T264825: backend extras.
Oct 12 2020, 11:07 PM · Humaniki

Oct 8 2020

notconfusing updated the task description for T264377: metrics generation framework.
Oct 8 2020, 10:54 PM · Humaniki
notconfusing updated the task description for T264377: metrics generation framework.
Oct 8 2020, 4:49 PM · Humaniki
notconfusing updated the task description for T264825: backend extras.
Oct 8 2020, 4:48 PM · Humaniki
notconfusing updated the task description for T264650: API backend framework.
Oct 8 2020, 4:47 PM · Humaniki

Oct 7 2020

notconfusing created T264923: deployment extras.
Oct 7 2020, 6:16 PM · Humaniki
notconfusing updated the task description for T264825: backend extras.
Oct 7 2020, 6:15 PM · Humaniki
notconfusing updated the task description for T264825: backend extras.
Oct 7 2020, 2:05 AM · Humaniki
notconfusing updated the task description for T264825: backend extras.
Oct 7 2020, 12:49 AM · Humaniki
notconfusing created T264825: backend extras.
Oct 7 2020, 12:07 AM · Humaniki

Oct 5 2020

notconfusing added a comment to T264650: API backend framework.

maybe try using https://flask-sqlalchemy-session.readthedocs.io/en/v1.1/
or diy with https://flask-sqlalchemy-session.readthedocs.io/en/v1.1/

Oct 5 2020, 5:47 PM · Humaniki
notconfusing moved T264650: API backend framework from beta backlog (mvp) to In Progress on the Humaniki board.
Oct 5 2020, 5:10 PM · Humaniki
notconfusing created T264650: API backend framework.
Oct 5 2020, 5:10 PM · Humaniki
notconfusing moved T263699: Implement new Schema from In Progress to needs review on the Humaniki board.
Oct 5 2020, 4:32 PM · Humaniki
notconfusing triaged T264459: Schema extras as Medium priority.
Oct 5 2020, 4:29 PM · Humaniki
notconfusing updated the task description for T264459: Schema extras.
Oct 5 2020, 4:22 PM · Humaniki

Oct 2 2020

notconfusing closed T262351: Code review of Denelezh-import as Resolved.
Oct 2 2020, 6:10 PM · Humaniki
notconfusing moved T262711: Homepage View from In Progress to styling on the Humaniki board.
Oct 2 2020, 6:07 PM · CSS, Humaniki
notconfusing created T264459: Schema extras.
Oct 2 2020, 6:01 PM · Humaniki
notconfusing updated the task description for T263699: Implement new Schema.
Oct 2 2020, 6:00 PM · Humaniki
notconfusing updated the task description for T263699: Implement new Schema.
Oct 2 2020, 6:00 PM · Humaniki

Oct 1 2020

notconfusing created T264377: metrics generation framework.
Oct 1 2020, 10:47 PM · Humaniki

Sep 28 2020

notconfusing updated the task description for T263699: Implement new Schema.
Sep 28 2020, 10:46 PM · Humaniki
notconfusing updated the task description for T263699: Implement new Schema.
Sep 28 2020, 10:31 PM · Humaniki
notconfusing updated the task description for T263702: Orchestration.
Sep 28 2020, 6:20 PM · Humaniki

Sep 25 2020

notconfusing closed T262577: Gather potential requirements for next version of denelezh-import as Resolved.
Sep 25 2020, 5:52 PM · Humaniki
notconfusing updated the task description for T262995: Gender By Date of Birth View.
Sep 25 2020, 5:51 PM · CSS, JavaScript, Humaniki
notconfusing updated the task description for T263699: Implement new Schema.
Sep 25 2020, 5:49 PM · Humaniki
notconfusing updated the task description for T263703: dev-ops - create server and mysql server.
Sep 25 2020, 5:14 PM · Humaniki
notconfusing moved T263586: create or upgrade new virtual machine from beta backlog (mvp) to needs review on the Humaniki board.
Sep 25 2020, 5:14 PM · Humaniki
notconfusing closed T263586: create or upgrade new virtual machine as Resolved.
Sep 25 2020, 5:14 PM · Humaniki
notconfusing moved T263703: dev-ops - create server and mysql server from In Progress to beta backlog (mvp) on the Humaniki board.
Sep 25 2020, 5:11 PM · Humaniki
notconfusing renamed T263822: baked-in data from frontend compling as part of data-processing layer, enabling embedded data to baked-in data.
Sep 25 2020, 3:57 AM · Humaniki
notconfusing created T263822: baked-in data.
Sep 25 2020, 3:56 AM · Humaniki

Sep 23 2020

notconfusing added a comment to T263703: dev-ops - create server and mysql server.

@Envlh do you use a dockerize image of mysql 8, or install it from package, or use a general cli-installer?

Sep 23 2020, 10:34 PM · Humaniki
notconfusing renamed T263703: dev-ops - create server and mysql server from dev-ops to dev-ops - create server and mysql server.
Sep 23 2020, 10:32 PM · Humaniki
notconfusing set the point value for T263703: dev-ops - create server and mysql server to 3.
Sep 23 2020, 10:31 PM · Humaniki
notconfusing created T263703: dev-ops - create server and mysql server.
Sep 23 2020, 10:31 PM · Humaniki
notconfusing moved T263702: Orchestration from In Progress to beta backlog (mvp) on the Humaniki board.
Sep 23 2020, 10:30 PM · Humaniki
notconfusing claimed T263702: Orchestration.
Sep 23 2020, 10:30 PM · Humaniki
notconfusing created T263702: Orchestration.
Sep 23 2020, 10:30 PM · Humaniki
notconfusing updated the task description for T263699: Implement new Schema.
Sep 23 2020, 10:28 PM · Humaniki
notconfusing moved T263701: Backfiller from In Progress to beta backlog (mvp) on the Humaniki board.
Sep 23 2020, 10:27 PM · Internet-Archive, Humaniki
notconfusing created T263701: Backfiller.
Sep 23 2020, 10:27 PM · Internet-Archive, Humaniki
notconfusing moved T263700: WDTK Layer from In Progress to beta backlog (mvp) on the Humaniki board.
Sep 23 2020, 10:26 PM · Humaniki
notconfusing created T263700: WDTK Layer.
Sep 23 2020, 10:26 PM · Humaniki
notconfusing created T263699: Implement new Schema.
Sep 23 2020, 10:22 PM · Humaniki
notconfusing moved T262577: Gather potential requirements for next version of denelezh-import from beta backlog (mvp) to needs review on the Humaniki board.
Sep 23 2020, 10:20 PM · Humaniki

Sep 22 2020

notconfusing updated the task description for T262577: Gather potential requirements for next version of denelezh-import.
Sep 22 2020, 7:39 PM · Humaniki
notconfusing moved T262351: Code review of Denelezh-import from In Progress to needs review on the Humaniki board.
Sep 22 2020, 7:38 PM · Humaniki
notconfusing added a project to T263586: create or upgrade new virtual machine: Humaniki.
Sep 22 2020, 7:36 PM · Humaniki
notconfusing created T263586: create or upgrade new virtual machine.
Sep 22 2020, 7:36 PM · Humaniki
notconfusing renamed T262577: Gather potential requirements for next version of denelezh-import from Gathering potential requirements for next version of denelezh-import to Gather potential requirements for next version of denelezh-import.
Sep 22 2020, 1:16 AM · Humaniki

Sep 13 2020

notconfusing added a comment to T262577: Gather potential requirements for next version of denelezh-import.

remaining items here: https://docs.google.com/document/d/1aXaeyL6sTWYVAs6lrgAnC9N2bvYwB5OBsjDZp6rVnBs/edit

Sep 13 2020, 5:04 PM · Humaniki

Sep 12 2020

notconfusing added a comment to T262577: Gather potential requirements for next version of denelezh-import.

Definite requirement: transform KPI table from long to wide

Sep 12 2020, 7:22 PM · Humaniki
notconfusing added a comment to T262577: Gather potential requirements for next version of denelezh-import.

Definite requirement: updated schema

Sep 12 2020, 6:47 PM · Humaniki
notconfusing added a comment to T262351: Code review of Denelezh-import.
Sep 12 2020, 12:48 AM · Humaniki

Sep 11 2020

notconfusing updated the task description for T262577: Gather potential requirements for next version of denelezh-import.
Sep 11 2020, 9:27 PM · Humaniki
notconfusing updated the task description for T262577: Gather potential requirements for next version of denelezh-import.
Sep 11 2020, 9:26 PM · Humaniki
notconfusing added a comment to T262577: Gather potential requirements for next version of denelezh-import.

Definite requirement: Backfiller
Whatever the future schema is, allow previous data from WHGI and Denelezh to be filled in retroactively.

Sep 11 2020, 8:34 PM · Humaniki
notconfusing added a comment to T262577: Gather potential requirements for next version of denelezh-import.

Definite Requirement: include whgi-needed data

WHGI's https://github.com/notconfusing/Wikidata-Toolkit/blob/wigi/wdtk-examples/src/main/java/org/wikidata/wdtk/examples/GenderIndexProcessor.java
Sep 11 2020, 8:33 PM · Humaniki
notconfusing updated the task description for T262577: Gather potential requirements for next version of denelezh-import.
Sep 11 2020, 8:28 PM · Humaniki
notconfusing renamed T262577: Gather potential requirements for next version of denelezh-import from Requirements gathering for next version of denelezh-import to Gathering potential requirements for next version of denelezh-import.
Sep 11 2020, 8:26 PM · Humaniki
notconfusing set Due Date to Sep 16 2020, 7:00 AM on T262357: Create example data responses for f/e.
Sep 11 2020, 6:40 PM · Humaniki