Page MenuHomePhabricator
Feed Advanced Search

Oct 1 2018

Hall1467 added a comment to T205909: ORES command line service sometimes hangs.

I updated the ORES utility to 1.2.0 and rerun. It ran for a little bit and then hung for 20 minutes. I then hit control-c and received the following traceback:

Oct 1 2018, 9:27 PM · Machine-Learning-Team (Active Tasks), ORES
Hall1467 created T205909: ORES command line service sometimes hangs.
Oct 1 2018, 6:27 PM · Machine-Learning-Team (Active Tasks), ORES

Jun 8 2017

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

@Ladsgroup: I believe this is the only related open patch right now: https://gerrit.wikimedia.org/r/#/c/355104/. Is that right, @hoo?

Jun 8 2017, 10:45 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient

May 22 2017

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

@hoo: elwiki sounds good to me.

May 22 2017, 1:53 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient

Apr 12 2017

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

@jcrespo: Related to your first comment, the patch that I provided a link to (in my comment from one month ago) is now invalid since we are no longer planning on using a separate table in order to implement statement tracking. A new patch should be ready soon implementing statement tracking with wbc_entity_usage.

Apr 12 2017, 6:47 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient
Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

@jcrespo: We have decided to update the existing wbc_entity_usage table in order to allow for statement tracking (probably done via the "eu_aspect_id" field). We would do an initial deployment to a medium-sized Wikipedia at first and calculate database IO load. We will be able to undo any database changes made in this initial deployment, it will not affect current tracking being done in wbc_entity_usage. Three medium-sized Wikipedias that @hoo and I have considered for this deployment are :

Apr 12 2017, 4:41 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient

Mar 29 2017

Hall1467 added a comment to T158389: replica.my.cnf appears to not exist for my tool labs account.

@madhuvishy Yes, the file is there now. Thank you!

Mar 29 2017, 4:12 PM · Cloud-Services, Toolforge

Mar 7 2017

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

@jcrespo: Asking my question on here per your request.

Mar 7 2017, 6:35 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient
Hall1467 added a project to T151717: Usage tracking: record which statement group is used: DBA.
Mar 7 2017, 5:20 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient

Feb 17 2017

Hall1467 renamed T158389: replica.my.cnf appears to not exist for my tool labs account from replica.my.cnf does not exist for my tool labs account to replica.my.cnf appears to not exist for my tool labs account.
Feb 17 2017, 3:28 AM · Cloud-Services, Toolforge
Hall1467 created T158389: replica.my.cnf appears to not exist for my tool labs account.
Feb 17 2017, 3:26 AM · Cloud-Services, Toolforge

Dec 23 2016

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

To follow up on @Halfak's database usage assessments, the estimate of 5 properties per entity/page relationship seems reasonable and conservative since the average number of statements per entity is in fact ~5 as seen here: https://grafana.wikimedia.org/dashboard/db/wikidata-datamodel-statements (its worth noting the average is increasing). This assumes that most of the time, a Wikipedia page is referencing data from just its corresponding Wikidata entity.

Dec 23 2016, 2:32 AM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient

Dec 19 2016

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

If we choose to go the database route instead of EventLogging, my initial thoughts would be to create a new table containing (modeled after @Halfak's reference and the current entity usage documentation: https://github.com/wikimedia/mediawiki-extensions-Wikibase/blob/master/docs/usagetracking.wiki):

  • page_id(UNSIGNED INT) -- Wikipedia page using the entity's data
  • entity_id(UNSIGNED INT) -- the entity id
  • property_id(UNSIGNED INT) -- the property used by the entity
Dec 19 2016, 5:16 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient

Dec 15 2016

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

I'd be happy to take the lead on the implementation of this task. Would that be okay?

Dec 15 2016, 5:24 PM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient

Dec 14 2016

Hall1467 added a comment to T151717: Usage tracking: record which statement group is used.

I think a good way to go about this tracking would be by overriding the Lua direct access method for the table that represents the entity.

Dec 14 2016, 1:05 AM · Patch-For-Review, DBA, User-Daniel, Wikidata, MediaWiki-extensions-WikibaseClient