Page MenuHomePhabricator

Manually update metrics spreadsheet with latest data from metrics db
Closed, ResolvedPublic

Description

Context

We created a spreadsheet of known instances ("Data in WBS Instances") and filled it with data manually. We are now automating the collection of much of this data, which means the spreadsheet is getting out of date/sync with our latest stats. Nonetheless, this spreadsheet remains the most accessible place for most people on the team to access this data.

Goal

update the spreadsheet with the latest data to bring the two sources into parity, where feasible.

Acceptance Criteria:

  • update existing columns w latest
  • figure out which data are missing from the spreadsheet (that are present in the database)
  • add in data missing in spreadsheet and fill w latest data from the database
  • where needed create new tabs to cover missing data

the data to add:

  • total items, lexemes, properties, triples
  • mediawiki major version, whether it's LTS
  • can we find the sparql endpoint? y/n
  • user counts for last month (human, bot, total log)
  • connectivity stats (specifically: Total Connections, avg distance, Connectivity)

also add, but likely need their own tabs in the sheet:

  • property popularity
  • extension data

Event Timeline

jon_amar-WMDE renamed this task from Update working spreadsheet with latest automated data to Update working spreadsheet with latest data from metrics db.Jul 12 2024, 7:21 PM
jon_amar-WMDE renamed this task from Update working spreadsheet with latest data from metrics db to Update metrics spreadsheet with latest data from metrics db.Jul 12 2024, 7:32 PM
jon_amar-WMDE renamed this task from Update metrics spreadsheet with latest data from metrics db to Manually update metrics spreadsheet with latest data from metrics db.

@RickiJay-WMDE jfyi considering our desire to use sheets as our main dashboard for the MVP, I reviewed some of the data points in the db and updated the list of data to get into the sheet. see main notes on ticket.

RickiJay-WMDE changed the subtype of this task from "Spike" to "Task".Aug 21 2024, 8:55 PM