Page MenuHomePhabricator

[EPIC] Migrate selected R-based Wikidata products
Open, Needs TriagePublic

Description

What is this task?
This task is used for planning and organizing only.

Description of the main objective:

Milestones:
Phase 1: Evaluate

  • Understand the current state
  • Decision about Spark3 migration (high priority)
  • Document the dashboards
  • Evaluate the legacy data products (low priority)
  • Decisions about legacy data products (low priority)

For details see PRD

Links:
Wikidata Concepts Monitor: WDCM
https://wikidata-analytics.wmcloud.org/app/WDCM_OverviewDashboard
https://wikidata-analytics.wmcloud.org/app/WDCM_UsageDashboard
https://wikidata-analytics.wmcloud.org/app/WDCM_SemanticsDashboard
https://wikidata-analytics.wmcloud.org/app/WDCM_BiasesDashboard
https://wikidata-analytics.wmcloud.org/app/WDCM_GeoDashboard
https://wikidata-analytics.wmcloud.org/app/WDCM_SitelinksDashboard
https://wikidata-analytics.wmcloud.org/app/WDCM_TitlesDashboard
https://wikidata-analytics.wmcloud.org/app/WDCM_StatementsDashboard

Tools for Wikidata editors
https://wikidata-analytics.wmcloud.org/app/CuriousFacts
https://wikidata-analytics.wmcloud.org/app/CurrentEvents

Tools for Wictionary editors
https://wiktionary-analytics.wmcloud.org/Wiktionary_CognateDashboard (see for details T321666)

Other
https://wikidata-analytics.wmcloud.org/app/WikidataAnalytics
https://wikidata-analytics.wmcloud.org/app/WD_pageviewsPerNamespace
https://wikidata-analytics.wmcloud.org/app/WD_percentUsageDashboard
https://wikidata-analytics.wmcloud.org/app/WD_HumanEdits
https://wikidata-analytics.wmcloud.org/app/WD_GameReferenceHunt
https://wikidata-analytics.wmcloud.org/app/WD_Inequality
https://wikidata-analytics.wmcloud.org/app/WD_ExternalIdentifiersDashboard
https://wikidata-analytics.wmcloud.org/app/WD_LanguagesLandscape

Documentation of the codes can be found in the doc linked here.

Event Timeline

Manuel renamed this task from [EPIC] Save WDCM to [EPIC] Save our legacy products (WDCM and Cognate dashboard) .Mar 23 2023, 2:57 PM
Manuel moved this task from Incoming to Waiting Epics on the Wikidata Analytics board.
Manuel renamed this task from [EPIC] Save our legacy products (WDCM and Cognate dashboard) to [EPIC] Save our R-based Wikidata products .Apr 1 2023, 9:26 AM
Manuel updated the task description. (Show Details)
AndrewTavis_WMDE subscribed.

Added a link to the task description pointing people to the following doc where I've been documenting the code base: https://docs.google.com/document/d/1aYWcStCZySbKTKbHdFzb4n9ZBpBntIbSZsnd99nriuc/edit?usp=sharing

I was pointed to this ticket by @Lydia_Pintscher: I wanted to update a presentation slide that uses https://wikidata-analytics.wmcloud.org/app_direct/WD_ExternalIdentifiersDashboard (that’s the only dashboard I can remember using)

Hi @JeanFred 👋 Thanks for reaching out :)

I'm currently in the midst of trying to get external identifiers running locally at the moment, but I'm running into some problems that didn't occur with the rest of WDCM. Is there a date that you need the information by? I'm planning on sitting with a coworker tomorrow to look at it a bit more in depth.

Hi @JeanFred, the data source for the dashboards is still updating (for now). So you may be able to find the information that you are looking for here.

I am currently investigating which parts of the dashboards were actively used. So I would be curious about what data exactly was helpful for you on that dashboard.

Ah yes, good thought on that, @Manuel! Just didn't make the connection :) Thanks! :D

Manuel renamed this task from [EPIC] Save our R-based Wikidata products to [EPIC] Migrate our selected R-based Wikidata products .Jul 4 2023, 1:56 PM
Manuel updated the task description. (Show Details)
Manuel renamed this task from [EPIC] Migrate our selected R-based Wikidata products to [EPIC] Migrate selected R-based Wikidata products .Jul 4 2023, 2:07 PM
Manuel moved this task from Waiting Epics to Kanban on the Wikidata Analytics board.
Manuel edited projects, added Wikidata Analytics (Kanban); removed Wikidata Analytics.
Manuel moved this task from Incoming to WIP epics on the Wikidata Analytics (Kanban) board.

Hey @AndrewTavis_WMDE & @Manuel , I only used the dashboard to get a nice visualization of the external ID galaxy − see this slide (the red bubble is the video-game related IDs)

ExternalIds.png (768×1 px, 753 KB)

Thank you for your feedback! :)

Manuel renamed this task from [EPIC] Migrate selected R-based Wikidata products to [EPIC] Migrate selected R-based Wikidata products [up to milestone 3].Jul 7 2023, 9:19 PM
Manuel renamed this task from [EPIC] Migrate selected R-based Wikidata products [up to milestone 3] to [EPIC] Migrate selected R-based Wikidata products .Feb 7 2024, 11:45 PM
Manuel updated the task description. (Show Details)
Manuel updated the task description. (Show Details)