Page MenuHomePhabricator

Pingback - Locate and Access Existing Data
Closed, DeclinedPublic

Description

Current Situation:

  • The Grafana page we expected to have monthly Pingback data has none, even for someone who is properly logged in.
  • We don't have permission to log in.

Goal:

  • Access existing Pingback data

Acceptance Criteria:

  • Data located
  • Data accessible

Notes:

  • Per Leszek, data exists in hadoop; we need access to that, which is more restricted than Grafana
  • Andrew was previously able to access this - pick his brain

Event Timeline

RickiJay-WMDE changed the task status from Open to In Progress.May 17 2024, 3:07 PM

Leszek created https://phabricator.wikimedia.org/T365138 for adding permissions for at least Grafana.

TLDR the data is stored in the event store https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Events

SELECT * FROM "event_sanitized"."wikibasepingback"

There is a single entry from 2024-08-30T20:29:10Z for a site on 1.36.3

SELECT * FROM "event"."wikibasepingback"

There is no more recent data
(every month or so the data gets moved into the sanitized table.

WikibasePingback was never really pushed as a feature that people should turn on, and the data was never really inspected at all before since its inception.
I'm surprised the number of records is actually this low.
It could be that this event was never updated for changes to the events system? it could also just be that noone really ever enabled it