Page MenuHomePhabricator

Deprecate pre-datahub documentation about datasets
Open, LowPublic

Description

https://www.mediawiki.org/wiki/Wikimedia_Product/Data_dictionary was created before we had datahub.
It should ideally be deprecated to avoid having multiple sources of information.

Since these are core metrics, I'm assigning Movement-Insights team to handle this, after consulting with data users on Slack.

Event Timeline

While we can deprecate the superset section, we need to verify if Turnilo section is still relevant or not, since datahub is not synced with Turnilo?

image.png (1,153×791 px, 89 KB)

@Mayakp.wiki +1 to deprecating things when we have multiple, redundant sources. Just to confirm because I think DataHub is still a private tool: are any of these mediawiki resources things that we would need to share with volunteers (i.e. not redundant with DataHub)?

are any of these mediawiki resources things that we would need to share with volunteers (i.e. not redundant with DataHub)?

Hi @Isaac , I dont think so, because the datasets mentioned in the data dictionary are only accessible by WMF-NDA users.
For volunteers who have NDA access, I'll make sure that there is some documentation (on wikitech) and focus on removing only the redundant ones, like this unique devices info on wikitech and this one from the data dictionary which are pretty much the same.

There are some private db tables like content_edit_daily which are not on datahub, but are kinda deprecated because it was last updated in 2021.

@Mayakp.wiki thanks for confirming! If folks have NDA, then they should have datahub access so that works for me.

OSefu-WMF moved this task from Incoming to Backlog on the Movement-Insights board.