Need to plan out the way we want to ingest Wikidata so we can start scoping it out and putting into tickets.
Context:
In the future, we are exploring adding Wikidata to the streams, hourly diffs, and daily exports. Wikimedia Enterprise users use Wikidata alongside the other Wikimedia projects to baseline their knowledge graphs. First step of this process is to figure out how we could reliably ingest and receive Wikidata (and it's scale) into our infrastructure to inevitably bundle into these different data feeds.
More info: https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Adding_Wikidata_to_Wikimedia_Enterprise
To Do:
- update architecture diagram
- create tickets in backlog
- figure out schema