Currently, we release changes to our site and it can take up to 35 days to see the impact via the edits hourly table. It would be amazingly useful if we could see updates daily without writing custom script.
I recognize that the mediawiki history job is crunching 15 years of data, but perhaps we could reprocess a shorter period or less granular (the latest month or do daily counts instead of hourly) every 24hrs and stomach the impact on accuracy?
In the future we would like to do this but right now the edits data is generated on a monthly basis.
Hi! I just want to post here and say that since I've been using Turnilo, I definitely want this data to be updated more frequently -- even weekly would be a great improvement. My use case is that I check Turnilo to see how many suggested edits (based on edit tags) are being done in our target wikis.
@JKatzWMF @Tnegrin wanted to give you a heads up that this task has moved out of Analytics Engineering's backlog and falls under their work to make incremental updates available in the data lake (https://phabricator.wikimedia.org/T258511).
Marking as duplicate of T358877. edits + wikitext data is now available hourly and reconciled daily in the mediawiki_content_history.v1 table.