Page MenuHomePhabricator

Recently edited pages are not included in MediaWiki Content File Exports
Closed, DuplicatePublicBUG REPORT

Description

For the July dump of enwikt, there are about 14,000 pages missing from the MediaWiki Content File Exports that are included in the XML dump.

wget https://dumps.wikimedia.org/other/mediawiki_content_current/enwiktionary/2026-07-01/xml/bzip2/enwiktionary-2026-07-01-p6p11794195.xml.bz2
wget https://dumps.wikimedia.org/enwiktionary/20260701/enwiktionary-20260701-pages-articles.xml.bz2
bzcat enwiktionary-2026-07-01-p6p11794195.xml.bz2 | grep '^    <title>' | grep -v ':' > enwiktionary-2026-07-01-p6p11794195.xml.bz2.allpages
bzcat enwiktionary-20260701-pages-articles.xml.bz2 | grep '^    <title>' | grep -v ':' > enwiktionary-20260701-pages-articles.xml.bz2.allpages
wc -l *allpages
  8875844 enwiktionary-2026-07-01-p6p11794195.xml.bz2.allpages
  8890057 enwiktionary-20260701-pages-articles.xml.bz2.allpages

First 10 missing pages, all edited on or after July 1:

diff enwiktionary-2026-07-01-p6p11794195.xml.bz2.allpages enwiktionary-20260701-pages-articles.xml.bz2.allpages | grep "^>" | head
>     <title>A</title>
>     <title>elephant</title>
>     <title>December</title>
>     <title>may</title>
>     <title>September</title>
>     <title>November</title>
>     <title>trade</title>
>     <title>name</title>
>     <title>fa</title>
>     <title>a-</title>

Previously reported alongside a separate issue in T417596