When deploying sub-referencing to dewiki, we want to run a campaign to raise awareness of the new feature and invite users to test it. We want to provide articles with lot's of potential sub-references as well as articles with just a few similar references which can be quickly converted to sub-references.

We need the list of articles beginning of September. The output could be similar to the similar refs samples in T367177.

Requirements

Metadata:

• Page title: title
• Links to each article (generated from title)
• Number of similar references per page: similar_ref_count
• Total number of references: identical_ref_count
• Number of re-used references per page: ref_reuse_counts

Formatted output:

• Ideally the output per page would be ready to use in an onwiki list of articles in the following format: * [https://de.wikipedia.org/wiki/Page_title?banner=subreferenzierung_info Page title] ([https://de.wikipedia.org/wiki/Page_title?veaction=edit&banner=subreferenzierung_info VisualEditor] | [https://de.wikipedia.org/wiki/Page_title?action=submit&banner=subreferenzierung_info Quelltext])

Output lists:

Random lists where at least 1/2 of the (= total - reuse) references are similar:

• Random list of 300 articles with 1 similar refs
• Random list of 300 articles with 2 - 5 similar refs.
• Random list of 300 articles with 10 - 30 similar refs.
• Random list of 300 articles with more than 100 similar refs.
• List of 300 highest similar refs.

Implementation

T402614: Write a script to filter scraper output and compile dewiki articles with similar refs