| OlehOnyshchcak | |
| Oct 22 2019, 12:11 PM |
| F30877980: pywikibot_bug.pdf | |
| Oct 24 2019, 12:41 PM |
Collect dataset of articles and corresponding images from Wikipedia's featured articles
Follow up tasks:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | OlehOnyshchcak | T236142 Evaluate existing multimodal learning methods for Wikipedia image recommendation [Master thesis] | |||
| Resolved | OlehOnyshchcak | T236146 [ImgRec UCU] Data Collection |
Sent email with found pywikibot bug for some articles (crashes and can't download some images)
FYI, Pywikibot uses Github only as a mirror. Wikimedia Phabricator is the issue tracker. See https://www.mediawiki.org/wiki/Manual:Pywikibot and https://www.mediawiki.org/wiki/How_to_report_a_bug
Created a truncated dataset for 500 articles(1.3 Gb) - https://www.kaggle.com/jacksoncrow/wiki-articles-multimodal
Full dataset for 5638 articles(14.2 Gb) is still uploading, will follow up with a link
Full dataset - https://drive.google.com/open?id=18i0D-N1J18UC1ebT9qbHZegKJQiKba5z
Will post a link with full dataset on Kagle.
Full dataset - https://www.kaggle.com/jacksoncrow/extended-wikipedia-multimodal-dataset
Full dataset with raw images - https://drive.google.com/file/d/1l0Oyv2Y6LmPGN3lP9MB6i8WWCinqkYPk/view?usp=sharing