Page MenuHomePhabricator

Import about 10M values to personal wikibase instance
Closed, ResolvedPublic

Description

My attempts using pywikibot seem not quite fruitful

I was trying pywikibot in a asyncio.gather loop but it does not seem to run in parallel. Did anyone work with pywikibot in parallel? I need to make ~10M edits on my wikibase instance

Maybe
https://learningwikibase.com/data-import/

Event Timeline

Change 593884 had a related patch set uploaded (by Physikerwelt; owner: Physikerwelt):
[mediawiki/extensions/MathSearch@master] WIP: Importer for StackExchange posts

https://gerrit.wikimedia.org/r/593884

The wikibase part seems to work quite well with direct PHP access. But for the associated Flow Topics, it is more challenging. I guess I will copy the approach from the mass-message extension and generate fake API requests.

Change 593884 merged by jenkins-bot:
[mediawiki/extensions/MathSearch@master] Importer for StackExchange posts (step 1)

https://gerrit.wikimedia.org/r/593884

This is now part of MathSearch.