Page MenuHomePhabricator

Re-add mwdumper builds to continuous integration / jenkins
Closed, ResolvedPublic

Description

mwdumper is a tool for filtering and converting MediaWiki export dumps from .xml format into either additional .xml dumps or .sql (either as a file or pumping it direct to MySQL).

It's an older tool I wrote in 2005, but is still in use, and gets maintenance from time to time.

Some while back, Jenkins was set up to make automatic builds, but those seem to have vanished. The commented-out reference from the manual page on wiki:

'''Current WMF builds''' are produced by jenkins; check the copy at [[download:tools/|download.wikimedia.org]] first, and for the absolute latest version check [https://integration.mediawiki.org/ci/view/Java/job/MWDumper-package/ the jenkins build].
You can find a mostly up-to-date build at https://integration.wikimedia.org/ci/view/Java/job/MWDumper-package/.

There no longer seems to be a Java CI job for MWDumper on our current setup. It has been created via T43634 and predate the use of Jenkins Job Builder.

Could we set this back up again? It builds via maven, should be super-easy to set up. :) Thanks!

The gerrit repo is mediawiki/tools/mwdumper.

Event Timeline

Change 287022 had a related patch set uploaded (by Hashar):
maven job for mediawiki/tools/mwdumper

https://gerrit.wikimedia.org/r/287022

Change 287022 merged by jenkins-bot:
maven job for mediawiki/tools/mwdumper

https://gerrit.wikimedia.org/r/287022

The beauty with maven is that it is well integrated in Jenkins and the lifecycle is straightforward: mvn clean package.

Crafted a job https://integration.wikimedia.org/ci/job/mwdumper-maven/ which triggers on patchset proposal and on CR+2 will get the change merged for you.

I gave it a try on https://gerrit.wikimedia.org/r/#/c/285004/2 and it worked just fine https://integration.wikimedia.org/ci/job/mwdumper-maven/2/

Analytics has a sprint to automatize release entirely (ie one click to build, sign and push to maven central). That is tracked by T130122 and @madhuvishy already did a lot on that front :-] Something to watch for mwdumper as well.

hashar claimed this task.