Alternatively we could provide extra interwiki prefixes for labs sites (if those don't exist already)... like beta-de (or so). That would also allow importing from labs.

Antoine: would this break any of the auto-fancy stuff like where we fetch an image from prod commons if we need it?

I have absolute no idea how interwikis are generated nor how they are cached. Maybe the interwiki.cdb file generated on beta uses the list of beta wikis and is thus up to date?

(In reply to Greg Grossmeier from comment #2)

Antoine: would this break any of the auto-fancy stuff like where we fetch an
image from prod commons if we need it?

That is done by setting $wgUseInstantCommons = true which has commons URL hardcoded directly in includes/Setup.php

if ( $wgUseInstantCommons ) {

$wgForeignFileRepos[] = array(
    'class' => 'ForeignAPIRepo',
    'name' => 'wikimediacommons',
    'apibase' => WebRequest::detectProtocol() === 'https' ?
        'https://commons.wikimedia.org/w/api.php' :
        'http://commons.wikimedia.org/w/api.php',
    ...
);

}

So the auto-fancy fetching of missing images will still work :]

(In reply to Antoine "hashar" Musso from comment #3)

I have absolute no idea how interwikis are generated nor how they are
cached. Maybe the interwiki.cdb file generated on beta uses the list of
beta wikis and is thus up to date?

No, it's the interwiki.cdb from production (it's taken out of the mediawiki-configuration repo)

It's probably easiest to just run the script on beta, create it as interwiki-labs.cdb, commit it...

if ( file_exists( "$wmfConfigDir/interwiki.cdb" ) ) {
	$wgInterwikiCache = "$wmfConfigDir/interwiki.cdb";
}

to

$iwCacheFile = getRealmSpecificFilename( "$wmfConfigDir/interwiki.cdb" );
if ( file_exists( $iwCacheFile ) ) {
	$wgInterwikiCache = $iwCacheFile;
}
unset( $iwCacheFile );

Should be trivial

https://gerrit.wikimedia.org/r/175755

The question is whether dumpInterwiki.php makes a file that's actually useful for labs... I'll have to have a look at what config it actually makes

We shouldn't be committing this to mediawiki-config, see also T75905

Change 175755 had a related patch set uploaded (by Greg Grossmeier):
Add interwiki-labs.cdb

https://gerrit.wikimedia.org/r/175755

Change 175755 merged by jenkins-bot:
Add interwiki-labs.cdb

https://gerrit.wikimedia.org/r/175755

Sorry for the silly question, but ... if that change has been deployed to the beta cluster, why hasnt the sitematrix and interwikimap updated?
Is there something else to be done, or is this a 'wait a while and it will fix itself' problem?
I note that https://noc.wikimedia.org/conf/interwiki-labs.cdb is currently a 403 Forbidden.

In T69931#1456102, @jayvdb wrote:

Sorry for the silly question, but ... if that change has been deployed to the beta cluster, why hasnt the sitematrix and interwikimap updated?

That change doesn't actually create the interwiki-labs.cdb in beta... Probably needs a labs-equivalent version of updateinterwikicache to be run on deployment-bastion?

In T69931#1456102, @jayvdb wrote:

I note that https://noc.wikimedia.org/conf/interwiki-labs.cdb is currently a 403 Forbidden.

Yeah, I doubt that's going to work as noc.wikimedia.org can only access the production mediawiki files. If we had a noc.wikimedia.beta.wmflabs.org it would only be able to show interwiki-labs.cdb rather than interwiki.cdb.

An interwiki.cdb for beta can't be generated (and expected to work correctly) until T75906 is fixed

Fwiw, the tasks depending on this task do not depend on the issues raised in T75906#1011937 , as Pywikibot only chokes on the fact that the beta interwikimap link the language prefixes to http://aa.wikipedia.org/ instead of http://aa.wikipedia.beta.wmflabs.org/ .

The JSON currently looks like this on beta:

{
    "query": {
        "interwikimap": [
            {
                "prefix": "aa",
                "local": "",
                "language": "Qaf\u00e1r af",
                "url": "http://aa.wikipedia.org/wiki/$1",
                "protorel": ""
            },
}

Would running updateinterwikicache now fix that?

We did run updateinterwikicache, and now there is an interwiki map (rather than nothing, and coming from interwiki-labs.cdb), but it has links to production sites, which I believe would be part of T75906.

Change 374922 had a related patch set uploaded (by Mattflaschen; owner: Mattflaschen):
[operations/mediawiki-config@master] Fix interwiki links on Labs

https://gerrit.wikimedia.org/r/374922

Now that interwiki.php is committed and the script works fine, this should be fine.

Change 374922 merged by jenkins-bot:
[operations/mediawiki-config@master] Fix interwiki links on Beta Cluster

https://gerrit.wikimedia.org/r/374922

Mentioned in SAL (#wikimedia-operations) [2017-08-31T18:51:51Z] <mattflaschen@tin> Synchronized wmf-config: Interwiki links on Beta Cluster: T69931 (duration: 00m 49s)

Mentioned in SAL (#wikimedia-operations) [2017-08-31T18:53:11Z] <mattflaschen@tin> Synchronized docroot/noc/conf/interwiki-labs.php.txt: Interwiki links on Beta Cluster: T69931 (duration: 00m 47s)