Page MenuHomePhabricator

Enable sitemaps on commons.wikimedia.org
Closed, ResolvedPublic

Description

Author: neilk

Description:

I'd like to enable sitemaps for Commons as a cronjob.
Basically we would just start the existing sitemap script on Commons daily. My guestimates show that it can complete in less than a day.
In the near future we will want sitemaps to be generated in a more clever way, especially since Commons content is exploding, but we would like to at least start doing old-fashioned sitemaps today.
I'm just kicking off this ticket to see how this progresses (it's my first entry into our RT). I can specify the crontab line more precisely, etc.

Details

Reference
rt707

Event Timeline

rtimport raised the priority of this task from to Normal.Dec 18 2014, 12:50 AM
rtimport added a project: ops-core.
rtimport set Reference to rt707.
Dzahn added a comment.Dec 5 2011, 5:35 PM

7:58 < mutante> has there been a recent change related to creating sitemaps? I
see a ticket from last March which talks about
"In the near future we will want sitemaps to be generated in a more clever way"
17:59 < Dantman> Last I checked our sitemap indexes didn't even have proper
full urls in them...
18:01 < mutante> it has been suggested to "enable sitemaps for Commons as a
cronjob", but i am not sure about the implications
of running that script on a daily basis
18:01 < MonoBook> mutante: There's only one way to find out ;-)

Dzahn added a comment.Dec 5 2011, 5:35 PM

Status changed from 'new' to 'open' by dzahn

Dzahn added a comment.Jan 4 2013, 10:48 PM

14:46 < Reedy> mutante: maintenance/generateSitemap.php

Dzahn added a comment.Jan 4 2013, 10:48 PM

Status changed from 'open' to 'resolved' by dzahn

Dzahn changed the visibility from "WMF-NDA (Project)" to "Public (No Login Required)".Aug 1 2018, 7:15 PM
Dzahn changed the edit policy from "WMF-NDA (Project)" to "All Users".