Page MenuHomePhabricator

wikistats updates broken for some projects
Closed, ResolvedPublic

Description

http://wikistats.wmflabs.org/

some projects did not get updated.. others did.. and the odd part is they are WMF projects but not all of them are broken

fix that

Event Timeline

Dzahn raised the priority of this task from to Needs Triage.
Dzahn updated the task description. (Show Details)
Dzahn added a project: VPS-project-Wikistats.
Dzahn subscribed.

Change 222045 had a related patch set uploaded (by Dzahn):
use https link to fetch stats for wmf projects

https://gerrit.wikimedia.org/r/222045

Change 222048 had a related patch set uploaded (by Dzahn):
add config option to use https-only for certain projects

https://gerrit.wikimedia.org/r/222048

Change 222048 merged by jenkins-bot:
add config option to use https-only for certain projects

https://gerrit.wikimedia.org/r/222048

Change 222045 abandoned by Dzahn:
use https link to fetch stats for wmf projects

https://gerrit.wikimedia.org/r/222045

fixed for all WMF projects

still open to check on

wikkii, wikisite, opensuse, gentoo

most likely different reasons though

Dzahn triaged this task as Low priority.Jul 1 2015, 2:22 AM

wikkii: down, delete entirely? http://downforeveryoneorjustme.com/wikkii.com

wiki-site: works in browser put curl from labs fails. looks like they are blocking us. remove then??

opensuse: needs to use https instead of http then it would work, add another special rule in update.php

gentoo: redirects to hosting site / parking . looks dead. remove?

Wikii, Gentoo: Delete Tables.

Wiki-Site: Throttle down to one per minute, try different methods.

OpenSuse: Go ahead

Change 222237 had a related patch set uploaded (by Dzahn):
remove wikkii table entirely

https://gerrit.wikimedia.org/r/222237

Change 222238 had a related patch set uploaded (by Dzahn):
remove gentoo table entirely

https://gerrit.wikimedia.org/r/222238

@RobiH

patches to remove wikkii and gentoo are coming up above

trying different methods or throttling wiki-site won't help unless they unblock us. it's completely blocked, can't even ping www.wiki-site.com from the labs machine

Can you send them an email with an official request for admittance?

Change 222237 merged by Dzahn:
remove wikkii table entirely

https://gerrit.wikimedia.org/r/222237

Change 222238 merged by Dzahn:
remove gentoo table entirely

https://gerrit.wikimedia.org/r/222238

built package version 2.10

https://gerrit.wikimedia.org/r/#/c/224726/

and installed it on the labs instance (wikistats-petcow)

this removed the gentoo and wikkii tables too

new questions meanwhile, when seeing red timestamps:

opensuse: updates fail and are redirects now, did they give up on the wikis?

referata: manually updated, but now works

shoutwiki: inconsistent. some fail, some work just fine, some deny read access by API settings, most work though.. also manually updated

Opensuse APIs are accessible.

wmspecials needs the same fix for HTTPS links the other wmf projects got. but it did not because this has URLs in the database due to too many special rules in the "specials" table

changed all the URLs from http to https and ran an update. most are 200 now. some 404 and 992 detected

seems wiki-site.com is blocking pings from instances behind the web proxies (as mailman-puppet shares the same external IP as wikistats, while mailman-jessie can ping it from a different external IP).

Opensuse still does not update by itself.
Opensuse: Add fi, nl, pl, zh, zh-tw

Opensuse still does not update by itself.
Opensuse: Add fi, nl, pl, zh, zh-tw

Mostly done. Reload the table now.

What's special about is, vi, and fi though?

What's special about is, vi, and fi though?

Anyone knows?

Opensuse: Replace "fi" by "languages"
Opensuse: Change "http://" to "https://"
Miraheze: "readapidenied" error on "damil" and "extload"
Wiki-Site: Send them an email with an official request for admittance?
LXDE: Host outage, keep watching.
Mediawikis: Delete all entries where Total="" and Name="n/a"
Wikia: Delete all entries where Total="" and HTTP="302"

Opensuse: Replace "fi" by "languages" -> done
Opensuse: Change "http://" to "https://" -> done (note to self: commit the changes to update.pp and config.php!)
Miraheze: "readapidenied" error on "damil" and "extload" done , deleted them,they are non-public wikis
Wiki-Site: Send them an email with an official request for admittance? not done
LXDE: Host outage, keep watching.
Mediawikis: Delete all entries where Total="" and Name="n/a" done (it's actually "where total is null and name is null" about 1738 deleted)
Wikia: Delete all entries where Total="" and HTTP="302" done (it's actually "where total is null and name is null" 4464 deleted)

Change 232946 had a related patch set uploaded (by Dzahn):
fix for opensuse URLs switched to https

https://gerrit.wikimedia.org/r/232946

Change 232946 merged by jenkins-bot:
fix for opensuse URLs switched to https

https://gerrit.wikimedia.org/r/232946

Opensuse: Change "http://" to "https://" -> done (note to self: commit the changes to update.pp and config.php!)

done

current status: wikisite and lxde not working @RobiH what do you suggest here? lxde.org still not loading any wikis even though the rest of the site is up. and what about wikisite? I would like to have a ticket that is less generic and can be closed in an finite amount of time. otherwise this will stay open forever just the focus of it will keep changing

I'm closing this because most (or all?) of the original issues have been addressed and the current issues are handled

in T111592 (wikisite) and T111591 (LXDE)