Page MenuHomePhabricator

tsreports is down
Closed, DeclinedPublic

Description

https://tsreports.toolforge.org/ reads "Sorry, tsreports is down. This is probably transient, and tsreports will be up in a minute or so. If problems persist, please contact https://nl.wikipedia.org/wiki/Gebruiker:Valhallasw !"

According to Saschaporsche@nlwiki, it has been down for a few days.

Also, Valhallasw doesn't seem to be active anymore on nlwiki. Please update the contact info.

Event Timeline

Legoktm subscribed.

I'm debugging/fixing it now, but for what it's worth, the top of the tool says "Tsreports is unsupported and will likely be discontinued in 2020. Consider using Quarry instead. To convert tsreports queries, please follow the conversion guide".

Legoktm added a subscriber: valhallasw.

Well the pages work again, but trying to generate a report for en.wikipedia.org gives "Sorry, an error occurred: no such wiki".

I'd spend more time on this bug it seems like @valhallasw was going to shut this down anyways. Also if I'm reading this correctly it's running under Python 2.4(!)?

For the record, here are the changes I made:

tools.tsreports@tools-sgebastion-07:~/src/tsreports$ git diff
diff --git a/.lighttpd.conf b/.lighttpd.conf
index e62ea7d..94fc217 100644
--- a/.lighttpd.conf
+++ b/.lighttpd.conf
@@ -1,4 +1,4 @@
-fastcgi.server += ( "/tsreports/userlist.fcgi" =>
+fastcgi.server += ( "/userlist.fcgi" =>
     ((
         "socket" => "/tmp/tsreports-userlist.fcgi.sock",
         "bin-environment" => ("PATH" => "/data/project/tsreports/src/tsreports/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"),
@@ -9,7 +9,7 @@ fastcgi.server += ( "/tsreports/userlist.fcgi" =>
 )
 
 
-fastcgi.server += ( "/tsreports/wikilist.fcgi" =>
+fastcgi.server += ( "/wikilist.fcgi" =>
     ((
         "socket" => "/tmp/tsreports-wikilist.fcgi.sock",
         "bin-environment" => ("PATH" => "/data/project/tsreports/src/tsreports/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"),
@@ -20,7 +20,7 @@ fastcgi.server += ( "/tsreports/wikilist.fcgi" =>
 )
 
 
-fastcgi.server += ( "/tsreports/index.fcgi" =>
+fastcgi.server += ( "/index.fcgi" =>
     ((
         "socket" => "/tmp/tsreports-index.fcgi.sock",
         "bin-environment" => ("PATH" => "/data/project/tsreports/src/tsreports/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"),
@@ -31,7 +31,7 @@ fastcgi.server += ( "/tsreports/index.fcgi" =>
 )
 
 
-fastcgi.server += ( "/tsreports/prefs.fcgi" =>
+fastcgi.server += ( "/prefs.fcgi" =>
     ((
         "socket" => "/tmp/tsreports-prefs.fcgi.sock",
         "bin-environment" => ("PATH" => "/data/project/tsreports/src/tsreports/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"),
@@ -44,10 +44,10 @@ fastcgi.server += ( "/tsreports/prefs.fcgi" =>
 
 
 url.rewrite-once += (
-    "/tsreports/(\?.*)?$" => "/tsreports/index.fcgi$1",
+    "/(\?.*)?$" => "/index.fcgi$1",
 )
 
-url.redirect += ("/tsreports(\?.*)$" => "/tsreports/$1")
+#url.redirect += ("/tsreports(\?.*)$" => "/tsreports/$1")
 
 debug.log-request-handling = "enable"
 fastcgi.debug = 1 
diff --git a/.reports.cfg b/.reports.cfg
index b00918d..64d0a4f 100644
--- a/.reports.cfg
+++ b/.reports.cfg
@@ -7,7 +7,7 @@ base = '/data/project/tsreports/src/tsreports'
 database = 'p50380g50943__cache'
 
 # The URL prefix.
-docroot = '/tsreports'
+docroot = '/'

P.S. I miss River.

Thanks for fixing, Legoktm, it looks like everything is working as before. The input field takes a database name like "enwiki", so that text is deceiving.

Could someone publish the queries somewhere before the tool goes down?

Thanks for fixing this so quickly, @Legoktm!

I'd spend more time on this bug it seems like @valhallasw was going to shut this down anyways. Also if I'm reading this correctly it's running under Python 2.4(!)?

I think it does run under 2.7 (the system python2 on the Debian distro used for lighttpd -- Buster?), but there are definitely some artifacts that are > 10 years old. But in the end, this is the main reason the tool will go down at some point: once the classic webservices & Python 2 are no longer supported someone will have to step up to do a complete rewrite. Given that Quarry exists, that effort is probably better spent improving Quarry.

Could someone publish the queries somewhere before the tool goes down?

Where to find the queries and how to convert them is documented under https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.tsreports/Converting_queries (linked from the banner above tsreports).

Thanks @Legoktm for fixing this.

I do use the tsreports on a regular basis to search for problems (like broken images ). I do understand that the toolserver will go down at some point and would highly appreciate if somebody ( @valhallasw ? ) would build a new tool! ( i don't have any experience in programming at all......)

Kind regards, Saschaporsche

The suggested replacement is https://quarry.wmflabs.org/ . For example, https://quarry.wmflabs.org/query/46608 is a converted version of brokenimages for nlwiki. https://quarry.wmflabs.org/query/46611 is an alternative version that is more convenient to export as wikitable (under 'download data').

To convert other queries, I hope the instructions under https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.tsreports/Converting_queries are clear enough; otherwise I can convert them for you.

Frostly subscribed.

Per T344576. tsreports is discontinued and Superset (formerly Quarry) is a very viable alternative.