I just want the record to show my appreciation for your work on this @scfc, thank you so much for figuring this out! I'll look into switching the qsub calls with jsub as you suggest. Thanks again for the work you've done on this!

@Halfak: No, currently nothing interesting to bring, unfortunately.

I'm thinking the 2015 CSCW paper is a better citation for this dataset (and ORES in general moving forward). While the approach is the same in both that and the "Tell Me More" paper, the more recent paper does a much better job of figuring out the appropriate features and the data gathering for training it is much better. So it's overall just more similar to the model ORES has.

I think there's two AQ datasets going around. One is the one @Ladsgroup pointed to, which I believe @Halfak gathered, and is used for ORES training and evaluation. The second is the one I used to do some additional training to improve the wikiclass library, and that's already on figshare: https://figshare.com/articles/English_Wikipedia_Quality_Asssessment_Dataset/1375406 This second dataset is gathered by following the process described in our 2015 CSCW paper, and referenced in the figshare description.

SuggestBot's cron jobs for editing https://en.wikipedia.org/wiki/Wikipedia:Community_portal/Opentask appear to be executing just fine. I also noticed that changing crontab worked on tools-bastion-02 for the tools.suggestbot account.

Switching to trusty by adding the parameter fixed it, sorry for not thinking about that before creating the task. Closing it as resolved.

Tested now in Safari (9.1.1) and it works there too. Possibly older Safari version fails, or there's been an update to Swagger? Not sure, but labelling it "WORKSFORME". I see little reason to investigate further.

Forgot to add the opening greeting and the screenshot, fixed now: https://no.wikipedia.org/w/index.php?title=Wikipedia:Tinget&oldid=16529063

Made a couple of copyedits, translated it to Norwegian, and posted it to their Village Pump (https://no.wikipedia.org/w/index.php?title=Wikipedia:Tinget&oldid=16529056).

@Halfak : Sure thing, do you have an example post, or some specific points that need to be mentioned?

Sounds like this got resolved, awesome!

@Harej Sorry about the delays, have been busy rewriting much of SuggestBot to get article page view data back. Am clear to work on this now and will get an updated version running that only recommends articles within specific projects.

I went through and copied some commonly used insults into the bad words list. Noticed that the generated list contains quite a lot of variations, will you be stemming the words?

With regards to the web service being restarted: I count 80 "No running webservice" notifications in ~suggestbot/service.log for 2016-05-30. There are a handful of requests in the access.log for the same day, so it seems that the service is still restarted for no apparent reason.

Memory usage has been one of my concerns as SuggestBot's link recommender is an iterative breadth-first search from a set of articles, and that's what is mostly used. However, the script (~tools.suggestbot/link-rec/link-recommender.py) is reasonably memory-optimized as it used to run on the Toolserver, which had a 1GB memory limit.

I'm not sure if this ticket should be closed now. While I rarely experience issues with accessing my web services, the problem with the server being restarted appears to persist. I wasn't sure if the deployment of T98440 would change anything, for May 1–4 I see no significant change with the web service being restarted 80, 74, 70, and 73 times, respectively. All of these have the matching pattern mentioned in T133090#2221574, although the average time before restart is down to 5s.

There are 71 "server stopped" patterns in ~/error.log as well. All of them have timestamps within 6–12s (mean 7.89s) after each of the timestamps in the service log. So yes, it's the same pattern as mentioned in T133090#2221574.

I haven't seen many 503s over the past couple of days, so I regard this particular task as resolved. At the same time, I logged 71 restarts of the web service yesterday (see below), so that appears to be something that needs looking at. Should I open a separate ticket for that?

I unfortunately have to report that the problem wasn't resolved, when I checked a couple of hours after @valhallasw's update, 503s were again reported.

Hmmm… these are interesting results. I'm wondering if my approach results in a less noisy dataset, but also not sure how we would go about figuring that out.

@putnik : Thanks so much for reviewing this! When I was looking at the article quality labels in Russian, I also came across "strong article" (labelled "дс" after lowercasing). Is this level not supposed to be used any more?

@Halfak : I added a comment to https://meta.wikimedia.org/wiki/Research_talk:Automated_classification_of_article_quality/Work_log/2016-03-29, not sure if I should've done that or commented here instead? Let me know if I should copy it over here.

I couldn't find anything in the label extractor that's cause for concern. Having though about it, I suspect there are significant differences in our overarching methodology. A hangout is probably the best approach to walk through it, I'll email @Halfak so we can get moving on that.

Talked with @Harej to get this moving again.

I'll add a +1 to wanting monthly data for a bunch of articles. Could enable some interesting changes to SuggestBot's algorithms.

@Harej: No, looks like everything's working! There's a little bit of work to set up the automation on my end, but that doesn't need to be tracked here, so I'm closing this task.

First of all, I'll join the celebrations, this if absolutely fantastic, huge thanks to everyone involved!

The updates are complete, and I've done some manual cleanup, removed the previous task suggestions. Looking forward to learning what project members think about the tasks, hopefully many of them will be useful!

Great! I've got seven WikiProjects that are due to have their suggestions updated by SuggestBot. I'll go check them out and make sure things are ready, then have SuggestBot make a run to see if everything works okay.

Yes, there is news, I have working code!

I added the title and abstract of my talk to https://www.mediawiki.org/wiki/Wikimedia_Research/Showcase#Upcoming_showcases

I have written a Lua module that can translate a set of suggestions into the necessary template calls: https://en.wikipedia.org/wiki/Module:User:SuggestBot/WikiProjects