@leila @Hall1467 has agreed to give a talk on the 26th. I've asked Sneha Narayan at Northwestern as well, but haven't heard back yet.

@JMinor @kaldari I'm ready to run another round of the study, but I've been waiting for budget confirmation before I spend any more $. Should have the answer tomorrow hopefully, in which case I can start the study again on Monday. Is the trending API in a stable place right now?

@leila I emailed both presenters. Let's see if they are interested.

Note: only one of my Q1 goals (Structured Data) maps onto the annual plan, so I left the other two (recsys evaluation and landing page) out of this version. They each have a Quarterly Checkin slide, though.

@Jdlrobson thanks for the heads-up. It definitely sounds like we need to coordinate if there are future tests. I was operating under the assumption that the API was providing consistent results.

Contractor is beginning to work on this, as of mid-May.

@mschwarzer I don't currently have any plans to do additional evaluations around article recommendations, but it's always possible that someone will request that work in future. Happy to talk about it if you want to.

I've updated the study page with some initial results. So far, I've been able to demonstrate that people based in India are less likely to be familiar with topics that appear in a 'top read'-based feed than a 'trending'-based feed.

In T149021#3261215, @Neil_P._Quinn_WMF wrote:

This is done. However, the results say that 7–10% of article creations are by non-autoconfirmed users. This seems off to me, since my previous analysis found that 13% of non-deleted articles were created by non auto-confirmed users and I expected that including deleted articles would make that percentage go up, not down.

@cmadeo @JMinor I've been hit with some unexpected work and it's eating up my time. How urgent is it that you know the full results of the study? I believe I can get initial data analysis done next week. Not a sure thing, though. That analysis may or may not be enough to say "switching to Trending is/is not a good idea", but it will at least help inform your decisions.

Thanks @kaldari. Just FYI I'm fairly sure this can be done without the data lake, too, if that's been a blocker. In the past, I've looked for deleted pages in the enwiki_p.archive table (pages deleted for normal reasons, like no notability) and RevisionDeleted pages (blatant attack pages) in the revision table on production db stat1003. If you do a random subsample of, say, 2000 pages created within a year window you should be able to calculate the autoconfirmed status of the page creator and then get an accurate estimate of the % deleted pages in that sample with a simple loop... but I've never used the data lake, so it may very well be easier that way.

@kaldari @Neil_P._Quinn_WMF i s there a report or write up of this on wiki anywhere? I'd like to know the status of the analysis. It looks as though it hit a roadblock (or at least a timeblock on Neil's part), but I'm not 100% sure I understand what the outstanding issues are.

@Ragesoss feel free to add/remove projects; I wasn't sure which Ed Program project(s) to add?

Thanks @Halfak! Quick question: does "confirm with reviewers" step involve more than just confirming that they have accepted the review via PCS?

I've got everything set up and plan to run the first survey batch tomorrow at 9am PDT. See the research page for more details.

There appears to be write-up related to this study here: https://www.mediawiki.org/wiki/Wikimedia_Research/Design_Research/Reading_Team_UX_Research/Top_Chrome_Usability

Per conversation with @JMinor, I've created a related task T163818 to get a sense of the potential impact of this change.

Thank you, @MoritzMuehlenhoff. I've pasted my new rsa public key as instructed: P5328

MetaWiki research page created

Looks like I was able to add the calendar. Tho no visible events, yet. Thanks @greg!

@leila I can't add this calendar item: "you do not have access to Tech Management's calendar". Who should I talk to about correcting this?

Looks like this doesn't need to happen for the landing page MVP, per conversations with @DarTar .

@leila is this a question you'd be interested in getting qualitative comparison data on?

To whoever vandalized my Latex doc: not cool.

@Aklapper it's probably @Nirzar 's call, what to do with Sherah's old tasks.

done: https://www.mediawiki.org/wiki/Wikimedia_Research/Design_Research