|Resolved||nshahquinn-wmf||T239876 Fix external automatic translation notebook|
|Resolved||nshahquinn-wmf||T240975 Update Toledo Oozie coordinator to work with Kerberos|
I discussed this with @Pginer-WMF today, and we do want to prioritize this above other Language work. We are not currently doing any development work, but there will be more community conversations as Google expands Toledo to new languages, so we want this data to be publicly available.
I've been putting a bunch of work into making this work again, but unfortunately it's not quite there yet. I've fixed the underlying job that collects data on Toledo pageviews (T240975), and done a bunch of cleanup on the notebook, but I'm having trouble with the job that reruns the notebook every day, since our move to Kerberos authentication meant changes in how we run cron jobs.
Currently, I'm running a one-off version of the notebook update script (which doesn't run into the Kerberos authentication issues); it may complete successfully, in which case the published notebook will be updated. However, it'll take a while to finish, so I'm going to head out of the office now and pick the project up again after All Hands.
I've figured out the underlying issue in the wmfdata library that was causing some of the queries in the notebook to fail. I've now done a one-time update; the published notebook now has current data.
One graph ("Revert rate for edits from external guidance extension" in section 4C) still has data only through last August. In order to update it, I would need to do some further work on the custom script that checks for reverts.
I would also need to do additional work in order to make it auto-update again.
@Arrbee, I'll wait for the outcome of your meeting with Toby before I spend the time on those remaining steps. It would take 2-4 days of additional work, but a lot of that would benefit other projects using Jupyter dashboards (including T226171) so if it's important to have continued visibility into external guidance edits, it would be worth it.
Big thanks @nshahquinn-wmf for working on this! I'll jump to the sunset task if I have other questions/requests, but if it's very simple to do, I would request that you list the basic steps / things that would have to be fixed to get this notebook running so that I (or someone else) can more easily take up the work if our team deems this notebook useful in the near future.