Please let me know if you revoke NFS from wikidumpparse, because it will break my project's pipeline. I'd appreciate it if it were left open, but if it's a problem I could imagine re-engineering it.

Thanks @Andrew . I will keep an eye out for the shinken upgrade.

@Andrew , thanks so much. You were right it needs to go down for several minutes to trigger the shinken. I tried it for 5 minuets, and it worked (even got the push notification).
Thank you so much for all your help! Cloud services rock.

Thanks for merging the patch and giving us the credentials to the shinken interface!

Hey @Andrew the details in that patch look correct. Thanks!

Please excuse this BUMP @bd808 . Thanks, and happy beginning of wintertime.

Hi @bd808 thanks for the response. We've considered your responses in a) using shinken, and b) writing "last run status". We feel it would be easier to go the route of setting up shinken to monitor the gratitude VPS. How can we go about getting shinken accounts?

Hi @bd808 . Fair enough point about the XY problem. The "Y" in this case is that I would like to know if the gratsync.gratitude.eqiad.wmflabs Cloud VPS instance goes down for a period of time (or for any reason is unable to execute it's crontab, which is being used as the job scheduler).

Thanks @Jane023 for the great "User Story", that really helps shape the concept for how we can make the next version "usable", rather than just browsable.

@Astinson that prototype sounds interesting. I won't be at WikiConference North America, regretably. I would be happy to Skype in and chat, as I think your campaigns tool would be a good candidate as a consumer of our the data output we're planning. I'll comment on your gdoc.

In T230184#5487604, @Jane023 wrote:

As far as reports go, it would be nice for the portrait part of the Sum of all Paintings if we could easily see the missing women in the genealogy chains from circa 1450 onwards. Often we already have the portrait items of the women, but are missing the human items for the women. Meanwhile the men seem to spawn from generation to generation 100% from the male chromosomes and only half of pendant portrait pairs are ingested as data. If we can identify missing wives/mpthers/daughters we can interlink the female portraits to the sitters. Sometimes it goes the other way: we have the portrait as an image illustrating the human item, but no portrait item yet. We want both!

In T230184#5487630, @Astinson wrote:

Hey all, so I wrote a requirement for something that could be a rewrite of the Monumental software by @Yarl and @Slaporte. I have been shopping around the idea, and there is a fair bit of interest for a "missing wiki women" type list building do: https://docs.google.com/document/d/1LtBujK6kARbwxUzDyF6hpv445rJwk7Ka7rAlf7e9USg/edit -- I would be happy to talk with folks about it.

@Aklapper thanks. I want to keep it open, but don't know what project to assign it to. It should either be part of a community data/statistics tools project. Or perhaps it is its own project? How can I find a good new tag for it?

Wikidumpparse does not strictly need NFS. It could run entirely on just the
local volumes. However it is storing data on NFS right now (the default
since the home dir is on nfs) so I would need time to migrate it.

I've got the Stretch VPS provisioned, and i see the files through the NSF.
So I think I'm done (except the new service isn't running on new VPS yet
because of differences in the JAVA that the distributions provide).

Implemented a fix to delete all but the last 2 dumps which are all I need,
using, `$ ls -d1tr $WDTKDIR"/dumpfiles/wikidatawiki/json"* | head -n -2 |
xargs -d '\n' rm -rf --`

Thanks for the responses @bd808 . I'll get this done before April 2019.

What is the deadline exactly for migrating to Stretch then? And is there an
easy automated way of migrating, or does everything need to be provisioned
"fresh" and manually remade?

@Halfak , this is a good idea, I would be glad to take it on. Another sort of crazy idea is we can build a test-set for mislabelled labels, and then fit a model to try and predict which labels are mislabelled.