Feb 11 2020
Please let me know if you revoke NFS from wikidumpparse, because it will break my project's pipeline. I'd appreciate it if it were left open, but if it's a problem I could imagine re-engineering it.
Jan 3 2020
Dec 19 2019
Thanks @Andrew . I will keep an eye out for the shinken upgrade.
Dec 17 2019
@Andrew , thanks so much. You were right it needs to go down for several minutes to trigger the shinken. I tried it for 5 minuets, and it worked (even got the push notification).
Thank you so much for all your help! Cloud services rock.
Dec 16 2019
Thanks for merging the patch and giving us the credentials to the shinken interface!
Dec 14 2019
Hey @Andrew the details in that patch look correct. Thanks!
Dec 5 2019
Please excuse this BUMP @bd808 . Thanks, and happy beginning of wintertime.
Nov 15 2019
Nov 5 2019
Hi @bd808 thanks for the response. We've considered your responses in a) using shinken, and b) writing "last run status". We feel it would be easier to go the route of setting up shinken to monitor the gratitude VPS. How can we go about getting shinken accounts?
Nov 4 2019
Hi @bd808 . Fair enough point about the XY problem. The "Y" in this case is that I would like to know if the gratsync.gratitude.eqiad.wmflabs Cloud VPS instance goes down for a period of time (or for any reason is unable to execute it's crontab, which is being used as the job scheduler).
Thanks @Jane023 for the great "User Story", that really helps shape the concept for how we can make the next version "usable", rather than just browsable.
Nov 1 2019
Oct 28 2019
@Astinson that prototype sounds interesting. I won't be at WikiConference North America, regretably. I would be happy to Skype in and chat, as I think your campaigns tool would be a good candidate as a consumer of our the data output we're planning. I'll comment on your gdoc.
Oct 15 2019
Oct 14 2019
@Aklapper thanks. I want to keep it open, but don't know what project to assign it to. It should either be part of a community data/statistics tools project. Or perhaps it is its own project? How can I find a good new tag for it?
Mar 23 2019
Wikidumpparse does not strictly need NFS. It could run entirely on just the
local volumes. However it is storing data on NFS right now (the default
since the home dir is on nfs) so I would need time to migrate it.
Nov 22 2018
I've got the Stretch VPS provisioned, and i see the files through the NSF.
So I think I'm done (except the new service isn't running on new VPS yet
because of differences in the JAVA that the distributions provide).
Nov 1 2018
Implemented a fix to delete all but the last 2 dumps which are all I need,
using, `$ ls -d1tr $WDTKDIR"/dumpfiles/wikidatawiki/json"* | head -n -2 |
xargs -d '\n' rm -rf --`
Oct 17 2018
Thanks for the responses @bd808 . I'll get this done before April 2019.
Oct 16 2018
What is the deadline exactly for migrating to Stretch then? And is there an
easy automated way of migrating, or does everything need to be provisioned
"fresh" and manually remade?
Jun 25 2018
@Halfak , this is a good idea, I would be glad to take it on. Another sort of crazy idea is we can build a test-set for mislabelled labels, and then fit a model to try and predict which labels are mislabelled.