To do: backup archive directory to hdfs and delete from this node.
We are aware; see https://phabricator.wikimedia.org/T251777. The new data is available at https://dumps.wikimedia.org/other/pageview_complete/.
Temporarily going to block this user agent; hoping to deprecate this system eventually.
@elukey Getting closer, able to ssh in to an-test-client1001.eqiad.wmnet, however puppet agent is throwing an error:
I deployed this to an-launcher1002 but got a permission error:
Good idea @elukey - added.
I hadn't been using razzi-puppetmaster or razzi-puppet-client for a bit and removed them in the Cloud VPS 2020 Purge. If necessary I can recreate that setup; it consisted of creating a standalone puppetmaster following https://wikitech.wikimedia.org/wiki/Help:Standalone_puppetmaster#How_can_I_use_a_local_Puppetmaster? (we didn't enable autosigning on the puppetmaster) and running the following 3 commands got razzi-puppet-client as per the client setup instructions:
Tue, Oct 20
Mon, Oct 19
After discussing with @elukey, we can leave stats.wikimedia.org running on port 8443, since it's not an address end users will see.
Sat, Oct 17
I made patches for the various hosts that need this upgrade. The one that will be trickiest will be stats.wikimedia.org (which also hosts analytics.wikimedia.org and datasets.wikimedia.org) - for that, I have 2 patches
Fri, Oct 16
@elukey I like that plan to keep both proxies running and switch ATS to 8443.
Thu, Oct 15
@Ottomata and I tested and deployed the envoy changes on yarn.wikimedia.org.
@elukey says this depends on BigTop for the hadoop version.
Feel free to open a new ticket with a description of the new feature.
@elukey thinks we should look into airflow 2 instead for now.
Wed, Oct 14
Tested the backup script and confirmed files are still backed up to hdfs.
Tue, Oct 13
Deployed the first part of this, to stop backing up maxmind files locally, putting them directly on hdfs.
Today is Tuesday, so the weekly backup already ran earlier today. Tomorrow we can manually run this change and see that the files backup as we expect.
Fri, Sep 25
Thu, Sep 24
@elukey we did try that, and it didn't work. It's possible we misconfigured something; could give that another try.
Confirmed with @mforns that adding to the bundle.properties
Wed, Sep 23
Turns out I already had kerberos, I just forgot where I put my password :)
Tue, Sep 22
Yes, I can access it now. Thanks!
Sep 21 2020
Sep 17 2020
This is done and configured on Matomo: https://piwik.wikimedia.org
Sep 16 2020
This node was deleted.
Sep 14 2020
@Nuria could you add your approval to this request?
Sep 2 2020
Yes, in my opinion there should be a nonzero exit code of the type checker, and that should propagate to the Jenkins job.
Aug 31 2020
SSH is working! Thanks all