Wed, Oct 16
Thanks for bugging about this, I have silenced the particular alerts for the time being so as to reduce spam. I should have time to debug it more this week and we'll try to get it to shut up.
Okay cool, like I said I'm not completely versed :)
Tue, Oct 15
After discussing this a bit it looks like it's not currently possible with pipermail without uptsream changes (willing to be wrong here but afaict).
Question, do you need an alias for the old list name?
I did a little digging but I don't immediately see where this is configured. Anyone more experienced with Mailman should look at this.
Done and done.
Tue, Oct 8
Mon, Oct 7
After discussing this a bit and thinking about it quite a lot, I'm highly in favor of a machine git repo for the generated side. This has a nice side-benefit of us being able to easy expose it to the network via https on the netbox servers (and, thus, both publically and to the dns servers).
Thu, Oct 3
Thanks for the extensive feedback & validation suggestions! I'll see what i can come up with.
Wed, Oct 2
THanks for the heads up, we'll loop around to fix these up.
This script has been released and appears to work correctly!
Tue, Sep 24
This is the "switching to http" problem discussed in T232767 I believe. I haven't taken the time to more fully debug it but I suspect it's something in Netbox's configuration or a bug in django rest framework possibly.
In debugging alerts on Netbox, I noticed that, unrelated to the CSV dumper, the ganeti sync sometimes returs a 500 error. This is caused by this error:
Mon, Sep 23
i think the general consensus i've heard is that external load balancers don't or can't have firewall rules, but perhaps we should consider it on a case by case basis for other external services.
Sep 18 2019
I spent some time debugging the problem with csv dumps from netbox2001. The basic gist is that when dumping a larger table, its pagination routine fails because the second page it tries to retrieve from the API is returning an http instead of an https url as the "next page" URL (and when netbox2001 tries to access an http url, it times out eventually because :80 is blocked). I suspect a bug in Netbox itself. I traced the execution in pdb, and it showed that this value is coming from the remote end.
After increasing the CPU count to 4 on both fornt-ends the number of 500 errors that occur are much lower.
netmon1002 is cleaned up now and should not be alerting on these basis anymore.
Sep 17 2019
This has been completed modulo some growing pains.
Sep 12 2019
Sep 11 2019
Shifting gears on this project to use the custom scripts interface added in 2.6.3. I shall make an 'add management interface' script that automatically assigns an IP address.
FWIW netbox.wikimedia.org points at netbox1001.wikimedia.og now. I am working on fixing some minor remaining issues with reports and making backups be correct (database is currently backed-up correctly, but netbox proper needs dumps backed up).
Sep 9 2019
Sep 4 2019
Sep 3 2019
Okay I've implemented changes to the netbox and ganeti modules as linked above which should allow all of the operations requested. I have not implemented writing status to Ganeti VMs since this information is updated automatically but it should be relatively straight forward to implement if desired.
@Volans Ah hah thanks for this. I was given to believe the 'default' would include the ferm config and did'nt even think of looking.
Aug 30 2019
Aug 29 2019
Finding which cluster, or if the instance by fqdn is a Ganeti instance, could be done as easily as trrying to look it up in every configured cluster, and checking if there's information. We could provide utility functions to perform those actions trivially.
Aug 27 2019
Work is progressing, I've taken the step of setting up vagrant so i can comfortably hack on Netbox without breaking anybody.
I have confirmed content-type is set correctly, however Swift sets a content-disposition to attachment which causes browser to download. Incoming patch to sttrip this at the apache level.
Aug 22 2019
Fix deployed with https://gerrit.wikimedia.org/r/531763
Aug 19 2019
Aug 14 2019
At least the first one i
Aug 13 2019
There is an undocumented API which creates a new IP address for a given prefix:
I have spent time looking at adding the API required for this functionality. I believe I have figured out how to do it and will produce a patch shortly.
this has been fully deployed now and tested. It is automated.
FWIW there was no mgmt DNS information for some hosts:
Script has completed running. Several edge cases worked out with Arzhel (frack, etc). MGMT interfaces should be largely correct now.
Aug 6 2019
Okay after some finagling, uploading (and downloading) images should work. A particularity of swift storage is that they download instead of viewing, but they work!
Aug 1 2019
Jul 31 2019
Jul 30 2019
Netbox has been deployed with the change that should enable this. We're testing.
Obviously some finagling happened, but in the end the upgrade is good.