Page MenuHomePhabricator
Create Task
Maniphest T101730

move planet from zirconium to a ganeti VM
Closed, ResolvedPublic
Actions

Description

move the planet RSS feed aggregator from physical server zircnonium to a virtual machine in ganeti

<akosiaris> https://phabricator.wikimedia.org/tag/vm-requests/
<akosiaris> wanna request that planet VM?

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
planet: remove feedparser.pyoperations/puppetproduction+0 -3 K
planet: proxy through url-downloader to fetch URLsoperations/puppetproduction+8 -3
planet: besides http_proxy need https_proxy toooperations/puppetproduction+1 -1
planet: install xslt-procoperations/puppetproduction+5 -0
cache/misc: switch planet over to planet1001operations/puppetproduction+1 -1
cache/misc: add planet1001 as a backendoperations/puppetproduction+1 -0
planet: remove role from zirconiumoperations/puppetproduction+0 -1
planet1001: set ganglia class and clusteroperations/puppetproduction+2 -0
planet1001: add to site, apply planet roleoperations/puppetproduction+5 -0
add planet1001 as a VMoperations/puppetproduction+8 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Dzahn created this task.Jun 8 2015, 5:29 PM
Dzahn claimed this task.
Dzahn raised the priority of this task from to Medium.
Dzahn updated the task description. (Show Details)
Dzahn added a project: acl*sre-team.
Dzahn added subscribers: Dzahn, akosiaris.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 8 2015, 5:29 PM
Krenair subscribed.Jun 8 2015, 5:30 PM
• JohnLewis subscribed.Jun 8 2015, 5:31 PM
• JohnLewis added a project: vm-requests.Jun 8 2015, 5:37 PM
• JohnLewis set Security to None.
akosiaris removed a project: vm-requests.Jun 9 2015, 7:38 AM

Please go to https://phabricator.wikimedia.org/tag/vm-requests/ and click on the "VM Request" link to ask for that VM. Adding the project to the task doesn't grant a VM anyway and it is hampering an easy overview. Thanks!

Dzahn added a subtask: T101899: EQIAD: 1 VM request for planet.Jun 9 2015, 9:21 PM
akosiaris closed subtask T101899: EQIAD: 1 VM request for planet as Resolved.Jun 10 2015, 9:10 AM
gerritbot subscribed.Jun 23 2015, 9:14 PM

Change 220310 had a related patch set uploaded (by John F. Lewis):
add planet1001 as a VM

https://gerrit.wikimedia.org/r/220310

gerritbot added a project: Patch-For-Review.Jun 23 2015, 9:14 PM
gerritbot added a comment.Jun 23 2015, 9:30 PM

Change 220310 merged by Dzahn:
add planet1001 as a VM

https://gerrit.wikimedia.org/r/220310

• JohnLewis mentioned this in rOPUP9355833f5685: add planet1001 as a VM.Jun 23 2015, 9:30 PM
gerritbot added a comment.Jun 23 2015, 11:32 PM

Change 220351 had a related patch set uploaded (by Dzahn):
planet1001: add to site, apply planet role

https://gerrit.wikimedia.org/r/220351

gerritbot added a comment.Jun 23 2015, 11:34 PM

Change 220352 had a related patch set uploaded (by Dzahn):
planet1001: set ganglia class and cluster

https://gerrit.wikimedia.org/r/220352

gerritbot added a comment.Jun 23 2015, 11:50 PM

Change 220351 merged by Dzahn:
planet1001: add to site, apply planet role

https://gerrit.wikimedia.org/r/220351

Dzahn mentioned this in rOPUP1dedff1070d2: planet1001: add to site, apply planet role.Jun 23 2015, 11:51 PM
gerritbot added a comment.Jun 23 2015, 11:51 PM

Change 220352 merged by Dzahn:
planet1001: set ganglia class and cluster

https://gerrit.wikimedia.org/r/220352

Dzahn mentioned this in rOPUP6045b64bed9a: planet1001: set ganglia class and cluster.Jun 23 2015, 11:52 PM
gerritbot added a comment.Jun 26 2015, 12:10 AM

Change 221013 had a related patch set uploaded (by Dzahn):
planet: remove feedparser.py

https://gerrit.wikimedia.org/r/221013

Restricted Application added a subscriber: Matanya. · View Herald TranscriptJun 26 2015, 12:10 AM
gerritbot added a comment.Jun 26 2015, 12:25 AM

Change 221016 had a related patch set uploaded (by Dzahn):
planet: remove role from zirconium

https://gerrit.wikimedia.org/r/221016

gerritbot added a comment.Jun 26 2015, 12:26 AM

Change 221013 merged by Dzahn:
planet: remove feedparser.py

https://gerrit.wikimedia.org/r/221013

Dzahn mentioned this in rOPUPb6ebdc533a95: planet: remove feedparser.py.Jun 26 2015, 12:26 AM
gerritbot added a comment.Jun 26 2015, 12:33 AM

Change 221016 merged by Dzahn:
planet: remove role from zirconium

https://gerrit.wikimedia.org/r/221016

Dzahn mentioned this in rOPUPba4b43bc5a44: planet: remove role from zirconium.Jun 26 2015, 12:34 AM
gerritbot added a comment.Jun 26 2015, 12:37 AM

Change 221027 had a related patch set uploaded (by Dzahn):
cache/misc: add planet1001 as a backend

https://gerrit.wikimedia.org/r/221027

gerritbot added a comment.Jun 26 2015, 12:40 AM

Change 221027 merged by Dzahn:
cache/misc: add planet1001 as a backend

https://gerrit.wikimedia.org/r/221027

Dzahn mentioned this in rOPUP072d89d8a13d: cache/misc: add planet1001 as a backend.Jun 26 2015, 12:40 AM
gerritbot added a comment.Jun 26 2015, 12:43 AM

Change 221032 had a related patch set uploaded (by Dzahn):
cache/misc: switch planet over to planet1001

https://gerrit.wikimedia.org/r/221032

gerritbot added a comment.Jun 26 2015, 12:53 AM

Change 221032 merged by Dzahn:
cache/misc: switch planet over to planet1001

https://gerrit.wikimedia.org/r/221032

Dzahn mentioned this in rOPUPb05a613474ca: cache/misc: switch planet over to planet1001.Jun 26 2015, 12:54 AM
gerritbot added a comment.Jun 26 2015, 1:03 AM

Change 221033 had a related patch set uploaded (by Dzahn):
planet: install xslt-proc

https://gerrit.wikimedia.org/r/221033

gerritbot added a comment.Jun 26 2015, 1:05 AM

Change 221033 merged by Dzahn:
planet: install xslt-proc

https://gerrit.wikimedia.org/r/221033

Dzahn mentioned this in rOPUPbb436e114962: planet: install xslt-proc.Jun 26 2015, 1:05 AM
gerritbot added a comment.Jun 26 2015, 1:46 AM

Change 221036 had a related patch set uploaded (by Dzahn):
planet: proxy through url-downloader to fetch URLs

https://gerrit.wikimedia.org/r/221036

gerritbot added a comment.Jun 26 2015, 1:48 AM

Change 221036 merged by Dzahn:
planet: proxy through url-downloader to fetch URLs

https://gerrit.wikimedia.org/r/221036

Dzahn mentioned this in rOPUP853adcdce1b8: planet: proxy through url-downloader to fetch URLs.Jun 26 2015, 1:48 AM
gerritbot added a comment.Jun 26 2015, 2:12 AM

Change 221040 had a related patch set uploaded (by Dzahn):
planet: besides http_proxy need https_proxy too

https://gerrit.wikimedia.org/r/221040

gerritbot added a comment.Jun 26 2015, 2:13 AM

Change 221040 merged by Dzahn:
planet: besides http_proxy need https_proxy too

https://gerrit.wikimedia.org/r/221040

Dzahn mentioned this in rOPUP73591b12dbff: planet: besides http_proxy need https_proxy too.Jun 26 2015, 2:13 AM
Dzahn added a comment.Jun 26 2015, 3:14 AM

all done. planet is running out of planet1001 in ganeti now and is switched.

see changes above

also feed URL fixes:

https://gerrit.wikimedia.org/r/#/c/221043/
https://gerrit.wikimedia.org/r/#/c/221046/

just open because still needs some cleanup of the old stuff

Dzahn lowered the priority of this task from Medium to Low.Jun 26 2015, 3:14 AM
Dzahn added a comment.EditedJun 26 2015, 3:21 AM

good things:

  • planet-venus 0~git9de2109-3 instead of planet-venus 0~bzr116-1
  • jessie instead of precise
  • one less virtual host on zirconium
  • now a VM, separate from other services
  • feedparser.py now from separate regular package, our bugfix/hack in feedparser removed (-3624 code lines in ops/puppet)
  • xslt-proc now from separate regular package
  • all wordpress feed URLs now https, fixed other changed URLs
  • now fetching URLs via url-downloader instead of directly
Dzahn removed a project: Patch-For-Review.Jun 26 2015, 3:22 AM
Dzahn closed this task as Resolved.Jun 26 2015, 5:11 PM

cleaned up on zirconium (remove docroot, delete systemuser, ...)

done

Dzahn added a parent task: T104946: move all misc services from zirconium to a VM.Jul 7 2015, 6:06 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits