Page MenuHomePhabricator
Create Task
Maniphest T88711

Fully puppetize Grid Engine
Closed, ResolvedPublic
Actions

Description

Currently it is only partially puppetized - we still have to actually add hosts / queues by hand.

  • ensure correct installation order
  • manage custom complexes
  • manage exec hosts
  • manage admin hosts
  • manage submit hosts
  • manage queues
  • manage host groups
  • manage user lists
  • manage admin access (managers)
  • manage Resource Quota Sets (rqs)

Likely (but not essential) tasks concurrent with this

  • puppetdb setup for configuration currently managed in NFS
  • resolution of T195889
  • creating an external qmaster spooldb role/profile and procedure for clush push of the shadow master files

Details

SubjectRepoBranchLines +/-
sonofagridengine: cleanup unused classesoperations/puppetproduction+0 -23
WIP toolforge: write/move a sonofgridengine module and toolforge profileoperations/puppetproduction+4 K -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

yuvipanda created this task.Feb 5 2015, 7:00 PM
yuvipanda assigned this task to coren.
yuvipanda raised the priority of this task from to Needs Triage.
yuvipanda updated the task description. (Show Details)
yuvipanda added projects: Toolforge, Puppet.
yuvipanda subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 5 2015, 7:00 PM
scfc subscribed.Feb 5 2015, 8:04 PM

In general I would like this to move from the filesystem-based stuff to hiera to keep it simple. The ping-pong where one instance writes something to the filesystem and then another is very cool :-), but also feels brittle to me.

faidon triaged this task as Medium priority.Feb 6 2015, 8:54 AM
faidon set Security to None.
scfc moved this task from Backlog to Tracking on the Toolforge board.Feb 18 2015, 5:33 PM
coren removed coren as the assignee of this task.Mar 25 2015, 3:20 PM
Aklapper added a project: Cloud-Services.Oct 24 2015, 8:02 PM
• chasemp merged a task: T95747: Puppetize gridengine master configuration.Dec 3 2015, 2:39 PM
• chasemp added subscribers: • chasemp, valhallasw, coren.
scfc mentioned this in T95747: Puppetize gridengine master configuration.Dec 3 2015, 3:22 PM
• chasemp added a subtask: T95747: Puppetize gridengine master configuration.Dec 3 2015, 3:35 PM
Danny_B added a project: Tracking-Neverending.May 5 2016, 7:44 PM
scfc mentioned this in T136433: toolsbeta grid misconfigured.May 29 2016, 1:59 AM
Danny_B moved this task from Tag to Should be Goal instead on the Tracking-Neverending board.Jul 11 2016, 6:44 PM
• Phabricator_maintenance added a project: Goal.Aug 13 2016, 8:41 PM
• Phabricator_maintenance renamed this task from Fully puppetize Grid Engine (Tracking) to Fully puppetize Grid Engine.Aug 13 2016, 9:54 PM
• Phabricator_maintenance removed a project: Tracking-Neverending.
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:55 PM
• Bstorm added a parent task: T199271: Upgrade the tools gridengine system.Jul 10 2018, 8:10 PM
• Bstorm subscribed.Jul 12 2018, 7:18 PM

T199276#4420812 is one thing needed for this.

• Bstorm mentioned this in T199276: Test running a stretch exec node in the existing system on toolsbeta.Jul 16 2018, 5:53 PM
• Bstorm added a comment.Jul 16 2018, 5:55 PM

I believe T199276#4420812 was possibly due to NFS mount happening after package installation (as long as the setup from the package runs when puppet installs it, which I haven't confirmed for sure yet) since the package install should have created those dirs AND run the initiation script. This becomes a non-issue if puppetdb is used to get around NFS.

• Bstorm removed a project: Cloud-Services.Jul 16 2018, 6:22 PM
• Bstorm updated the task description. (Show Details)
• Bstorm updated the task description. (Show Details)Jul 18 2018, 11:07 PM
• Bstorm updated the task description. (Show Details)Jul 18 2018, 11:48 PM
• Bstorm updated the task description. (Show Details)Aug 8 2018, 3:28 PM

I found that the custom complexes were at least partially done, but they weren't used correctly, so they probably have never been tested.

gerritbot subscribed.Aug 10 2018, 7:33 PM

Change 448791 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] WIP toolforge: write a sonofgridengine module and toolforge profile

https://gerrit.wikimedia.org/r/448791

gerritbot added a project: Patch-For-Review.Aug 10 2018, 7:33 PM
gerritbot added a comment.Oct 12 2018, 10:10 PM

Change 448791 merged by Bstorm:
[operations/puppet@production] WIP toolforge: write/move a sonofgridengine module and toolforge profile

https://gerrit.wikimedia.org/r/448791

• GTirloni added a project: cloud-services-team (Kanban).Mar 23 2019, 9:42 PM
Ladsgroup removed a project: Patch-For-Review.May 28 2019, 3:37 PM
Andrew assigned this task to • Bstorm.Nov 27 2019, 4:30 PM
Andrew subscribed.

this can be closed, can't it?

• Bstorm closed this task as Resolved.Nov 27 2019, 4:32 PM

I'm closing it. Deleting a node needs work, but that exists as another ticket.

bd808 closed subtask T95747: Puppetize gridengine master configuration as Resolved.Jun 11 2020, 11:22 PM
bd808 closed subtask T88712: Puppetize adding new node to OGE as Resolved.Jun 11 2020, 11:27 PM
bd808 closed subtask T88713: Puppetize adding a host to a particular queue as Resolved.
gerritbot added a comment.Jan 4 2022, 3:25 PM

Change 751456 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] sonofagridengine: cleanup unused classes

https://gerrit.wikimedia.org/r/751456

Restricted Application added a project: Infrastructure-Foundations. · View Herald TranscriptJan 4 2022, 3:25 PM
gerritbot added a project: Patch-For-Review.Jan 4 2022, 3:25 PM
gerritbot added a comment.Jan 6 2022, 10:53 AM

Change 751456 merged by David Caro:

[operations/puppet@production] sonofagridengine: cleanup unused classes

https://gerrit.wikimedia.org/r/751456

Maintenance_bot removed a project: Patch-For-Review.Jan 6 2022, 11:10 AM
dcaro closed subtask T88733: Document our GridEngine set up as Declined.Jan 24 2024, 3:26 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits