Separate AQS off of RESTBase
Closed, ResolvedPublic5 Estimated Story Points
Actions

Assigned To

None

Authored By

	• mobrovac
	Feb 9 2016, 12:12 AM

Description

We have moved the framework part of RESTBase into a separate package called HyperSwitch (as per T118404: RFC: Move RESTBase framework functionality to a new package (swagger-service?)). That means that now AQS can have its own source repository and Puppet module, so that its development and deployment can be completely independent of RESTBase.

TODO

Repository separation
- Create a new source repo based on RESTBase's (preserve history)
- Clean it up of redundant and irrelevant code
- Clean up RESTBase repository from AQS code and configs
- Change the AQS deploy repo to point to the new source repo
Create a new Puppet module for AQS
Deploy the new repo and config to the nodes, replacing the current installation present in /srv/deployment/restbase

Details

Subject	Repo	Branch	Lines +/-
Add otto to aqs-admins	operations/puppet	production	+1 -1
Use aqs-admins group for AQS deployment via deploy-service user	operations/puppet	production	+11 -1
AQS: Separate AQS off of RESTBase	operations/puppet	production	+109 -21
Add scap config	analytics/aqs/deploy	master	+32 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	EddieGP	T132259 Deployment-prep hosts with puppet errors (tracking)
Resolved	None	T116206 Set up AQS in Beta
Resolved	None	T126294 Separate AQS off of RESTBase
Resolved	Ottomata	T127720 Allow aqs-admins to deploy via scap using deploy-service ssh key

Event Timeline

• mobrovac created this task.Feb 9 2016, 12:12 AM

• mobrovac raised the priority of this task from to High.

• mobrovac updated the task description. (Show Details)

• mobrovac added projects: Services, HyperSwitch, RESTBase, Analytics.

• mobrovac added subscribers: • mobrovac, Milimetric, JAllemandou.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 9 2016, 12:12 AM

• mobrovac added a subscriber: thcipriani.Feb 9 2016, 4:14 PM

Change 269477 had a related patch set uploaded (by Ppchelko):
Removed RESTBase-specific code from AQS repository.

https://gerrit.wikimedia.org/r/269477

gerritbot added a project: Patch-For-Review.Feb 9 2016, 8:17 PM

Status: @Milimetric created a new source repository directly in Gerrit - analytics/query-service and @Pchelolo imported the history and clean up the code.

• mobrovac updated the task description. (Show Details)Feb 9 2016, 10:29 PM

• mobrovac set Security to None.

Change 269477 merged by Mobrovac:
Removed RESTBase-specific code from AQS repository.

https://gerrit.wikimedia.org/r/269477

• mobrovac updated the task description. (Show Details)Feb 9 2016, 10:44 PM

• mobrovac added a parent task: T116206: Set up AQS in Beta.Feb 9 2016, 11:27 PM

• Pchelolo updated the task description. (Show Details)Feb 9 2016, 11:28 PM

Milimetric moved this task from Incoming to Analytics Query Service on the Analytics board.Feb 11 2016, 6:09 PM

Milimetric moved this task from Analytics Query Service to Radar on the Analytics board.

• Pchelolo mentioned this in T127323: Update AQS yaml format to match new convention {melc}.Feb 18 2016, 6:24 PM

Change 271687 had a related patch set uploaded (by Mobrovac):
AQS: Separate AQS off of RESTBase

https://gerrit.wikimedia.org/r/271687

Preliminary plan for scap deployment of AQS:

figure out proper scap.cfg placement in aqs/deploy
make sure aqs/deploy repo exists and is all good
get /srv/deployment/aqs/deploy on tin (via trebuchet stuff?)
disable puppet on aqs100*
depool aqs1001
merge https://gerrit.wikimedia.org/r/#/c/271687, run puppet on tin and aqs1001
make sure scap deploy works and /srv/deployment/aqs/deploy exists on aqs1001
stop restbase, remove systemd and config files on aqs1001
start aqs, check that things are cool
repool aqs1001
repeat 5-9 for other aqs nodes

The AQS deploy repo is ready for deployment. It needs the scap directory and config file in order for it to be deployed via Scap3, though.

Change 271796 had a related patch set uploaded (by Ottomata):
Add scap config

https://gerrit.wikimedia.org/r/271796

Change 271796 merged by Milimetric:
Add scap config

https://gerrit.wikimedia.org/r/271796

Ok, we are good to go on this. Dan and I moved repos to analytics/aqs and analytics/aqs/deploy. scap.cfg has been added to analytics/aqs/deploy. We're going to wait til Monday to continue.

Ottomata merged a task: T114999: Deploy AQS with scap3.Feb 22 2016, 3:00 PM

Ottomata added subscribers: • Nuria, hashar, JanZerebecki and 5 others.

Change 271687 merged by Ottomata:
AQS: Separate AQS off of RESTBase

https://gerrit.wikimedia.org/r/271687

Ottomata created subtask T127720: Allow aqs-admins to deploy via scap using deploy-service ssh key.Feb 22 2016, 4:39 PM

Change 272516 had a related patch set uploaded (by Ottomata):
Use aqs-admins group for AQS deployment via deploy-service user

https://gerrit.wikimedia.org/r/272516

Change 272516 merged by Ottomata:
Use aqs-admins group for AQS deployment via deploy-service user

https://gerrit.wikimedia.org/r/272516

Change 272518 had a related patch set uploaded (by Ottomata):
Add otto to aqs-admins

https://gerrit.wikimedia.org/r/272518

Change 272518 merged by Ottomata:
Add otto to aqs-admins

https://gerrit.wikimedia.org/r/272518

FYI Step 8. is

sudo rm -rf /etc/restbase/
sudo rm -rf /var/log/restbase/
sudo rm -f /lib/systemd/system/restbase.service
sudo update-rc.d -f restbase remove

Ottomata added a project: Analytics-Kanban.Feb 25 2016, 8:07 PM

Ottomata moved this task from Next Up to Done on the Analytics-Kanban board.

Milimetric set the point value for this task to 5.Mar 3 2016, 5:12 PM

• Nuria closed this task as Resolved.Mar 8 2016, 9:15 PM

Aklapper edited projects, added Analytics-Radar; removed Analytics.Jun 10 2020, 6:44 AM

Separate AQS off of RESTBaseClosed, ResolvedPublic5 Estimated Story PointsActions