T249756 contains useful details about what the Analytics team wants to do for the AQS Cassandra 3 upgrade, namely doing it in place.
This task should be about finding a suitable testing environment to test the 2.2 -> 3.11 upgrade procedure, and possibly writing the spicerack/cookbook automation to do it.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | BTullis | T249755 Cassandra3 migration for Analytics AQS | |||
| Resolved | BTullis | T257572 Set up a testing environment for the AQS Cassandra 3 migration |
A lot of things changed, we are getting the 6 new nodes for AQS (due to hw refresh) sooner so our idea is the following:
This means that the "testing" environment will basically also be the final production environment, but it seems the best compromise to do all the following:
Change 670197 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/puppet@production] aqs: make aqs1010 a separate AQS cluster
Change 670197 merged by Hnowlan:
[operations/puppet@production] aqs: make aqs1010 a separate AQS cluster
Change 671132 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/puppet@production] aqs: add aqs1011 to cassandra 3.11 test cluster
Change 672366 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[operations/puppet@production] aqs: move import of ::passwords::aqs
Change 672372 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[labs/private@master] passwords::cassandra: add aqs password entry
Change 672372 merged by Hnowlan:
[labs/private@master] passwords::cassandra: add aqs password entry
Change 672441 had a related patch set uploaded (by Hnowlan; owner: Hnowlan):
[labs/private@master] aqs: move password to hieradata rather than password module
Change 672366 merged by Hnowlan:
[operations/puppet@production] aqs: move import of ::passwords::aqs
Change 671132 merged by Hnowlan:
[operations/puppet@production] aqs: add aqs1011 to cassandra 3.11 test cluster, add aqs_next role
Change 672441 abandoned by Hnowlan:
[labs/private@master] aqs: move password to hieradata rather than password module
Reason:
jbond did this in another change
Change 679295 had a related patch set uploaded (by Hnowlan; author: Hnowlan):
[analytics/aqs@master] Add docker-compose environment with cassandra
In lieu of having a test environment or a WMCS cluster, we are planning on pursuing a docker-compose environment that will let us do testing and experimentation in a clean dockerised cluster: https://gerrit.wikimedia.org/r/c/analytics/aqs/+/679295
I think that this item can be closed. We used the new cluster as a testing environment as outlined above.
Now the new cluster is in production and we have begun to decommisison the old cluster.
Change 679295 abandoned by Hnowlan:
[analytics/aqs@master] Add docker-compose environment with cassandra
Reason:
Not needed