⚓ T246854 Replace deployment-mediawiki-parsoid10 with a "purer" deployment-parsoid11 box

Subject	Repo	Branch	Lines +/-
Follow-up Ice6a9431: Fix filename of deployment-parsoid11 hieradata	operations/puppet	production	+0 -0
add hiera keys for parsoid-php on deployment-parsoid11	operations/puppet	production	+20 -0
beta: pull out deployment-parsoid11	operations/puppet	production	+3 -1
cloud: add parsoid cluster in cloud Hiera	operations/puppet	production	+6 -0

Status	Subtype	Assigned	Task
Invalid		None	T178349 Expand the set of bundled extensions and skins to achieve a default MediaWiki experience that's comparable to Wikimedia sites
Resolved		Jdforrester-WMF	T232854 Expand the set of bundled extensions and skins in MediaWiki 1.35
Resolved		Jdforrester-WMF	T243258 Bundle VisualEditor extension with MediaWiki
Open		None	T48826 Sanitizer breaks microdata
Open		None	T248211 One Sanitizer to Rule Them All
Open		None	T247804 Move Sanitizer from core into Parsoid
Resolved	Goal	cscott	T239660 Integrate Parsoid/PHP with core as a composer library
Resolved		cscott	T240055 Craft a deployment strategy to transition Parsoid/PHP from a faux extension to a composer library without breaking incoming requests
Resolved		cscott	T246833 Parsoid/RESTbase seems to be unavailable in Beta
Resolved		Jdforrester-WMF	T246854 Replace deployment-mediawiki-parsoid10 with a "purer" deployment-parsoid11 box
Resolved		Jdforrester-WMF	T247147 Puppet fails on Beta Cluster because "did not find a value for the name 'profile::envoy::ensure'"
Resolved		Krenair	T246937 deployment-puppetmaster04 disc use exploding
Resolved		Krenair	T247151 Puppet fails on Beta Cluster because Safe_service_restart is expecting lvs_services set though `has_lvs: false`
Resolved		Dzahn	T247480 Sync parsoid11 config from Horizon back to puppet git
Resolved		Krenair	T247545 Fix scap on deployment-parsoid11
Resolved		cscott	T247589 Parsoid-PHP should be publicly accessible in beta

Jdforrester-WMF created this task.Mar 4 2020, 1:09 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 4 2020, 1:09 AM

Change 576493 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] add hiera keys for parsoid-php on deployment-parsoid11

https://gerrit.wikimedia.org/r/576493

gerritbot added a project: Patch-For-Review.Mar 4 2020, 1:14 AM

Mentioned in SAL (#wikimedia-releng) [2020-03-04T01:34:48Z] <James_F> Beta Cluster: Created deployment-parsoid11 in Horizon T246854 to test 576493.

cscott added a parent task: T246833: Parsoid/RESTbase seems to be unavailable in Beta.Mar 4 2020, 3:59 PM

cscott mentioned this in T246833: Parsoid/RESTbase seems to be unavailable in Beta.

Change 576898 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] cloud: add parsoid cluster in cloud Hiera

https://gerrit.wikimedia.org/r/576898

cscott mentioned this in T236275: Parsoid-php doesn't get updated after a code deploy.Mar 4 2020, 5:32 PM

Change 576898 merged by Dzahn:
[operations/puppet@production] cloud: add parsoid cluster in cloud Hiera

https://gerrit.wikimedia.org/r/576898

@Jdforrester-WMF Merged on prod master, it should find the cluster now.

Will look.

Jdforrester-WMF moved this task from INBOX to Maintenance on the Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)) board.Mar 4 2020, 6:22 PM

ssastry moved this task from Needs Triage to Testing on the Parsoid board.Mar 5 2020, 11:05 PM

Jdforrester-WMF added a subtask: T246937: deployment-puppetmaster04 disc use exploding .Mar 6 2020, 11:59 PM

Jdforrester-WMF closed subtask T246937: deployment-puppetmaster04 disc use exploding as Resolved.

Jdforrester-WMF closed subtask T247147: Puppet fails on Beta Cluster because "did not find a value for the name 'profile::envoy::ensure'" as Resolved.Mar 7 2020, 1:28 AM

Jdforrester-WMF reopened subtask T247147: Puppet fails on Beta Cluster because "did not find a value for the name 'profile::envoy::ensure'" as Open.

ssastry triaged this task as High priority.Mar 8 2020, 1:00 AM

Krenair closed subtask T247151: Puppet fails on Beta Cluster because Safe_service_restart is expecting lvs_services set though `has_lvs: false` as Resolved.Mar 10 2020, 9:04 PM

• Pchelolo mentioned this in T247295: Add content type check to mobile-html and mobile-html-offline-resources to enforce the latest version.Mar 11 2020, 1:21 PM

This box has Parsoid/JS enabled. The puppet package corresponding to Parsoid/JS should probably be disabled to uninstall Parsoid/JS.

In T246854#5960462, @ssastry wrote:

This box has Parsoid/JS enabled. The puppet package corresponding to Parsoid/JS should probably be disabled to uninstall Parsoid/JS.

There isn't a "puppet package corresponding to Parsoid/JS". There's only one package, Parsoid. I don't see how to switch off the JS. It probably needs the puppet package being re-written?

I see. I suppose when the production puppet package is updated, this will happen as well. Looks like this isn't interfering with Parsoid/PHP in any case. Just need to make sure there are no port conflicts - one of the issues encountered in T231569.

In T246854#5960652, @ssastry wrote:

I see. I suppose when the production puppet package is updated, this will happen as well.

Yes! I was thinking that this would be a good test target for the puppet work to de-JS-ify the production Parsoid servers.

Looks like this isn't interfering with Parsoid/PHP in any case. Just need to make sure there are no port conflicts - one of the issues encountered in T231569.

Agreed.

In T246854#5960666, @Jdforrester-WMF wrote:

In T246854#5960652, @ssastry wrote:

I see. I suppose when the production puppet package is updated, this will happen as well.

Yes! I was thinking that this would be a good test target for the puppet work to de-JS-ify the production Parsoid servers.

I started working on this in https://gerrit.wikimedia.org/r/577044 but the tendrils are deep. It's probably a good idea to try to tackle one small piece at a time, if we can. Doing beta is perhaps a good first step.

Agreed.

@Jdforrester-WMF I'm leaving this task open until you decommission parsoid10, but as far as I can tell nothing should be using parsoid10 now. (https://gerrit.wikimedia.org/r/579018 points to parsoid09 though!)

cscott mentioned this in T247480: Sync parsoid11 config from Horizon back to puppet git.Mar 12 2020, 12:05 AM

cscott added a subtask: T247480: Sync parsoid11 config from Horizon back to puppet git.

Mentioned in SAL (#wikimedia-releng) [2020-03-12T00:34:15Z] <James_F> Shutting down deployment-mediawiki-parsoid10 ahead of its removal T246854

Jdforrester-WMF closed subtask T247147: Puppet fails on Beta Cluster because "did not find a value for the name 'profile::envoy::ensure'" as Resolved.Mar 12 2020, 12:53 AM

Mentioned in SAL (#wikimedia-releng) [2020-03-12T09:38:54Z] <hashar> https://integration.wikimedia.org/ci/job/beta-scap-eqiad/ broken cause it can not ssh to deployment-parsoid11.deployment-prep.eqiad.wmflabs # T246854

Change 579233 had a related patch set uploaded (by Hashar; owner: Hashar):
[operations/puppet@production] beta: pull out deployment-parsoid11

https://gerrit.wikimedia.org/r/579233

cscott added a parent task: T240055: Craft a deployment strategy to transition Parsoid/PHP from a faux extension to a composer library without breaking incoming requests.Mar 12 2020, 5:32 PM

cscott added a subtask: T247545: Fix scap on deployment-parsoid11.Mar 12 2020, 5:35 PM

cscott added a subtask: T247589: Parsoid-PHP should be publicly accessible in beta.Mar 13 2020, 8:25 PM

Change 579233 abandoned by Hashar:
beta: pull out deployment-parsoid11

Reason:
Thx Krenair. role::beta::mediawiki was the class I was looking for :))))

https://gerrit.wikimedia.org/r/579233

Change 576493 merged by Dzahn:
[operations/puppet@production] add hiera keys for parsoid-php on deployment-parsoid11

https://gerrit.wikimedia.org/r/576493

Maintenance_bot removed a project: Patch-For-Review.Mar 13 2020, 9:10 PM

Jdforrester-WMF closed this task as Resolved.Mar 13 2020, 9:10 PM

Jdforrester-WMF closed subtask T247545: Fix scap on deployment-parsoid11 as Resolved.

Jdforrester-WMF closed subtask T247480: Sync parsoid11 config from Horizon back to puppet git as Resolved.

Jdforrester-WMF closed subtask T247589: Parsoid-PHP should be publicly accessible in beta as Resolved.

cscott reopened subtask T247589: Parsoid-PHP should be publicly accessible in beta as Open.Mar 13 2020, 9:13 PM

Change 579650 had a related patch set uploaded (by Alex Monk; owner: Alex Monk):
[operations/puppet@production] Follow-up Ice6a9431: Fix filename of deployment-parsoid11 hieradata

https://gerrit.wikimedia.org/r/579650

Change 579650 merged by Dzahn:
[operations/puppet@production] Follow-up Ice6a9431: Fix filename of deployment-parsoid11 hieradata

https://gerrit.wikimedia.org/r/579650

Maintenance_bot removed a project: Patch-For-Review.Mar 13 2020, 10:10 PM

cscott closed subtask T247589: Parsoid-PHP should be publicly accessible in beta as Resolved.Mar 17 2020, 2:48 AM

Naike reopened subtask T247589: Parsoid-PHP should be publicly accessible in beta as Stalled.Jun 5 2020, 1:30 PM

• Pchelolo closed subtask T247589: Parsoid-PHP should be publicly accessible in beta as Resolved.Jun 5 2020, 1:38 PM