Page MenuHomePhabricator
Create Task
Maniphest T306469

Convert Striker to a container-based deployment
Closed, ResolvedPublic
Actions

Description

Striker currently uses scap3 and a relatively elaborate process for preparing the deployment repository to ship code to production. This system was largely copied from deployment tooling for ORES. It is functional, but also complicated and occasionally fragile.

Toolhub is using a newer deployment process based on PipelineLib. This process creates and publishes container images as a post-merge CI step. These images can then be used in the production Kubernetes cluster and elsewhere to deploy the application.

Discussion with @Andrew has revealed that he is willing to allow some experimentation with running Striker as a container on the labweb* production hosts. We are not seeking to deploy into the production Kubernetes cluster at this point.

  • Add pipelinelib config to Striker
  • Switch tests to pipelinelib
  • Rebuild demo environment with Docker
  • Provision Docker container on {cloud,lab}web* hosts
  • Ensure error pages, favicon, robots.txt are served from the container
  • Open firewall for port 8080 on {cloud,lab}web* hosts (but also not needed and should be reverted)
  • Point CDN at port 8080 container (at local envoy layer)
  • Ensure that log events are getting from Docker all the way to the ELK cluster
  • Remove uwsgi version of Striker from {cloud,lab}web* hosts
  • Remove striker from scap3 config

Details

SubjectRepoBranchLines +/-
dsh: remove old labweb hostsoperations/puppetproduction+0 -2
striker: route syslog output to ELK cluster via kafkaoperations/puppetproduction+2 -1
service::docker: Add SyslogIdentifier to systemd unitoperations/puppetproduction+1 -0
striker: remove legacy deploymentoperations/puppetproduction+13 -452
striker: remove from scap::sourcesoperations/puppetproduction+0 -2
striker: Remove uwsgi deployment logging configoperations/puppetproduction+0 -14
striker: remove legacy settingslabs/privatemaster+0 -20
hieradata: cloudweb-dev: route striker to the docker portoperations/puppetproduction+6 -0
Revert "striker: Open firewall for Docker-managed service"operations/puppetproduction+0 -5
labweb: point tlsproxy envoy at %{facts.ipaddress}:8080 for strikeroperations/puppetproduction+11 -2
labweb: move striker, wikitech, horizon behind envoyoperations/puppetproduction+13 -8
labweb: point tlsproxy envoy at port 8080 for strikeroperations/puppetproduction+9 -2
labweb: point tlsproxy envoy at port 8080 for strikeroperations/puppetproduction+16 -2
striker: Open firewall for Docker-managed serviceoperations/puppetproduction+5 -0
striker: Bump container version to 2022-07-01-210101-productionoperations/puppetproduction+2 -2
Add 'whitenoise' for static file servinglabs/strikermaster+11 -4
Handle /robots.txt and /favicon.ico routeslabs/strikermaster+12 -0
striker: connect docker container directly to host networkoperations/puppetproduction+18 -8
dev: run production variant on port 8080labs/strikermaster+1 -1
striker: Add profile to provision docker containeroperations/puppetproduction+114 -6
cloudweb: include ::profile::docker::ferm so docker can mess with iptablesoperations/puppetproduction+1 -0
striker: require ::profile::docker::ferm in ::profile::wmcs::striker::dockeroperations/puppetproduction+1 -1
striker: add fake hiera secretslabs/privatemaster+11 -0
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
bd808 claimed this task.Apr 19 2022, 7:54 PM
bd808 triaged this task as High priority.
bd808 added a subtask: T271668: Create Buster dev environment for Striker.
bd808 added a project: Developer-Advocacy (Apr-Jun 2022).
Restricted Application added a project: User-bd808. · View Herald TranscriptApr 19 2022, 7:56 PM
bd808 moved this task from Ready to Doing on the Striker board.Apr 19 2022, 7:56 PM
bd808 changed the status of subtask T306470: Replace ini config system with envvar config system from Open to In Progress.Apr 20 2022, 12:06 AM
bd808 changed the status of subtask T306668: Convert Striker CI to PipelineLib from Open to In Progress.Apr 21 2022, 9:31 PM
bd808 closed subtask T306668: Convert Striker CI to PipelineLib as Resolved.Apr 27 2022, 12:18 AM
bd808 closed subtask T306470: Replace ini config system with envvar config system as Resolved.
bd808 closed subtask T271668: Create Buster dev environment for Striker as Resolved.May 8 2022, 3:13 PM
bd808 added a comment.May 8 2022, 3:20 PM

We now have a Docker based local development environment, PipelineLib integration to create and publish a container after each git merge, and a demo environment using published containers. The next big step is to make a new Puppet profile using service:docker to provision a runtime based on published containers as well.

gerritbot added a comment.May 8 2022, 8:58 PM

Change 790012 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: Add profile to provision docker container

https://gerrit.wikimedia.org/r/790012

gerritbot added a project: Patch-For-Review.May 8 2022, 8:58 PM
gerritbot added a comment.May 8 2022, 9:33 PM

Change 790013 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[labs/private@master] striker: add fake hiera secrets

https://gerrit.wikimedia.org/r/790013

gerritbot added a comment.May 9 2022, 6:38 PM

Change 790013 merged by Andrew Bogott:

[labs/private@master] striker: add fake hiera secrets

https://gerrit.wikimedia.org/r/790013

bd808 mentioned this in rLPRI99937c8db1a7: striker: add fake hiera secrets.May 9 2022, 7:02 PM
bd808 moved this task from To Do to In Dev/Progress on the User-bd808 board.May 18 2022, 9:30 PM
gerritbot added a comment.Jun 28 2022, 8:40 PM

Change 790012 merged by Andrew Bogott:

[operations/puppet@production] striker: Add profile to provision docker container

https://gerrit.wikimedia.org/r/790012

gerritbot added a comment.Jun 28 2022, 8:54 PM

Change 809285 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] cloudweb: include ::profile::docker::ferm so docker can mess with iptables

https://gerrit.wikimedia.org/r/809285

gerritbot added a comment.Jun 28 2022, 8:55 PM

Change 809285 merged by Andrew Bogott:

[operations/puppet@production] cloudweb: include ::profile::docker::ferm so docker can mess with iptables

https://gerrit.wikimedia.org/r/809285

Maintenance_bot removed a project: Patch-For-Review.Jun 28 2022, 9:30 PM
gerritbot added a comment.Jun 28 2022, 10:19 PM

Change 809306 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: require ::profile::docker::ferm in ::profile::wmcs::striker::docker

https://gerrit.wikimedia.org/r/809306

gerritbot added a project: Patch-For-Review.Jun 28 2022, 10:19 PM
gerritbot added a comment.Jun 28 2022, 10:36 PM

Change 809306 merged by Andrew Bogott:

[operations/puppet@production] striker: require ::profile::docker::ferm in ::profile::wmcs::striker::docker

https://gerrit.wikimedia.org/r/809306

Maintenance_bot removed a project: Patch-For-Review.Jun 28 2022, 11:30 PM
gerritbot added a comment.Jun 29 2022, 12:28 AM

Change 809333 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[labs/striker@master] dev: run production variant on port 8080

https://gerrit.wikimedia.org/r/809333

gerritbot added a project: Patch-For-Review.Jun 29 2022, 12:28 AM
gerritbot added a comment.Jun 29 2022, 12:41 AM

Change 809333 merged by jenkins-bot:

[labs/striker@master] dev: run production variant on port 8080

https://gerrit.wikimedia.org/r/809333

gerritbot added a comment.Jun 29 2022, 10:58 PM

Change 809714 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: connect docker container directly to host network

https://gerrit.wikimedia.org/r/809714

gerritbot added a comment.Jun 30 2022, 9:40 PM

Change 809714 merged by Andrew Bogott:

[operations/puppet@production] striker: connect docker container directly to host network

https://gerrit.wikimedia.org/r/809714

bd808 added a comment.Jul 1 2022, 4:07 PM

A Docker container hosting Striker on the {cloud,lab}web* hosts. The container is bound to the host network rather than the default Docker bridge network to allow Striker to talk to nutcracker on the localhost. Striker is exposed on port 8080 of each host. This port is currently not open on the local firewall, so the running Striker is only available via localhost at the moment.

bd808 updated the task description. (Show Details)Jul 1 2022, 4:11 PM
gerritbot added a comment.Jul 1 2022, 8:42 PM

Change 810406 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[labs/striker@master] Add 'whitenoise' for static file serving

https://gerrit.wikimedia.org/r/810406

gerritbot added a comment.Jul 1 2022, 8:42 PM

Change 810407 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[labs/striker@master] Handle /robots.txt and /favicon.ico routes

https://gerrit.wikimedia.org/r/810407

gerritbot added a comment.Jul 1 2022, 9:00 PM

Change 810406 merged by jenkins-bot:

[labs/striker@master] Add 'whitenoise' for static file serving

https://gerrit.wikimedia.org/r/810406

gerritbot added a comment.Jul 1 2022, 9:00 PM

Change 810407 merged by jenkins-bot:

[labs/striker@master] Handle /robots.txt and /favicon.ico routes

https://gerrit.wikimedia.org/r/810407

bd808 updated the task description. (Show Details)Jul 1 2022, 10:24 PM
gerritbot added a comment.Jul 1 2022, 10:31 PM

Change 810413 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: Open firewall for Docker-managed service

https://gerrit.wikimedia.org/r/810413

gerritbot added a comment.Jul 1 2022, 10:31 PM

Change 810414 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: Bump container version to 2022-07-01-210101-production

https://gerrit.wikimedia.org/r/810414

gerritbot added a comment.Jul 2 2022, 4:21 PM

Change 810413 merged by Andrew Bogott:

[operations/puppet@production] striker: Open firewall for Docker-managed service

https://gerrit.wikimedia.org/r/810413

gerritbot added a comment.Jul 2 2022, 4:22 PM

Change 810414 merged by Andrew Bogott:

[operations/puppet@production] striker: Bump container version to 2022-07-01-210101-production

https://gerrit.wikimedia.org/r/810414

gerritbot added a comment.Jul 5 2022, 4:09 PM

Change 811332 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] hieradata: cloudweb-dev: route striker to the docker port

https://gerrit.wikimedia.org/r/811332

bd808 updated the task description. (Show Details)Jul 5 2022, 4:15 PM
gerritbot added a comment.Jul 5 2022, 4:18 PM

Change 811274 had a related patch set uploaded (by BryanDavis; author: BryanDavis):

[operations/puppet@production] Revert "striker: Open firewall for Docker-managed service"

https://gerrit.wikimedia.org/r/811274

gerritbot added a comment.Jul 5 2022, 4:46 PM

Change 811337 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] labweb: point tlsproxy envoy at port 8080 for striker

https://gerrit.wikimedia.org/r/811337

gerritbot added a comment.Jul 5 2022, 7:04 PM

Change 811337 merged by Andrew Bogott:

[operations/puppet@production] labweb: point tlsproxy envoy at port 8080 for striker

https://gerrit.wikimedia.org/r/811337

gerritbot added a comment.Jul 5 2022, 10:01 PM

Change 811381 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] labweb: point tlsproxy envoy at port 8080 for striker

https://gerrit.wikimedia.org/r/811381

bd808 added a comment.Jul 7 2022, 7:31 PM
In T306469#8053170, @gerritbot wrote:

Change 811337 merged by Andrew Bogott:

[operations/puppet@production] labweb: point tlsproxy envoy at port 8080 for striker

https://gerrit.wikimedia.org/r/811337

This was reverted with https://gerrit.wikimedia.org/r/c/operations/puppet/+/811277.

gerritbot added a comment.Jul 7 2022, 9:50 PM

Change 811381 merged by Andrew Bogott:

[operations/puppet@production] labweb: point tlsproxy envoy at port 8080 for striker

https://gerrit.wikimedia.org/r/811381

bd808 added a comment.EditedJul 7 2022, 10:02 PM
In T306469#8063720, @gerritbot wrote:

Change 811381 merged by Andrew Bogott:

[operations/puppet@production] labweb: point tlsproxy envoy at port 8080 for striker

https://gerrit.wikimedia.org/r/811381

This was reverted with https://gerrit.wikimedia.org/r/c/operations/puppet/+/811965/.

The problem this time was that apache has an explicit vhost for 127.0.0.1:80 which captured the envoy traffic we intended to go to the *:80 vhosts for horizon and wikitech.

gerritbot added a comment.Jul 7 2022, 10:49 PM

Change 812096 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] labweb: move striker, wikitech, horizon behind envoy

https://gerrit.wikimedia.org/r/812096

gerritbot added a comment.Jul 7 2022, 10:59 PM

Change 812096 merged by Andrew Bogott:

[operations/puppet@production] labweb: move striker, wikitech, horizon behind envoy

https://gerrit.wikimedia.org/r/812096

bd808 added a comment.Jul 7 2022, 11:11 PM
In T306469#8063929, @gerritbot wrote:

Change 812096 merged by Andrew Bogott:

[operations/puppet@production] labweb: move striker, wikitech, horizon behind envoy

https://gerrit.wikimedia.org/r/812096

Reverted by https://gerrit.wikimedia.org/r/c/operations/puppet/+/812106/.

Envoy again served unexpected content for wikitech and horizon requests.

gerritbot added a comment.Jul 8 2022, 5:20 PM

Change 812381 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] labweb: point tlsproxy envoy at %{facts.ipaddress}:8080 for striker

https://gerrit.wikimedia.org/r/812381

bd808 edited projects, added Developer-Advocacy (Jul-Sep 2022); removed Developer-Advocacy (Apr-Jun 2022).Jul 8 2022, 9:33 PM
gerritbot added a comment.Jul 19 2022, 8:14 PM

Change 812381 merged by Andrew Bogott:

[operations/puppet@production] labweb: point tlsproxy envoy at %{facts.ipaddress}:8080 for striker

https://gerrit.wikimedia.org/r/812381

bd808 updated the task description. (Show Details)Jul 19 2022, 11:11 PM

https://toolsadmin.wikimedia.org is now being served from Docker containers running on labweb100[12]. Initial manual testing of everything looks good. I'm going to wait a few days before starting on the cleanup side of this task which will remove the now legacy uwsgi deployment.

bd808 updated the task description. (Show Details)Jul 20 2022, 3:23 PM
gerritbot added a comment.Jul 20 2022, 6:01 PM

Change 811274 merged by Andrew Bogott:

[operations/puppet@production] Revert "striker: Open firewall for Docker-managed service"

https://gerrit.wikimedia.org/r/811274

gerritbot added a comment.Jul 20 2022, 6:04 PM

Change 811332 merged by Andrew Bogott:

[operations/puppet@production] hieradata: cloudweb-dev: route striker to the docker port

https://gerrit.wikimedia.org/r/811332

gerritbot added a comment.Aug 1 2022, 4:50 PM

Change 819116 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[labs/private@master] striker: remove legacy settings

https://gerrit.wikimedia.org/r/819116

gerritbot added a comment.Aug 1 2022, 5:20 PM

Change 819121 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: remove legacy deployment

https://gerrit.wikimedia.org/r/819121

gerritbot added a comment.Aug 2 2022, 4:56 PM

Change 819121 merged by Andrew Bogott:

[operations/puppet@production] striker: remove legacy deployment

https://gerrit.wikimedia.org/r/819121

gerritbot added a comment.Aug 2 2022, 5:00 PM

Change 819116 merged by Andrew Bogott:

[labs/private@master] striker: remove legacy settings

https://gerrit.wikimedia.org/r/819116

bd808 mentioned this in rLPRI04a01f844960: striker: remove legacy settings.Aug 2 2022, 5:01 PM
bd808 added a comment.Aug 3 2022, 6:16 PM

Remove uwsgi version of Striker from {cloud,lab}web* hosts

The labweb hosts are in the process of being decommed, so we only need to clean the cloudweb nodes. These commands were used:

$ sudo service uwsgi-striker stop
$ sudo rm /lib/systemd/system/uwsgi-striker.service
$ sudo /bin/systemctl daemon-reload

$ sudo rm /etc/striker/striker.ini
$ sudo rm /etc/apache2/sites-available/50-striker.conf
$ sudo rm /etc/uwsgi/apps-enabled/striker.ini
$ sudo rm /etc/uwsgi/apps-available/striker.ini

$ sudo rm /etc/nagios/nrpe.d/check_uwsgi-striker.cfg

$ sudo rm -r /srv/deployment/striker

$ sudo -i puppet agent -tv
  • cloudweb2002-dev.wikimedia.org
  • cloudweb1004.wikimedia.org
  • cloudweb1003.wikimedia.org
bd808 updated the task description. (Show Details)Aug 3 2022, 6:17 PM
gerritbot added a comment.Aug 3 2022, 7:45 PM

Change 820206 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: Remove uwsgi deployment logging config

https://gerrit.wikimedia.org/r/820206

gerritbot added a comment.Aug 3 2022, 7:45 PM

Change 820207 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: remove from scap::sources

https://gerrit.wikimedia.org/r/820207

gerritbot added a comment.Aug 3 2022, 8:11 PM

Change 820206 merged by Andrew Bogott:

[operations/puppet@production] striker: Remove uwsgi deployment logging config

https://gerrit.wikimedia.org/r/820206

gerritbot added a comment.Aug 3 2022, 8:13 PM

Change 820207 merged by Andrew Bogott:

[operations/puppet@production] striker: remove from scap::sources

https://gerrit.wikimedia.org/r/820207

bd808 updated the task description. (Show Details)Aug 3 2022, 10:00 PM
gerritbot added a comment.Aug 3 2022, 10:25 PM

Change 820237 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] service::docker: Add SyslogIdentifier to systemd unit

https://gerrit.wikimedia.org/r/820237

gerritbot added a comment.Aug 3 2022, 10:25 PM

Change 820238 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] striker: route syslog output to ELK cluster via kafka

https://gerrit.wikimedia.org/r/820238

gerritbot added a comment.Aug 4 2022, 3:34 PM

Change 820237 merged by Cwhite:

[operations/puppet@production] service::docker: Add SyslogIdentifier to systemd unit

https://gerrit.wikimedia.org/r/820237

gerritbot added a comment.Aug 4 2022, 3:40 PM

Change 820238 merged by Cwhite:

[operations/puppet@production] striker: route syslog output to ELK cluster via kafka

https://gerrit.wikimedia.org/r/820238

bd808 closed this task as Resolved.Aug 5 2022, 9:47 PM
bd808 updated the task description. (Show Details)
bd808 mentioned this in T304869: StrikerBot doing deprecated action=oathvalidate&totp= queries.Aug 5 2022, 9:57 PM
dcaro subscribed.Aug 8 2022, 10:02 AM

Manually masked the wmf_autorestart services for striker uswgi service (was removed), and reset the failed state:

root@cloudweb1003:~# systemctl mask wmf_auto_restart_uwsgi-striker.timer
Created symlink /etc/systemd/system/wmf_auto_restart_uwsgi-striker.timer → /dev/null.
root@cloudweb1003:~# systemctl mask wmf_auto_restart_uwsgi-striker.service
Created symlink /etc/systemd/system/wmf_auto_restart_uwsgi-striker.service → /dev/null.

root@cloudweb1003:~# systemctl reset-failed

It was triggering some alerts (https://alerts.wikimedia.org/?q=team%3Dwmcs):

critical
Check systemd state
summary: CRITICAL - degraded: The following units failed: wmf_auto_restart_uwsgi-striker.service
3 days ago
instance: cloudweb1004
source: icinga
team: wmcs
@receiver: irc-spam
runbook
RhinosF1 subscribed.Aug 8 2022, 10:10 AM

Manually masked the wmf_autorestart services for striker uswgi service (was removed), and reset the failed state:

Was removed with https://github.com/wikimedia/puppet/commit/c7be95a4448f8d7cd6b030b8d3047d543996c2de#diff-ebf0da109f631a42e558175237b41ea3477ccedcb01c2a82b980b8d87b0870b2L144 so likely missed from the cleanup in T306469#8129139 and can be completely deleted

bd808 added a comment.Aug 8 2022, 5:44 PM
In T306469#8136822, @dcaro wrote:

Manually masked the wmf_autorestart services for striker uswgi service (was removed), and reset the failed state:

Thank you @dcaro

In T306469#8136837, @RhinosF1 wrote:

Was removed with https://github.com/wikimedia/puppet/commit/c7be95a4448f8d7cd6b030b8d3047d543996c2de#diff-ebf0da109f631a42e558175237b41ea3477ccedcb01c2a82b980b8d87b0870b2L144 so likely missed from the cleanup in T306469#8129139 and can be completely deleted

Yes, this is just more cruft from the manifests I deleted because I was too lazy to figure out how to make them "ensure => absent". It would have been more ideal for me to remove things before the role was applied to the new cloudweb100[34] boxes, but I can't find the keys to the time machine.

bd808 added a comment.Aug 8 2022, 5:56 PM
In T306469#8138172, @bd808 wrote:
In T306469#8136837, @RhinosF1 wrote:

Was removed with https://github.com/wikimedia/puppet/commit/c7be95a4448f8d7cd6b030b8d3047d543996c2de#diff-ebf0da109f631a42e558175237b41ea3477ccedcb01c2a82b980b8d87b0870b2L144 so likely missed from the cleanup in T306469#8129139 and can be completely deleted

Yes, this is just more cruft from the manifests I deleted because I was too lazy to figure out how to make them "ensure => absent". It would have been more ideal for me to remove things before the role was applied to the new cloudweb100[34] boxes, but I can't find the keys to the time machine.

Cleaned up on cloudweb1003, cloudweb1004, & cloudweb2002-dev:

$ sudo rm /lib/systemd/system/wmf_auto_restart_uwsgi-striker.{service,timer}
$ sudo rm /etc/systemd/system/wmf_auto_restart_uwsgi-striker.{service,timer}
$ sudo /bin/systemctl daemon-reload
gerritbot added a comment.Aug 10 2022, 8:28 AM

Change 821733 had a related patch set uploaded (by RhinosF1; author: RhinosF1):

[operations/puppet@production] dsh: remove old labweb hosts

https://gerrit.wikimedia.org/r/821733

gerritbot added a comment.Aug 10 2022, 2:40 PM

Change 821733 merged by Andrew Bogott:

[operations/puppet@production] dsh: remove old labweb hosts

https://gerrit.wikimedia.org/r/821733

bd808 mentioned this in T270640: Toolinfo records do not always have a url value.Aug 19 2022, 3:23 PM
bd808 mentioned this in T151422: Striker error log events not getting into ELK cluster due to truncation of JSON payload.Aug 19 2022, 6:01 PM
bd808 mentioned this in T341640: Move Horizon deploy to a Docker container.Jul 11 2023, 11:31 PM
Maintenance_bot removed a project: Patch-For-Review.Jul 12 2023, 12:10 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits