Page MenuHomePhabricator
Create Task
Maniphest T241852

(Need by: TBD) rack/setup/install 86 new codfw mw systems
Closed, ResolvedPublic
Actions

Description

Please note these systems were ordered on T231255, and DC-Ops needs feedback from serviceops on the split between mw, kubenetes, thumbor, & wtp systems ordered on that task.

serviceops: Please update this task to denote how many of the 106 total systems are to be split between mw, kubenetes, thumbor, & wtp. Once we have that info, 3 additional tasks can be filed for kubernetes, thumbor, and wtp.

Racking Proposal:

RowABCD
mw servers19253111

Hostnames: mw2[291-2377].codfw.wmnet
This checklist should be duplicated for EVERY SINGLE HOST:

  • - receive in system on procurement task T231255
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned):
  • - bios/drac/serial setup/testing :
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

Details

SubjectRepoBranchLines +/-
site: add mw2335-mw2339 as appserversoperations/puppetproduction+1 -1
site: add new appservers mw2335 through mw2339operations/puppetproduction+5 -1
add management and production IPs for mw2335-mw2339operations/dnsmaster+31 -4
DHCP: Add MAC address for mw233[5-9]operations/puppetproduction+30 -0
fix fake certificate names for new codfw appserverslabs/privatemaster+0 -0
fake certificates for all remaining new eqiad and codfw appserverslabs/privatemaster+0 -0
DHCP: Add MAC address for mw2350 to mw2365, Add those servers too to site.ppoperations/puppetproduction+101 -0
DNS: Add mgmt and production DNS for mw2350 to mw2365operations/dnsmaster+96 -1
add fake certificates for mw2291 through mw2309labs/privatemaster+0 -0
add mw2291 through mw2300 as API appserversoperations/puppetproduction+11 -1
add codfw appservers in racks A3 and A6 as sparesoperations/puppetproduction+10 -0
site: add mw2366-mw2376 with spare roleoperations/puppetproduction+5 -0
DHCP: Add MAC address for mw236[6-9] mw237[0-6]operations/puppetproduction+66 -0
DNS: Add mgmt and production DNS for mw236[6-9], mw237[0-6]operations/dnsmaster+66 -0
site: add mw2317-24 in rack A3 as API appserversoperations/puppetproduction+13 -5
conftool-data: add 7 new codfw appserversoperations/puppetproduction+7 -0
site: add 7 new codfw appservers in rack B3 with mw roleoperations/puppetproduction+7 -2
add fake keys for new codfw appserver certslabs/privatemaster+0 -0
site: add new codfw mw appservers with spare roleoperations/puppetproduction+10 -0
DHCP: Add MAC address entries for mw2291 to mw2309operations/puppetproduction+114 -0
DNS: Add mgmt and production DNS for mw2291 to mww2309operations/dnsmaster+114 -1
DHCP: Update DHCP file so the new mw servers can use Stretch and not Busteroperations/puppetproduction+25 -0
DHCP: Add MAC address entries for mw2310 to mw2334operations/puppetproduction+125 -0
DNS; Add mgmt and production DNS for mw2310 to mw2334operations/dnsmaster+150 -6
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Mar 5 2020, 12:10 AM

Change 577005 had a related patch set uploaded (by Papaul; owner: Papaul):
[operations/puppet@production] DHCP: Add MAC address for mw2350 to mw2365, Add those servers too to site.pp

https://gerrit.wikimedia.org/r/577005

gerritbot added a comment.Mar 5 2020, 1:48 AM

Change 577005 merged by Papaul:
[operations/puppet@production] DHCP: Add MAC address for mw2350 to mw2365, Add those servers too to site.pp

https://gerrit.wikimedia.org/r/577005

ops-monitoring-bot added a comment.Mar 5 2020, 1:55 AM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2350.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003050155_pt1979_25417_mw2350_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 2:05 AM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2351.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003050205_pt1979_26769_mw2351_codfw_wmnet.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 5 2020, 2:10 AM
ops-monitoring-bot added a comment.Mar 5 2020, 2:18 AM

Completed auto-reimage of hosts:

['mw2350.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 2:20 AM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2352.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003050219_pt1979_31241_mw2352_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 2:27 AM

Completed auto-reimage of hosts:

['mw2351.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 2:28 AM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2353.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003050228_pt1979_947_mw2353_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 2:42 AM

Completed auto-reimage of hosts:

['mw2352.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 2:42 AM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2354.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003050242_pt1979_4738_mw2354_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 2:51 AM

Completed auto-reimage of hosts:

['mw2353.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 2:53 AM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2355.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003050253_pt1979_7508_mw2355_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 3:07 AM

Completed auto-reimage of hosts:

['mw2354.codfw.wmnet']

and were ALL successful.

Papaul added a comment.EditedMar 5 2020, 3:14 AM
Servers Rack C6Ready for service
mw2350Yes
mw2351Yes
mw2352Yes
mw2353Yes
mw2354Yes
mw2355Yes
mw2356Yes
mw2357Yes
mw2358Yes
mw2359Yes
mw2360Yes
mw2361Yes
mw2362Yes
mw2363Yes
mw2364Yes
mw2365Yes
ops-monitoring-bot added a comment.Mar 5 2020, 3:15 AM

Completed auto-reimage of hosts:

['mw2355.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 1:09 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2356.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051309_pt1979_19863_mw2356_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 1:09 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2357.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051309_pt1979_19973_mw2357_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 1:32 PM

Completed auto-reimage of hosts:

['mw2356.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 1:34 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2358.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051334_pt1979_25893_mw2358_codfw_wmnet.log.

Papaul claimed this task.Mar 5 2020, 1:55 PM
ops-monitoring-bot added a comment.Mar 5 2020, 1:56 PM

Completed auto-reimage of hosts:

['mw2358.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 1:59 PM

Completed auto-reimage of hosts:

['mw2357.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 4:54 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2359.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051654_pt1979_30504_mw2359_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 4:59 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2360.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051659_pt1979_31165_mw2360_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 5:18 PM

Completed auto-reimage of hosts:

['mw2359.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 5:22 PM

Completed auto-reimage of hosts:

['mw2360.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 5:23 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2361.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051723_pt1979_4306_mw2361_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 5:26 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2362.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051726_pt1979_4692_mw2362_codfw_wmnet.log.

gerritbot added a comment.Mar 5 2020, 5:38 PM

Change 577308 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[labs/private@master] fake certificates for all remaining new eqiad and codfw appservers

https://gerrit.wikimedia.org/r/577308

gerritbot added a project: Patch-For-Review.Mar 5 2020, 5:38 PM
ops-monitoring-bot added a comment.Mar 5 2020, 5:46 PM

Completed auto-reimage of hosts:

['mw2361.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 5:47 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2363.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051747_pt1979_8865_mw2363_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 5:48 PM

Completed auto-reimage of hosts:

['mw2362.codfw.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 5 2020, 5:49 PM

Change 577308 merged by Dzahn:
[labs/private@master] fake certificates for all remaining new eqiad and codfw appservers

https://gerrit.wikimedia.org/r/577308

Dzahn mentioned this in rLPRI3b58a88e468a: fake certificates for all remaining new eqiad and codfw appservers.Mar 5 2020, 5:52 PM
ops-monitoring-bot added a comment.Mar 5 2020, 5:54 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2364.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051754_pt1979_9989_mw2364_codfw_wmnet.log.

ops-monitoring-bot added a comment.Mar 5 2020, 6:10 PM

Completed auto-reimage of hosts:

['mw2363.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Mar 5 2020, 6:11 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2365.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003051811_pt1979_13802_mw2365_codfw_wmnet.log.

gerritbot added a comment.Mar 5 2020, 6:12 PM

Change 577314 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[labs/private@master] fix fake certificate names for new codfw appservers

https://gerrit.wikimedia.org/r/577314

ops-monitoring-bot added a comment.Mar 5 2020, 6:18 PM

Completed auto-reimage of hosts:

['mw2364.codfw.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 5 2020, 6:26 PM

Change 577314 merged by Dzahn:
[labs/private@master] fix fake certificate names for new codfw appservers

https://gerrit.wikimedia.org/r/577314

Dzahn mentioned this in rLPRIf36ec02782c8: fix fake certificate names for new codfw appservers.Mar 5 2020, 6:27 PM
ops-monitoring-bot added a comment.Mar 5 2020, 6:32 PM

Completed auto-reimage of hosts:

['mw2365.codfw.wmnet']

and were ALL successful.

Papaul added a comment.Mar 5 2020, 6:50 PM

For a Total of 86 mw servers , 71 are done and 15 left. The 15 left are waiting for space in row C in rack C3

Papaul renamed this task from (Need by: TBD) rack/setup/install new codfw mw systems to (Need by: TBD) rack/setup/install 86 new codfw mw systems.Mar 5 2020, 7:10 PM
Dzahn mentioned this in T247018: codfw: decom at least 15 appservers in codfw rack C3 to make room for new servers.Mar 5 2020, 7:20 PM
Dzahn changed the task status from Open to Stalled.EditedMar 5 2020, 7:23 PM

thanks Papaul for all the new servers. We'll continue with racking right after eqiad is done. We can do that on separate ticket ( T247021) as well to keep service implementation out of it.

I made T247018 which now blocks this ticket.

Dzahn mentioned this in T247021: move all 86 new codfw appservers into production (mw2[291-2377].codfw.wmnet).Mar 5 2020, 7:29 PM
Papaul moved this task from Racking Tasks to Blocked on the ops-codfw board.Mar 6 2020, 1:00 AM
Maintenance_bot removed a project: Patch-For-Review.Mar 6 2020, 1:11 AM
Dzahn added a comment.EditedMar 6 2020, 1:51 AM

mw2291 through mw2324 are now pooled and status active in netbox (34 servers) https://gerrit.wikimedia.org/r/q/topic:%22appservers-codfw%22+(status:open%20OR%20status:merged)

mw2325 through mw2334 are not pooled but in site.pp and status staged in netbox (10 servers) https://gerrit.wikimedia.org/r/c/operations/puppet/+/577408

mw2335 through mw2349 are not pooled, not in site.pp and status planned in netbox (15 servers) (blocked by T247018)

mw2350 through mw2376 are not pooled, in site.pp and and status staged in netbox ((27 servers) (https://gerrit.wikimedia.org/r/c/operations/puppet/+/577409)

total: 86 servers

Dzahn changed the status of subtask T247021: move all 86 new codfw appservers into production (mw2[291-2377].codfw.wmnet) from Open to Stalled.Apr 10 2020, 9:32 AM
akosiaris mentioned this in T252185: (Need by: TBD) rack/setup/install kubernetes20[07-14].codfw.wmnet and kubestage200[1-2].codfw.wmnet..May 8 2020, 9:10 AM
Papaul added a comment.May 19 2020, 2:14 PM

We have 5 mw servers left to be racked in row c rack c3 since we used 10 servers in T252185

Dzahn changed the status of subtask T247021: move all 86 new codfw appservers into production (mw2[291-2377].codfw.wmnet) from Stalled to Open.May 22 2020, 12:19 PM
Dzahn changed the task status from Stalled to Open.May 22 2020, 2:34 PM

Hi @Papaul

23 servers from rack C3 have been decom'ed. mw2150 through mw2172. (lower part of the rack)

You can:

  • remove these physically from the rack
  • use the space for your planned test of new cabling schema
  • rack 5 new servers in their place

In an order of your choice.

Next week I am planning to remove even more so we might be able to empty out almost the entire C3.

also: T247018#6158017.

Papaul added a comment.May 22 2020, 2:46 PM

@Dzahn Thanks

Papaul moved this task from Blocked to Racking Tasks on the ops-codfw board.May 24 2020, 4:14 PM
gerritbot added a comment.May 29 2020, 9:10 AM

Change 599749 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: add new appservers mw2336 through mw2339

https://gerrit.wikimedia.org/r/599749

gerritbot added a project: Patch-For-Review.May 29 2020, 9:10 AM
Papaul updated the task description. (Show Details)Jun 9 2020, 6:04 PM
Papaul updated the task description. (Show Details)Jun 10 2020, 12:15 AM
gerritbot added a comment.Jun 10 2020, 10:50 AM

Change 604339 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] add management and production IPs for mw2335-mw2339

https://gerrit.wikimedia.org/r/604339

Dzahn added a comment.Jun 10 2020, 10:51 AM

@Papaul I uploaded a new change to add mgmt and production IPs for mw2335-mw2339 (C3). Does it look good to you?

gerritbot added a comment.Jun 10 2020, 1:58 PM

Change 604393 had a related patch set uploaded (by Papaul; owner: Papaul):
[operations/puppet@production] DHCP: Add MAC address for mw233[5-9]

https://gerrit.wikimedia.org/r/604393

gerritbot added a comment.Jun 10 2020, 2:03 PM

Change 604393 merged by Dzahn:
[operations/puppet@production] DHCP: Add MAC address for mw233[5-9]

https://gerrit.wikimedia.org/r/604393

gerritbot added a comment.Jun 10 2020, 2:46 PM

Change 604339 merged by Dzahn:
[operations/dns@master] add management and production IPs for mw2335-mw2339

https://gerrit.wikimedia.org/r/604339

Papaul added a comment.Jun 10 2020, 2:57 PM
[edit interfaces interface-range vlan-private1-c-codfw]
     member xe-7/0/3 { ... }
+    member ge-3/0/3;
+    member ge-3/0/4;
+    member ge-3/0/5;
+    member ge-3/0/6;
+    member ge-3/0/7;
[edit interfaces interface-range disabled]
-    member ge-3/0/3;
-    member ge-3/0/4;
-    member ge-3/0/5;
-    member ge-3/0/6;
-    member ge-3/0/7;
Papaul updated the task description. (Show Details)Jun 10 2020, 2:59 PM
ops-monitoring-bot added a comment.Jun 10 2020, 3:04 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2335.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202006101504_pt1979_1393_mw2335_codfw_wmnet.log.

gerritbot added a comment.Jun 10 2020, 3:11 PM

Change 599749 merged by Dzahn:
[operations/puppet@production] site: add new appservers mw2335 through mw2339

https://gerrit.wikimedia.org/r/599749

ops-monitoring-bot added a comment.Jun 10 2020, 3:20 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2336.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202006101519_pt1979_4336_mw2336_codfw_wmnet.log.

ops-monitoring-bot added a comment.Jun 10 2020, 3:26 PM

Completed auto-reimage of hosts:

['mw2335.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Jun 10 2020, 3:30 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2337.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202006101529_pt1979_6453_mw2337_codfw_wmnet.log.

ops-monitoring-bot added a comment.Jun 10 2020, 3:43 PM

Completed auto-reimage of hosts:

['mw2336.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Jun 10 2020, 3:45 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2338.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202006101545_pt1979_10271_mw2338_codfw_wmnet.log.

gerritbot added a comment.Jun 10 2020, 3:52 PM

Change 604429 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site/conftool: add mw2335-mw2339 as appservers

https://gerrit.wikimedia.org/r/604429

ops-monitoring-bot added a comment.Jun 10 2020, 3:55 PM

Completed auto-reimage of hosts:

['mw2337.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Jun 10 2020, 3:56 PM

Script wmf-auto-reimage was launched by pt1979 on cumin2001.codfw.wmnet for hosts:

mw2339.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/202006101556_pt1979_12212_mw2339_codfw_wmnet.log.

ops-monitoring-bot added a comment.Jun 10 2020, 4:09 PM

Completed auto-reimage of hosts:

['mw2338.codfw.wmnet']

and were ALL successful.

ops-monitoring-bot added a comment.Jun 10 2020, 4:18 PM

Completed auto-reimage of hosts:

['mw2339.codfw.wmnet']

and were ALL successful.

Papaul closed this task as Resolved.Jun 10 2020, 4:28 PM
Papaul updated the task description. (Show Details)

@Dzahn the 5 servers in C3 are ready for services

• wkandek subscribed.Jun 10 2020, 9:13 PM
gerritbot added a comment.Jun 17 2020, 2:08 PM

Change 604429 merged by Dzahn:
[operations/puppet@production] site: add mw2335-mw2339 as appservers

https://gerrit.wikimedia.org/r/604429

Maintenance_bot removed a project: Patch-For-Review.Jun 17 2020, 2:11 PM
Dzahn added a comment.Jun 17 2020, 3:24 PM
In T241852#6211870, @Papaul wrote:

@Dzahn the 5 servers in C3 are ready for services

They are now in production. (details in T247021)

Dzahn added a comment.Jun 17 2020, 3:30 PM

@Papaul This ticket talks about mw2377 but it seems to me we never had a host mw2377 (only up to mw2376). Can you confirm that?

Dzahn added a comment.Jun 17 2020, 3:32 PM

76 servers are pooled as appservers. 10 have been used for kubernetes. Adds up to 86.

Dzahn closed subtask T247021: move all 86 new codfw appservers into production (mw2[291-2377].codfw.wmnet) as Resolved.Jun 17 2020, 3:33 PM
Papaul added a comment.Jun 17 2020, 5:36 PM

@Dzahn confirm we have up to mw2376

Dzahn awarded a token.Jun 17 2020, 5:45 PM
akosiaris closed subtask T252185: (Need by: TBD) rack/setup/install kubernetes20[07-14].codfw.wmnet and kubestage200[1-2].codfw.wmnet. as Resolved.Dec 14 2020, 4:06 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL