Page MenuHomePhabricator
Create Task
Maniphest T277653

Toolforge: add Debian Buster to the grid and eliminate Debian Stretch
Closed, ResolvedPublic
Actions

Description

Migrate tools/toolsbeta grid to Debian Buster since Stretch is deprecated. This is mostly just adding Buster queues, but then Stretch queues need to go away.

About the migration itself, this will be handled by (@komla):

Details

Other Assignee
taavi
ProjectBranchLines +/-Subject
operations/puppetproduction+0 -13P:toolforge::checker: remove stretch endpoints
operations/software/tools-webservicemaster+2 -2Remove stretch support
labs/toollabsmaster+1 -1jsub: Remove stretch support
operations/puppetproduction+6 -6icinga::monitor::toollabs: replace stretch with buster
operations/puppetproduction+2 -0P:toolforge::checker: add missing endpoint config
operations/puppetproduction+11 -0P:toolforge::checker: add buster endpoints
labs/toollabsmaster+15 -15jsub: set buster as default release
operations/software/tools-webservicemaster+2 -2gridengine: default to buster
operations/puppetproduction+47 -0toolforge: automated-tests: introduce some TJF checks
operations/puppetproduction+20 -0toolforge: automated-tests: introduce check to verify default grid release
operations/puppetproduction+8 -8toolforge: grid: weblight: support debian buster
operations/cookbookswmcs+154 -3wmcs: toolforge: grid: add remove instance cookbook
operations/cookbookswmcs+120 -0wmcs: toolforge: grid: add cookbook to depool a node
operations/puppetproduction+8 -9P::toolforge::grid: fix tomcat on buster
operations/puppetproduction+1 -1toolforge.exec_environ: use libnode-dev on buster
operations/puppetproduction+10 -0toolforge.exec_environ: add tests
operations/puppetproduction+299 -140toolforge.genpp: add buster repos
operations/puppetproduction+256 -151toolforge: Add buster specific packages/setting
operations/puppetproduction+57 -60sonofgridengine: grid-configurator: introduce support for the new domain
operations/puppetproduction+11 -11gridengine: set additional grid-configurator source files to new domain
operations/puppetproduction+11 -18gridengine: set grid-configurator source files to use new domain name
operations/puppetproduction+2 -0sonofgridengine: master: ensure cpp package is installed
operations/puppetproduction+0 -3toolforge: grid: base: stop using LVM
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
Restricted Task
Restricted Task
 ResolvedBstormT169289 Tool Labs 2017-06-29 Labstore100[45] kernel upgrade issues
 ResolvedMoritzMuehlenhoffT169290 New anti-stackclash (4.9.25-1~bpo8+3 ) kernel super bad for NFS
 ResolvedBstormT203254 labstore1004 and labstore1005 high load issues following upgrades
 OpenNoneT257945 NFS v4.1/2 as possible fix for elevated load and lock contention on our NFS servers
 ResolvedAndrewT289883 cloud-vps: actively deprecate/phase out use of Debian Stretch
 ResolvedtaaviT306099 Cloud VPS "tools" project Stretch deprecation
 ResolvedtaaviT306100 Cloud VPS "toolsbeta" project Stretch deprecation
 ResolvedtaaviT275864 Toolforge: migrate to Debian Buster or later
 StalledNoneT249949 Stop using integration/composer and then archive the repo
 In ProgresstaaviT287900 Switch Toolforge installation of "composer" to use the Debian package
 StalledNoneT305834 Cloud VPS: drop wmflabs names from profile::resolving::domain_search
 ResolvedaborreroT277653 Toolforge: add Debian Buster to the grid and eliminate Debian Stretch
 ResolvedaborreroT277866 cloud-init: figure out how to change /etc/hosts from cloud-init/vendordata
 ResolvedaborreroT278232 Toolforge: figure out how to work with the new domain in the grid
 ResolvedaborreroT278748 Toolforge: introduce support for selecting grid queue release
 ResolvedaborreroT282972 "--release is not implemented for --backend=kubernetes" with latest tools-webservice from Git
 ResolvedtaaviT288961 /usr/local/bin/webservice:109: DeprecationWarning: dist() and linux_distribution() functions are deprecated in Python 3.5
 ResolvedaborreroT300501 Toolforge grid: uwsgi in buster fails to load python3 venvs
 ResolvedtaaviT280037 Toolforge: set up monitoring tooling for stretch deprecation
 DuplicateNoneT280252 Toolforge Buster bastion no longer tab completes become command
 ResolvedtaaviT284767 Toolforge: migrate cron servers to Debian Buster
 DeclinedNoneT298089 Sort out Mono repositories for the buster grid
 ResolvedaborreroT298948 Toolforge grid deployment/management automation
 StalledNoneT300032 spicerack: introduce GridEngine controller
 ResolvedaborreroT301665 Toolforge jobs framework: create documentation on wikitech
 ResolvedtaaviT309525 Toolforge: Create a cookbook to decomission a SGE node
 ResolvedtaaviT309732 New SGE nodes can't talk to the grid engine master
 ResolvednskaggsT309821 Buster webservice grid went BOOM!
 OpentaaviT309902 Tiny swap on many grid nodes

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
taavi added a parent task: T287900: Switch Toolforge installation of "composer" to use the Debian package.Oct 12 2021, 7:36 AM
taavi mentioned this in T295694: Install svgo.Nov 15 2021, 3:24 PM
taavi added a subtask: T284767: Toolforge: migrate cron servers to Debian Buster.Nov 15 2021, 4:35 PM
aborrero changed the task status from Stalled to In Progress.Dec 15 2021, 10:37 AM
aborrero claimed this task.
gerritbot added a comment.Dec 15 2021, 12:06 PM

Change 747503 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P::toolforge::grid: fix tomcat on buster

https://gerrit.wikimedia.org/r/747503

gerritbot added a comment.Dec 15 2021, 4:59 PM

Change 747503 merged by Arturo Borrero Gonzalez:

[operations/puppet@production] P::toolforge::grid: fix tomcat on buster

https://gerrit.wikimedia.org/r/747503

Stashbot added a comment.Dec 21 2021, 11:06 AM

Mentioned in SAL (#wikimedia-cloud) [2021-12-21T11:06:13Z] <arturo> bump quotas, instances from 50 to 55, CPU from 100 to 150, RAM from 200GB to 250GB (T277653)

gerritbot added a comment.Dec 21 2021, 5:27 PM

Change 749221 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: add cookbook to depool a node

https://gerrit.wikimedia.org/r/749221

gerritbot added a comment.Dec 21 2021, 5:27 PM

Change 749222 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: add remove instance cookbook

https://gerrit.wikimedia.org/r/749222

gerritbot added a comment.Dec 22 2021, 11:41 AM

Change 749221 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: grid: add cookbook to depool a node

https://gerrit.wikimedia.org/r/749221

gerritbot added a comment.Dec 22 2021, 11:41 AM

Change 749222 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: grid: add remove instance cookbook

https://gerrit.wikimedia.org/r/749222

aborrero closed subtask T298089: Sort out Mono repositories for the buster grid as Declined.Dec 23 2021, 10:47 AM
gerritbot added a comment.Jan 12 2022, 12:37 PM

Change 753446 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/puppet@production] toolforge: grid: weblight: support debian buster

https://gerrit.wikimedia.org/r/753446

gerritbot added a comment.Jan 12 2022, 12:40 PM

Change 753446 merged by Arturo Borrero Gonzalez:

[operations/puppet@production] toolforge: grid: weblight: support debian buster

https://gerrit.wikimedia.org/r/753446

Stashbot added a comment.Jan 20 2022, 12:56 PM

Mentioned in SAL (#wikimedia-cloud) [2022-01-20T12:56:50Z] <arturo> scaling up the grid with 10 buster exec nodes (T277653)

Stashbot added a comment.Jan 24 2022, 3:23 PM

Mentioned in SAL (#wikimedia-cloud) [2022-01-24T15:22:59Z] <arturo> scaling up the grid with 10 buster exec nodes (T277653)

Stashbot added a comment.Jan 26 2022, 1:55 PM

Mentioned in SAL (#wikimedia-cloud) [2022-01-26T13:55:33Z] <arturo> scaling up the buster web grid with 5 lighttd and 2 generic nodes (T277653)

AntiCompositeNumber added a subscriber: AntiCompositeNumber.Jan 26 2022, 6:32 PM
gerritbot added a comment.Jan 26 2022, 6:43 PM

Change 757499 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/puppet@production] toolforge: automated-tests: introduce check to verify default grid release

https://gerrit.wikimedia.org/r/757499

gerritbot added a comment.Jan 27 2022, 11:32 AM

Change 757499 merged by Arturo Borrero Gonzalez:

[operations/puppet@production] toolforge: automated-tests: introduce check to verify default grid release

https://gerrit.wikimedia.org/r/757499

aborrero updated the task description. (Show Details)Jan 27 2022, 1:08 PM
aborrero updated the task description. (Show Details)Jan 27 2022, 1:15 PM
aborrero updated the task description. (Show Details)
aborrero updated the task description. (Show Details)Jan 27 2022, 3:26 PM
aborrero added a subscriber: komla.
nskaggs updated the task description. (Show Details)Jan 27 2022, 3:31 PM
aborrero closed subtask T278748: Toolforge: introduce support for selecting grid queue release as Resolved.Jan 31 2022, 12:46 PM
nskaggs updated the task description. (Show Details)Feb 1 2022, 2:08 PM
aborrero updated the task description. (Show Details)Feb 7 2022, 6:18 PM
aborrero updated the task description. (Show Details)
• bd808 updated the task description. (Show Details)Feb 7 2022, 6:35 PM
aborrero updated the task description. (Show Details)Feb 8 2022, 11:10 AM
komla updated the task description. (Show Details)Feb 8 2022, 6:08 PM
Stashbot added a comment.Feb 9 2022, 6:56 PM

Mentioned in SAL (#wikimedia-cloud) [2022-02-09T18:56:13Z] <wm-bot> pooled 10 grid nodes tools-sgeweblight-10-[1-5],tools-sgewebgen-10-[1,2],tools-sgeexec-10-[1-10] (T277653) - cookbook ran by arturo@nostromo

aborrero updated the task description. (Show Details)Feb 14 2022, 11:57 AM
aborrero updated the task description. (Show Details)Feb 14 2022, 12:00 PM
aborrero added a subtask: T301665: Toolforge jobs framework: create documentation on wikitech.
aborrero updated the task description. (Show Details)Feb 15 2022, 10:24 AM
aborrero mentioned this in T301736: toolsbeta.automated-toolforge-tests membership causes "groups: cannot find name for group ID 54872" error message.Feb 15 2022, 12:28 PM
gerritbot added a comment.Feb 15 2022, 1:07 PM

Change 762811 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/puppet@production] toolforge: automated-tests: introduce some TJF checks

https://gerrit.wikimedia.org/r/762811

gerritbot added a comment.Feb 15 2022, 1:16 PM

Change 762811 merged by Arturo Borrero Gonzalez:

[operations/puppet@production] toolforge: automated-tests: introduce some TJF checks

https://gerrit.wikimedia.org/r/762811

aborrero closed subtask T301665: Toolforge jobs framework: create documentation on wikitech as Resolved.Feb 16 2022, 11:55 AM
aborrero closed subtask T298948: Toolforge grid deployment/management automation as Resolved.Feb 18 2022, 6:37 PM
komla updated the task description. (Show Details)Mar 21 2022, 11:14 PM
komla added a comment.Apr 3 2022, 4:20 PM

On 1st April, emails were sent to individual maintainers who still have projects running on Stretch GridEngine.

Some have started migrating away from Stretch GridEngine.

komla added a comment.EditedApr 3 2022, 4:28 PM

One user sent a technical enquiry to the Cloud mailing list but the post is currently being held for moderation because of size.
Can this be reviewed?

aborrero added a comment.Apr 4 2022, 8:40 AM
In T277653#7827047, @komla wrote:

One user sent a technical enquiry to the Cloud mailing list but the post is currently being held for moderation because of size.
Can this be reviewed?

apparently somebody already let the message in.

komla added a comment.Apr 5 2022, 5:57 PM

I am seeing services that have been migrated from Stretch grid still appearing on grid-deprecation.toolforge.org portal.
Example services: srwiki and linedwell

Does this mean the maintainers have left these services running on Stretch grid or is it in the way the data is fetched?

• bd808 added a comment.Apr 5 2022, 6:12 PM
In T277653#7833060, @komla wrote:

I am seeing services that have been migrated from Stretch grid still appearing on grid-deprecation.toolforge.org portal.
Example services: srwiki and linedwell

Does this mean the maintainers have left these services running on Stretch grid or is it in the way the data is fetched?

  • The srwiki tool's crontab does not specify a -release for either job, so it is still running its jobs on the stretch grid. I don't see any sign of that tool attempting to use the new kubernetes job service.
  • The linedwell tool's report shows its grid engine webservice job shutting down on 2022-04-03 09:32. The grid-deprecation app has some code (R2043:b18c8d8eff90: app: remove workloads migrated to Kubernetes) that tries to remove things that are now seen on running on Kubernetes, but apparently the matching logic is not currently working for webservices.

If you have other tools like this, I don't think there is any way to know if it is a tool issue or a reporting issue until someone goes an manually checks each tool.

komla added a comment.Apr 5 2022, 6:18 PM

Thanks!
I will remind maintainers to make sure they shutdown all services on Stretch grid after migration.

komla added a comment.Apr 5 2022, 8:02 PM

Some maintainers are asking for their projects(either abandoned or very old) to be shut down.
Is this something I can do? Or how do I mark such projects for shutdown?

• bd808 added a comment.Apr 5 2022, 8:12 PM
In T277653#7833504, @komla wrote:

Some maintainers are asking for their projects(either abandoned or very old) to be shut down.
Is this something I can do? Or how do I mark such projects for shutdown?

aborrero mentioned this in T305834: Cloud VPS: drop wmflabs names from profile::resolving::domain_search.Apr 11 2022, 11:22 AM
taavi added a parent task: T305834: Cloud VPS: drop wmflabs names from profile::resolving::domain_search.Apr 11 2022, 11:45 AM
gerritbot added a comment.Apr 12 2022, 12:22 PM

Change 779462 had a related patch set uploaded (by Majavah; author: Majavah):

[labs/toollabs@master] jsub: set buster as default release

https://gerrit.wikimedia.org/r/779462

Stashbot added a comment.Apr 29 2022, 2:22 PM

Mentioned in SAL (#wikimedia-cloud) [2022-04-29T14:22:35Z] <andrewbogott> changing login.toolforge.org, bastion.toolforge.org, and dev.toolforge.org dns entries to refer to the new Buster bastions T277653 https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Timeline

komla updated the task description. (Show Details)Apr 29 2022, 2:23 PM
komla updated the task description. (Show Details)Apr 29 2022, 3:35 PM
taavi mentioned this in T306099: Cloud VPS "tools" project Stretch deprecation.Apr 30 2022, 3:32 PM
JeanFred mentioned this in T307269: ErfgoedBot doesn't work since 2022-04-19, since the move to new Buster tools grid.May 3 2022, 7:59 AM
Stashbot added a comment.May 30 2022, 8:24 AM

Mentioned in SAL (#wikimedia-cloud) [2022-05-30T08:24:26Z] <taavi> depool tools-sgeexec-[0901-0909] (7 nodes total) T277653

gerritbot added a comment.May 30 2022, 12:47 PM

Change 801385 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] sonofgridengine: grid_configurator: make the grid master a submit host

https://gerrit.wikimedia.org/r/801385

taavi closed subtask T309732: New SGE nodes can't talk to the grid engine master as Resolved.Jun 2 2022, 8:00 AM
gerritbot added a comment.Jun 2 2022, 9:52 AM

Change 802470 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/software/tools-webservice@master] gridengine: default to buster

https://gerrit.wikimedia.org/r/802470

gerritbot added a comment.Jun 2 2022, 9:56 AM

Change 802470 merged by jenkins-bot:

[operations/software/tools-webservice@master] gridengine: default to buster

https://gerrit.wikimedia.org/r/802470

Stashbot added a comment.Jun 2 2022, 10:16 AM

Mentioned in SAL (#wikimedia-cloud) [2022-06-02T10:16:57Z] <taavi> publish tools-webservice 0.84 that updates the grid default from stretch to buster T277653

gerritbot added a comment.Jun 2 2022, 10:54 AM

Change 779462 merged by jenkins-bot:

[labs/toollabs@master] jsub: set buster as default release

https://gerrit.wikimedia.org/r/779462

Stashbot added a comment.Jun 2 2022, 11:17 AM

Mentioned in SAL (#wikimedia-cloud) [2022-06-02T11:17:36Z] <taavi> publish jobutils 1.44 that updates the grid default from stretch to buster T277653

• bd808 added a subtask: T309821: Buster webservice grid went BOOM!.Jun 2 2022, 11:32 PM
nskaggs closed subtask T309821: Buster webservice grid went BOOM! as Resolved.Jun 3 2022, 9:28 PM
gerritbot added a comment.Jun 21 2022, 3:47 PM

Change 807168 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::checker: add buster endpoints

https://gerrit.wikimedia.org/r/807168

gerritbot added a comment.Jun 21 2022, 3:47 PM

Change 807169 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] icinga::monitor::toollabs: replace stretch with buster

https://gerrit.wikimedia.org/r/807169

gerritbot added a comment.Jun 21 2022, 3:47 PM

Change 807170 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::checker: remove stretch endpoints

https://gerrit.wikimedia.org/r/807170

gerritbot added a comment.Jun 21 2022, 4:23 PM

Change 807168 merged by David Caro:

[operations/puppet@production] P:toolforge::checker: add buster endpoints

https://gerrit.wikimedia.org/r/807168

gerritbot added a comment.Jun 21 2022, 4:37 PM

Change 807182 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::checker: add missing endpoint config

https://gerrit.wikimedia.org/r/807182

gerritbot added a comment.Jun 21 2022, 5:27 PM

Change 807184 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/software/tools-webservice@master] Remove stretch support

https://gerrit.wikimedia.org/r/807184

gerritbot added a comment.Jun 21 2022, 5:28 PM

Change 807185 had a related patch set uploaded (by Majavah; author: Majavah):

[labs/toollabs@master] jsub: Remove stretch support

https://gerrit.wikimedia.org/r/807185

gerritbot added a comment.Jun 21 2022, 8:45 PM

Change 807182 merged by David Caro:

[operations/puppet@production] P:toolforge::checker: add missing endpoint config

https://gerrit.wikimedia.org/r/807182

gerritbot added a comment.Jun 22 2022, 9:35 AM

Change 807169 merged by Filippo Giunchedi:

[operations/puppet@production] icinga::monitor::toollabs: replace stretch with buster

https://gerrit.wikimedia.org/r/807169

taavi added a comment.Jun 22 2022, 5:14 PM

The following SGE jobs are still running on the exec grid:

tools.alchimista 8787914 tlgm
tools.ammarbot 9058295 cine_review
tools.avicbot 400742 uaaby5min
tools.avicbot 6444029 avicbotirc
tools.cewbot 3280296 cron-tools.cewbot-IRC
tools.earwigbot 9782320 earwigbot
tools.germancon-mobile 400540 germancon-mobile-parser
tools.hat-collector 3965351 go
tools.listeria 3216144 bot
tools.nokib-bot 1593642 daily
tools.patest 6882116 script_wui
tools.phetools 2742445 ws_ocr_daemon
tools.phetools 2742447 verify_match
tools.phetools 2742450 extract_text_layer
tools.sdzerobot 6303775 stream
tools.signature-checker 2297341 cron-20170515.signature_check.wikinews
tools.signature-checker 2297344 cron-20170515.signature_check.wikisource
tools.signature-checker 2297345 cron-20170515.signature_check.wikiversity
tools.signature-checker 4615899 cron-20170515.signature_check.zh
tools.signature-checker 5086089 cron-20170515.signature_check.simple
tools.signature-checker 5969401 cron-20170515.signature_check.wiktionary
tools.signature-checker 6091396 cron-20170515.signature_check.zh-classical
tools.signature-manquante-bot 4769872 signature-manquante
tools.telegram-wikilinksbot 5699376 wikilinksbot
tools.toc 1826241 cron-20170915.topic_list.ja
tools.toc 3609056 cron-20170915.topic_list.wikinews
tools.toc 3609088 cron-20170915.topic_list.wikisource
tools.toc 3609172 cron-20170915.topic_list.wikiversity
tools.toc 5086111 cron-20170915.topic_list.wiktionary
tools.toc 5287268 cron-20170915.topic_list.moegirl
tools.urbanecmbot 2811129 patrolAfterPatrol
tools.urbanecmbot 6443111 patrolSandbox
tools.wikidata-todo 2840123 wc_all
tools.wikidata-todo 2840124 wc_rc
tools.wikitanvirbot 1366931 doubredi
tools.wikitanvirbot 5512585 sand-wbbn
tools.wikitanvirbot 5512746 corona
tools.wikitanvirbot 5816767 sand-wtbn

I'm going to kill those sometime tomorrow (so 2022-06-23).

RhinosF1 added a subscriber: RhinosF1.Jun 22 2022, 5:24 PM
Stashbot added a comment.Jun 23 2022, 1:59 PM

Mentioned in SAL (#wikimedia-cloud) [2022-06-23T13:59:45Z] <taavi> removing remaining continuous jobs from the stretch grid T277653

gerritbot added a comment.Jun 23 2022, 2:34 PM

Change 807185 merged by jenkins-bot:

[labs/toollabs@master] jsub: Remove stretch support

https://gerrit.wikimedia.org/r/807185

gerritbot added a comment.Jun 23 2022, 2:45 PM

Change 807184 merged by jenkins-bot:

[operations/software/tools-webservice@master] Remove stretch support

https://gerrit.wikimedia.org/r/807184

JJMC89 mentioned this in T311374: Unable to login to login-stretch.tools.wmflabs.org.Jun 27 2022, 3:47 PM
taavi closed this task as Resolved.Jun 27 2022, 6:18 PM
taavi updated Other Assignee, added: taavi.
gerritbot added a comment.Jun 30 2022, 4:36 PM

Change 807170 merged by David Caro:

[operations/puppet@production] P:toolforge::checker: remove stretch endpoints

https://gerrit.wikimedia.org/r/807170

taavi closed subtask T284767: Toolforge: migrate cron servers to Debian Buster as Resolved.Jul 2 2022, 6:09 AM
dcaro mentioned this in rCCKB297b3c518e85: wmcs: toolforge: grid: add cookbook to depool a node.Dec 14 2022, 3:32 PM
dcaro mentioned this in rCCKBbc63b38bb5f2: wmcs: toolforge: grid: add remove instance cookbook.
taavi closed subtask T309525: Toolforge: Create a cookbook to decomission a SGE node as Resolved.Mar 25 2023, 8:05 AM
taavi removed a subtask: T257945: NFS v4.1/2 as possible fix for elevated load and lock contention on our NFS servers.May 2 2023, 3:14 PM
taavi added a parent task: T257945: NFS v4.1/2 as possible fix for elevated load and lock contention on our NFS servers.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL