Page MenuHomePhabricator
Create Task
Maniphest T301879

Test MariaDB 10.6 on Bullseye
Closed, ResolvedPublic
Actions

Description

MariaDB 10.6 has a number of features that can be very useful for us (https://mariadb.com/kb/en/changes-improvements-in-mariadb-106/) like:

  • Ignored Indexes
  • Native sys DB support
  • binlog_expire_logs_seconds
  • CREATE, ALTER, DROP and RENAME are crash safe

A bunch of options have been removed, so we'd need to double check if we are still using them: (investigation at: T301879#7759265)

innodb_adaptive_max_sleep_delay
innodb_background_scrub_data_check_interval
innodb_background_scrub_data_compressed
innodb_background_scrub_data_interval
innodb_background_scrub_data_uncompressed
innodb_buffer_pool_instances
innodb_commit_concurrency
innodb_concurrency_tickets
innodb_file_format
innodb_large_prefix
innodb_lock_schedule_algorithm
innodb_log_checksums
innodb_log_compressed_pages
innodb_log_files_in_group
innodb_log_optimize_ddl
innodb_page_cleaners
innodb_replication_delay
innodb_scrub_log
innodb_scrub_log_speed
innodb_sync_array_size
innodb_thread_concurrency
innodb_thread_sleep_delay
innodb_undo_logs

Details

SubjectRepoBranchLines +/-
mariadb: Remove innodb_large_prefix flag.operations/puppetproduction+0 -19
db2181: Install MariaDB 10.6operations/puppetproduction+1 -0
db2178: Migrate from 10.4 to 10.6operations/puppetproduction+1 -0
db1120: Migrate from 10.4 to 10.6operations/puppetproduction+1 -0
db1182: Upgrade from 10.4 to 10.6operations/puppetproduction+1 -0
db2180: Install 10.6operations/puppetproduction+1 -0
db1168: Install 10.6operations/puppetproduction+1 -0
db2146: Disable notificationsoperations/puppetproduction+1 -0
core-percona.my.cnf.erb: Update optimizer optionsoperations/puppetproduction+0 -4
production.my.cnf.erb: Leave rowid disabledoperations/puppetproduction+0 -4
db1132: Enable notificationsoperations/puppetproduction+0 -1
control-mariadb-10.6-bullseye: Add to repooperations/softwaremaster+12 -0
instances.yaml: Add db1132 to dbctloperations/puppetproduction+1 -0
mariadb: Remove innodb_buffer_pool_instancesoperations/puppetproduction+0 -3
phabricator.my.cnf: Remove innodb_buffer_pool_instances flagoperations/puppetproduction+0 -1
mariadb: Remove innodb_buffer_pool_instances flagoperations/puppetproduction+0 -6
mariadb: Remove innodb_file_formatoperations/puppetproduction+0 -40
mariadb: Remove innodb_thread_concurrency variableoperations/puppetproduction+0 -16
db1124: Install 10.6 on db1124operations/puppetproduction+1 -0
analytics_multiinstance.my.cnf: Remove innodb_file_formatoperations/puppetproduction+0 -4
sanitarium_multiinstance.my.cnf: Remove innodb_file_formatoperations/puppetproduction+0 -4
db1125: Install mariadb 10.6operations/puppetproduction+3 -2
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedMarosteguiT301879 Test MariaDB 10.6 on Bullseye
 ResolvedMarosteguiT303395 Move db1132 from m5 to s1
 ResolvedMarosteguiT303582 Investigate db1125 reboot
 OpenNoneT305427 Slow recentchanges DB queries on 10.6
 ResolvedMarosteguiT307546 Migrate a wikidata DB to MariaDB 10.6
 ResolvedMarosteguiT306777 Install MariaDB 10.6 on pc2014
 ResolvedMarosteguiT306782 Review db1132 (mariadb 10.6) grants
 ResolvedMarosteguiT307082 Investigate spikes on db1132 (mariadb 10.6 host)
 ResolvedMarosteguiT308099 Migrate db2146 (s1) to mariadb 10.6
 ResolvedMarosteguiT308126 Migrate a s7 DB host to mariadb 10.6
 ResolvedMarosteguiT309265 Migrate 4 DB ES hosts to 10.6
 ResolvedMarosteguiT309612 Migrate an active DC parsercache host to MariaDB 10.6
 ResolvedMarosteguiT309679 Migrate a x1 DB host to mariadb 10.6
 ResolvedMarosteguiT310114 Migrate a s4 DB host to mariadb 10.6
 ResolvedMarosteguiT311106 Investigate mariadb 10.6 performance regression during spikes/high load
 ResolvedMarosteguiT315411 Compile and package MariaDB 10.6.9 and 10.4.26
 ResolvedMarosteguiT315754 db1132 lagging behind (10.6)
 ResolvedMarosteguiT315742 Replication stopped on db1143
 ResolvedMarosteguiT318128 Compile and install MariaDB 10.6.10
 ResolvedMarosteguiT318914 Investigate and possibly remove 10.6 deprecated options
 ResolvedjcrespoT319383 Mydumper incompatibility with MariaDB 10.6 (was: Logical recoveries (myloader) to db2098:s7 are failing with "Lock wait timeout exceeded; try restarting transaction")
 OpenMarosteguiT333118 Slow recentchanges query on 10.6

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Apr 5 2022, 4:34 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-05T04:34:26Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1132 for testing T301879', diff saved to https://phabricator.wikimedia.org/P24087 and previous config saved to /var/cache/conftool/dbconfig/20220405-043426-marostegui.json

Stashbot added a comment.Apr 5 2022, 5:52 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-05T05:52:57Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1132 for testing T301879', diff saved to https://phabricator.wikimedia.org/P24093 and previous config saved to /var/cache/conftool/dbconfig/20220405-055256-marostegui.json

Stashbot added a comment.Apr 5 2022, 6:01 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-05T06:01:25Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1132 into API for testing T301879', diff saved to https://phabricator.wikimedia.org/P24094 and previous config saved to /var/cache/conftool/dbconfig/20220405-060124-marostegui.json

Marostegui added a comment.Apr 5 2022, 6:01 AM

Just pooled db1132 into API group with very small weight to start capturing API queries.

Stashbot added a comment.Apr 5 2022, 6:36 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-05T06:36:48Z] <marostegui@cumin1001> dbctl commit (dc=all): 'More weight to db1132 T301879', diff saved to https://phabricator.wikimedia.org/P24095 and previous config saved to /var/cache/conftool/dbconfig/20220405-063648-marostegui.json

Marostegui mentioned this in T305427: Slow recentchanges DB queries on 10.6.Apr 5 2022, 7:06 AM
gerritbot added a comment.Apr 7 2022, 7:17 AM

Change 778206 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/software@master] control-mariadb-10.6-bullseye: Add to repo

https://gerrit.wikimedia.org/r/778206

Marostegui added a comment.Apr 7 2022, 8:19 AM

Pushed the above control file to the repo, so it is kept somewhere.

gerritbot added a comment.Apr 7 2022, 8:20 AM

Change 778206 merged by jenkins-bot:

[operations/software@master] control-mariadb-10.6-bullseye: Add to repo

https://gerrit.wikimedia.org/r/778206

Marostegui added a comment.Apr 13 2022, 8:00 AM

I am feeling pretty comfortable with the 10.6 tests. I will probably leave the host running with small weight on s1 after the holidays (as I am out tomorrow and friday)

Ladsgroup added a comment.Apr 13 2022, 1:03 PM

\o/

gerritbot added a comment.Apr 20 2022, 4:50 AM

Change 784355 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1132: Enable notifications

https://gerrit.wikimedia.org/r/784355

Stashbot added a comment.Apr 20 2022, 4:51 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-20T04:51:09Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1132 into s1 T301879', diff saved to https://phabricator.wikimedia.org/P25523 and previous config saved to /var/cache/conftool/dbconfig/20220420-045108-marostegui.json

gerritbot added a comment.Apr 20 2022, 4:51 AM

Change 784355 merged by Marostegui:

[operations/puppet@production] db1132: Enable notifications

https://gerrit.wikimedia.org/r/784355

Marostegui added a comment.Apr 20 2022, 4:52 AM

I have pooled db1132 into s1 (main and api) with small weight:

--- eqiad/groupLoadsBySection/s1 live
+++ eqiad/groupLoadsBySection/s1 generated
@@ -1,6 +1,7 @@
 {
     "api": {
         "db1119": 100,
+        "db1132": 10,
         "db1134": 100,
         "db1135": 100,
         "db1164": 100,
--- eqiad/sectionLoads/s1 live
+++ eqiad/sectionLoads/s1 generated
@@ -7,6 +7,7 @@
         "db1105:3311": 50,
         "db1106": 50,
         "db1119": 200,
+        "db1132": 50,
         "db1134": 200,
         "db1135": 200,
         "db1163": 325,

Going to leave it serving until Friday.

Stashbot added a comment.Apr 21 2022, 5:09 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-21T05:09:31Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1132 T301879', diff saved to https://phabricator.wikimedia.org/P25874 and previous config saved to /var/cache/conftool/dbconfig/20220421-050931-marostegui.json

Stashbot added a comment.Apr 25 2022, 6:38 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-25T06:38:24Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1132 into s1 T301879', diff saved to https://phabricator.wikimedia.org/P26432 and previous config saved to /var/cache/conftool/dbconfig/20220425-063823-marostegui.json

Marostegui added a comment.Apr 25 2022, 6:38 AM

Just repooled db1132 into s1, going to leave it serving during the whole week.

Marostegui added a comment.Apr 25 2022, 7:44 AM

This is for parsercache https://gerrit.wikimedia.org/r/c/operations/puppet/+/785798/ but I will do that for production too. That if was there for the time we had 10.1 and 10.4 but now that 10.1 is gone, we can simply leave it disabled.

Marostegui closed subtask T306782: Review db1132 (mariadb 10.6) grants as Resolved.Apr 25 2022, 11:37 AM
Marostegui closed subtask T306777: Install MariaDB 10.6 on pc2014 as Resolved.Apr 26 2022, 9:56 AM
gerritbot added a comment.Apr 27 2022, 5:37 AM

Change 786670 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production.my.cnf.erb: Leave rowid disabled

https://gerrit.wikimedia.org/r/786670

gerritbot added a comment.Apr 27 2022, 5:39 AM

Change 786670 merged by Marostegui:

[operations/puppet@production] production.my.cnf.erb: Leave rowid disabled

https://gerrit.wikimedia.org/r/786670

Marostegui added a comment.Apr 27 2022, 8:16 AM

So far db1132 has been performing very well on s1, I am going to increase its weight now on both main and API, and leave it serving for the rest of the week. If all goes fine, I might migrate a s8 host to 10.6 next week, as the queries there might have other issues than a normal wiki.

Stashbot added a comment.Apr 27 2022, 8:17 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-27T08:17:27Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase db1132 weight T301879', diff saved to https://phabricator.wikimedia.org/P26703 and previous config saved to /var/cache/conftool/dbconfig/20220427-081727-marostegui.json

gerritbot added a comment.Apr 28 2022, 4:48 AM

Change 787119 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] core-percona.my.cnf.erb: Update optimizer options

https://gerrit.wikimedia.org/r/787119

gerritbot added a comment.Apr 28 2022, 4:49 AM

Change 787119 merged by Marostegui:

[operations/puppet@production] core-percona.my.cnf.erb: Update optimizer options

https://gerrit.wikimedia.org/r/787119

Stashbot added a comment.Apr 28 2022, 7:22 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-28T07:22:01Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Increase db1132 weight T301879', diff saved to https://phabricator.wikimedia.org/P26860 and previous config saved to /var/cache/conftool/dbconfig/20220428-072200-marostegui.json

Marostegui added a comment.Apr 28 2022, 7:22 AM

As everything looks good with db1132, I have given it normal weight (like any other host serving API+MAIN) which is 200 on main and 100 on API. I want to explore if this host, for any reason would report more slow queries than a 10.4 one

Stashbot added a comment.Apr 29 2022, 6:30 AM

Mentioned in SAL (#wikimedia-operations) [2022-04-29T06:30:19Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1132 T301879', diff saved to https://phabricator.wikimedia.org/P27001 and previous config saved to /var/cache/conftool/dbconfig/20220429-063019-marostegui.json

Marostegui added a comment.Apr 29 2022, 6:30 AM

Depooled db1132 for the long weekend.

Stashbot added a comment.May 3 2022, 8:04 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-03T08:04:22Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1132 T301879', diff saved to https://phabricator.wikimedia.org/P27350 and previous config saved to /var/cache/conftool/dbconfig/20220503-080421-marostegui.json

Marostegui added a comment.May 3 2022, 8:07 AM

db1132 pooled for the week.

Stashbot added a comment.May 4 2022, 2:24 PM

Mentioned in SAL (#wikimedia-operations) [2022-05-04T14:24:51Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1132 T301879', diff saved to https://phabricator.wikimedia.org/P27468 and previous config saved to /var/cache/conftool/dbconfig/20220504-142449-marostegui.json

Marostegui added a comment.May 9 2022, 5:18 AM

For the first time db1132 has been serving traffic during the weekend and everything looked good apart from the already reported query: T305427#7912741

Stashbot added a comment.May 11 2022, 5:13 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-11T05:13:07Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2146 T301879', diff saved to https://phabricator.wikimedia.org/P27778 and previous config saved to /var/cache/conftool/dbconfig/20220511-051307-marostegui.json

gerritbot added a comment.May 11 2022, 5:13 AM

Change 790796 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db2146: Disable notifications

https://gerrit.wikimedia.org/r/790796

gerritbot added a comment.May 11 2022, 5:14 AM

Change 790796 merged by Marostegui:

[operations/puppet@production] db2146: Disable notifications

https://gerrit.wikimedia.org/r/790796

Stashbot added a comment.May 11 2022, 5:17 AM

Mentioned in SAL (#wikimedia-operations) [2022-05-11T05:17:04Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2146 T301879', diff saved to https://phabricator.wikimedia.org/P27779 and previous config saved to /var/cache/conftool/dbconfig/20220511-051703-marostegui.json

Marostegui closed subtask T308099: Migrate db2146 (s1) to mariadb 10.6 as Resolved.May 11 2022, 5:18 AM
Marostegui mentioned this in T307501: Adjust the field type of globalblocks timestamp columns to fixed binary on wmf wikis.May 11 2022, 5:50 AM
Marostegui closed subtask T307546: Migrate a wikidata DB to MariaDB 10.6 as Resolved.May 13 2022, 6:55 AM
Marostegui closed subtask T308126: Migrate a s7 DB host to mariadb 10.6 as Resolved.May 24 2022, 5:06 AM
jcrespo mentioned this in T309296: Failover m1 primary db from db1128 to db1164.May 26 2022, 10:39 AM
Marostegui added a comment.May 27 2022, 5:36 AM

I am repooling es1032 (10.6.8) - first ES RO host serving traffic with 10.6

Marostegui added a comment.May 27 2022, 2:26 PM

After all the few changes on hosts during the last week, these are the hosts currently running live, with 10.6

Version: 10.6.7+deb11u1 4
db1124.eqiad.wmnet (host) (test host)
db1125.eqiad.wmnet (host) (test host)
db2122.codfw.wmnet (host) (s7)
db2146.codfw.wmnet (host) (s1)

Version: 10.6.8+deb11u1 7
db1111.eqiad.wmnet (host) (s8)
db1127.eqiad.wmnet (host) (s7)
db1132.eqiad.wmnet (host) (s1)
es1032.eqiad.wmnet (host) (es1)
es2022.codfw.wmnet (host) (es4)
es2030.codfw.wmnet (host) (es1)
pc2014.codfw.wmnet (host) (pc1)

Marostegui closed subtask T309265: Migrate 4 DB ES hosts to 10.6 as Resolved.May 31 2022, 8:23 AM
Marostegui closed subtask T307082: Investigate spikes on db1132 (mariadb 10.6 host) as Resolved.Jun 2 2022, 9:36 AM
Marostegui closed subtask T309679: Migrate a x1 DB host to mariadb 10.6 as Resolved.Jun 6 2022, 5:26 AM
Marostegui closed subtask T310114: Migrate a s4 DB host to mariadb 10.6 as Resolved.Jun 21 2022, 6:28 AM
Wellverywell subscribed.Jun 22 2022, 10:49 AM
Marostegui closed subtask T309612: Migrate an active DC parsercache host to MariaDB 10.6 as Resolved.Jun 24 2022, 12:40 PM
gerritbot added a comment.Sep 16 2022, 5:50 AM

Change 832588 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1168: Install 10.6

https://gerrit.wikimedia.org/r/832588

Stashbot added a comment.Sep 16 2022, 5:51 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-16T05:51:24Z] <marostegui> Install 10.6 on db1168 T301879

gerritbot added a comment.Sep 16 2022, 5:52 AM

Change 832588 merged by Marostegui:

[operations/puppet@production] db1168: Install 10.6

https://gerrit.wikimedia.org/r/832588

Marostegui added a comment.Sep 16 2022, 5:53 AM

Installed 10.6 (with the fix) for T311106 on s6, so we currently have a replica on:

s1 (db1132)
s4 (db1143)
s6 (db1168)
s7 (db1127)
s8 (db1111)

gerritbot added a comment.Sep 16 2022, 7:30 AM

Change 832607 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db2180: Install 10.6

https://gerrit.wikimedia.org/r/832607

gerritbot added a comment.Sep 16 2022, 7:32 AM

Change 832607 merged by Marostegui:

[operations/puppet@production] db2180: Install 10.6

https://gerrit.wikimedia.org/r/832607

Marostegui added a comment.Sep 16 2022, 9:59 AM
In T301879#8241203, @Marostegui wrote:

Installed 10.6 (with the fix) for T311106 on s6, so we currently have a replica on:

s1 (db1132)
s4 (db1143)
s6 (db1168)
s7 (db1127)
s8 (db1111)

Added the s6 codfw host too (db2180)

Marostegui closed subtask T318128: Compile and install MariaDB 10.6.10 as Resolved.Sep 29 2022, 5:03 AM
Marostegui added a subtask: T318914: Investigate and possibly remove 10.6 deprecated options.Sep 30 2022, 5:44 AM
Marostegui mentioned this in T318914: Investigate and possibly remove 10.6 deprecated options.
gerritbot added a comment.Oct 3 2022, 6:30 AM

Change 837490 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Remove innodb_large_prefix flag.

https://gerrit.wikimedia.org/r/837490

gerritbot added a comment.Oct 3 2022, 6:46 AM

Change 837491 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1182: Upgrade from 10.4 to 10.6

https://gerrit.wikimedia.org/r/837491

gerritbot added a comment.Oct 3 2022, 6:47 AM

Change 837491 merged by Marostegui:

[operations/puppet@production] db1182: Upgrade from 10.4 to 10.6

https://gerrit.wikimedia.org/r/837491

Marostegui added a comment.Oct 3 2022, 7:05 AM

Installed 10.6.10 on db1182 and db2175 (s2).

gerritbot added a comment.Oct 3 2022, 7:35 AM

Change 837497 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1120: Migrate from 10.4 to 10.6

https://gerrit.wikimedia.org/r/837497

gerritbot added a comment.Oct 3 2022, 7:37 AM

Change 837497 merged by Marostegui:

[operations/puppet@production] db1120: Migrate from 10.4 to 10.6

https://gerrit.wikimedia.org/r/837497

gerritbot added a comment.Oct 3 2022, 7:57 AM

Change 837614 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db2178: Migrate from 10.4 to 10.6

https://gerrit.wikimedia.org/r/837614

gerritbot added a comment.Oct 3 2022, 7:58 AM

Change 837614 merged by Marostegui:

[operations/puppet@production] db2178: Migrate from 10.4 to 10.6

https://gerrit.wikimedia.org/r/837614

Marostegui added a comment.Oct 3 2022, 8:00 AM

Installed 10.6.10 on db1200 and db2178 (s5)

gerritbot added a comment.Oct 4 2022, 8:18 AM

Change 838074 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db2181: Install MariaDB 10.6

https://gerrit.wikimedia.org/r/838074

gerritbot added a comment.Oct 4 2022, 8:20 AM

Change 838074 merged by Marostegui:

[operations/puppet@production] db2181: Install MariaDB 10.6

https://gerrit.wikimedia.org/r/838074

gerritbot added a comment.Oct 4 2022, 10:52 AM

Change 837490 merged by Marostegui:

[operations/puppet@production] mariadb: Remove innodb_large_prefix flag.

https://gerrit.wikimedia.org/r/837490

Marostegui closed subtask T311106: Investigate mariadb 10.6 performance regression during spikes/high load as Resolved.Oct 5 2022, 7:34 AM
jcrespo added a subtask: T319383: Mydumper incompatibility with MariaDB 10.6 (was: Logical recoveries (myloader) to db2098:s7 are failing with "Lock wait timeout exceeded; try restarting transaction").Oct 6 2022, 10:42 AM
jcrespo subscribed.

Potential 10.6 regression: T319383 Doing more tests to prove it.

Marostegui closed subtask T318914: Investigate and possibly remove 10.6 deprecated options as Resolved.Nov 23 2022, 10:39 AM
Marostegui closed this task as Resolved.Jan 11 2023, 7:32 PM

I am going to consider this task done. The pending issue (adapt our tooling to work with 10.6) has its own task where it can be followed up T319383

Maintenance_bot moved this task from In progress to Done on the DBA board.Jan 11 2023, 8:15 PM
jcrespo closed subtask T319383: Mydumper incompatibility with MariaDB 10.6 (was: Logical recoveries (myloader) to db2098:s7 are failing with "Lock wait timeout exceeded; try restarting transaction") as Resolved.Jan 12 2023, 9:16 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits