bd808 (Bryan Davis)Administrator
Engineering Manager, Wikimedia Cloud Services

Projects (33)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 3 2014, 2:36 PM (163 w, 6 d)
Roles
Administrator
Availability
Available
IRC Nick
bd808
LDAP User
BryanDavis
MediaWiki User
BDavis (WMF)

I'm BDavis (WMF) on wiki, bd808 on irc, and BryanDavis on Gerrit and Wikitech.

I've got a thing for 🦄s. Don't judge.

I work for or provide services to the Wikimedia Foundation, but this is my only Phabricator account. Edits, statements, or other contributions made from this account are my own, and may not reflect the views of the Foundation.

Recent Activity

Today

bd808 renamed T181257: Lack of freeform external access to MediaWiki data is a limitation from MediaWiki Action API does not allow complex queries to Lack of freeform external access to MediaWiki data is a limitation.
Thu, Nov 23, 6:34 PM · MediaWiki-API
bd808 added a comment to T181257: Lack of freeform external access to MediaWiki data is a limitation.

The typical solution used when some business logic or data is found to be missing from the Action API would be to implement a new API module to expose the data that is needed as well as to enforce the needed access controls for exposing the data.

Thu, Nov 23, 6:33 PM · MediaWiki-API
bd808 merged task T180096: MediaWiki Action API is a unique API specification into T181257: Lack of freeform external access to MediaWiki data is a limitation.
Thu, Nov 23, 6:28 PM · MediaWiki-API
bd808 merged T180096: MediaWiki Action API is a unique API specification into T181257: Lack of freeform external access to MediaWiki data is a limitation.
Thu, Nov 23, 6:28 PM · MediaWiki-API
bd808 edited projects for T181205: let quarry use the mariadb module, added: cloud-services-team (Kanban); removed cloud-services-team.
Thu, Nov 23, 2:19 AM · cloud-services-team (Kanban), Operations, Quarry

Yesterday

bd808 added a comment to T180662: Request creation of qna VPS project.

+1 from me for the creation of this project. I think it would be helpful to the Discourse pilot to have at least one other competing platform tested live.

Wed, Nov 22, 4:44 PM · Cloud-VPS (Project-requests)
bd808 closed T181146: j as Invalid.
Wed, Nov 22, 3:29 PM
bd808 moved T181025: Database purges should not be done for GET requests from Backlog to WMF Deployment Blockers on the MediaWiki-extensions-ThrottleOverride board.
Wed, Nov 22, 6:03 AM · Patch-For-Review, MediaWiki-extensions-ThrottleOverride
bd808 moved T181072: Update http://scholarships.wmflabs.org/apply for Wikimania 2018 from Backlog to Must have on the Wikimedia-Wikimania-Scholarships board.
Wed, Nov 22, 4:08 AM · Wikimedia-Wikimania-Scholarships
bd808 moved T85526: Make updating dates and URLs with hardcoded year in en.json easier from Backlog to Done on the Wikimedia-Wikimania-Scholarships board.
Wed, Nov 22, 4:08 AM · I18n, Wikimedia-Wikimania-Scholarships
bd808 moved T121927: Use banana-checker for wikimedia/wikimania-scholarships from Backlog to Done on the Wikimedia-Wikimania-Scholarships board.
Wed, Nov 22, 4:08 AM · Patch-For-Review, Wikimedia-Wikimania-Scholarships
bd808 moved T157980: text content of scholarships.wikimedia.org is stale by 1 year in british english from Backlog to Done on the Wikimedia-Wikimania-Scholarships board.
Wed, Nov 22, 4:08 AM · Wikimedia-Wikimania-Scholarships
bd808 added a comment to T181072: Update http://scholarships.wmflabs.org/apply for Wikimania 2018.

Niharika and Bryan Davis are committed to helping with the revising the application again this year. I also have changes from Legal (privacy statement portion) ; probably one more question (coming end of this week); and updating dates and some boilerplate language, and possibly deleting the question about presentation. How best to make sure all of these additions/changes get done and are checked?

Wed, Nov 22, 4:07 AM · Wikimedia-Wikimania-Scholarships
bd808 added a comment to T181072: Update http://scholarships.wmflabs.org/apply for Wikimania 2018.

We want to add this text:
“Some Wikimedia movement organization proceed with the results of the international Wikimania Scholarship Committee results, some will create their own jury process. In the second case, do you intend to apply for funding there, too? If so, we will work with the organisation in question to arrange the best solution.
o Yes o No”

Wed, Nov 22, 4:00 AM · Wikimedia-Wikimania-Scholarships

Tue, Nov 21

bd808 added projects to T181106: Advanced search UI looks bad with Timeless skin: Timeless, OOjs-UI.

Comparison shots using the vector and monobook skins:

Tue, Nov 21, 11:23 PM · MW-1.31-release-notes (WMF-deploy-2017-11-14 (1.31.0-wmf.8)), Patch-For-Review, WMDE-QWERTY-Sprint-2017-11-14, WMDE-QWERTY-Team-Board, Timeless, Advanced-Search, TCB-Team
bd808 added a comment to T180854: Create discourse-mediawiki.wmflabs.org (pilot instance).

A basic blocker for the pilot: where should discourse-mediawiki.wmflabs.org be hosted? Options (if I understand the situation correctly:

Tue, Nov 21, 4:05 PM · cloud-services-team (Kanban), Developer-Relations, Operations
bd808 added a comment to T181025: Database purges should not be done for GET requests.

See comments on https://gerrit.wikimedia.org/r/#/c/392556/3/ThrottleOverride.hooks.php for more information/ideas from Aaron.

Tue, Nov 21, 5:20 AM · Patch-For-Review, MediaWiki-extensions-ThrottleOverride
bd808 added a subtask for T27000: Review and deploy ThrottleOverride extension to Wikimedia wikis: T181025: Database purges should not be done for GET requests.
Tue, Nov 21, 5:14 AM · Wikimedia-extension-review-queue, Possible-Tech-Projects, Wikimedia-Hackathon-2017, Wikimedia-Developer-Summit (2017), MediaWiki-extensions-ThrottleOverride, Wikimedia-Extension-setup
bd808 added a parent task for T181025: Database purges should not be done for GET requests: T27000: Review and deploy ThrottleOverride extension to Wikimedia wikis.
Tue, Nov 21, 5:14 AM · Patch-For-Review, MediaWiki-extensions-ThrottleOverride
bd808 created T181025: Database purges should not be done for GET requests.
Tue, Nov 21, 5:13 AM · Patch-For-Review, MediaWiki-extensions-ThrottleOverride
bd808 closed T156174: Rewrite /usr/local/bin/crontab in python; fix bugs as Resolved.

Thanks for all of your work on this @zhuyifei1999!

Tue, Nov 21, 12:02 AM · Patch-For-Review, cloud-services-team (Kanban), Toolforge

Mon, Nov 20

bd808 updated the task description for T177126: 2017 Toolforge user survey.
Mon, Nov 20, 7:14 PM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge
bd808 added a comment to T177126: 2017 Toolforge user survey.

Initial email send complete:

$ ./send.sh | tee 20171120.log
...
[2017-11-20 19:09:27] processed: 1289 (0.2/sec); ok: 1281 (99.4%); failed: 0 (0.0%); missing: 0 (0.0%); norecieve: 0 (0.0%); optedout: 8 (0.6%);
done.
Mon, Nov 20, 7:13 PM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge
bd808 reassigned T161899: End self-service new Trusty instance creation in Cloud VPS; standardize on Debian base images from bd808 to Andrew.
Mon, Nov 20, 7:01 PM · cloud-services-team (Kanban), Cloud-VPS, User-bd808, Operations
bd808 added a comment to T178803: `qsub sync -y` jobs failing on Grid Engine with "range_list containes no elements" error.

tomcat-setup is an easy way to recreate this error for debugging per T180830 and T180831.

Mon, Nov 20, 3:37 PM · cloud-services-team (Kanban), Toolforge, Wikisource
bd808 renamed T178803: `qsub sync -y` jobs failing on Grid Engine with "range_list containes no elements" error from [Wsexport] Grid job submission failing to `qsub sync -y` jobs failing on Grid Engine with "range_list containes no elements" error.
Mon, Nov 20, 3:35 PM · cloud-services-team (Kanban), Toolforge, Wikisource

Sat, Nov 18

bd808 added a comment to T124691: Configure Single Sign On at discourse.wmflabs.org.

Discourse seems to use OmniAuth for several auth plugins and this https://github.com/timwaters/omniauth-mediawiki plugin exists that purports to work with MediaWiki OAuth. Making a proper upstream patch for MediaWiki as an auth provider seems like the best way forward if Discourse is a serious contender for production deployment.

Sat, Nov 18, 6:15 PM · VPS-Projects
bd808 added a comment to T114969: Update grantreview codebase to use the wikimedia/slimapp library.

The Scholarships commits rWWSCfe8ff368fd82: Require wikimedia/slimapp and rWWSC9c5020ccc54e: Use Slimapp classes show a similar migration that was done in the past.

Sat, Nov 18, 5:52 PM · Wikimedia-IEG-grant-review
bd808 added a comment to T180773: Upgrade of libraries: slim vs. twig view vs. PHP view.

Rather than upgrading libraries in this project directly, T114969: Update grantreview codebase to use the wikimedia/slimapp library should be done first. wikimedia/slimapp could be updated to use newer libraries. There may be a task somewhere about the slim2 to slim3 migration for that library. The view layer used by wikimedia/slimapp and its dependent projects (Wikimania Scholarships and several Toolforge tools) is Twig.

Sat, Nov 18, 5:52 PM · Wikimedia-IEG-grant-review
bd808 added a comment to T175885: Toolforge's static webserver broken by Puppet changes and stale nginx packages.

The unattended-upgrades failure was caused by a conffile prompt for the /etc/nginx/sites-enabled/default file which is provided by the package but removed by our Puppet configuration via the File['/etc/nginx/sites-enabled`] in ::nginx.

Sat, Nov 18, 5:35 PM · cloud-services-team (Kanban), Operations, Cloud-VPS, Toolforge
bd808 updated the task description for T180853: Bring discourse.mediawiki.org to production .
Sat, Nov 18, 5:12 PM · Developer-Relations, Operations
bd808 added a comment to T180854: Create discourse-mediawiki.wmflabs.org (pilot instance).

@Tgr would hosting this VM fit in the scope of T180662: Request creation of qna VPS project?

Sat, Nov 18, 4:58 PM · cloud-services-team (Kanban), Developer-Relations, Operations

Fri, Nov 17

bd808 added a comment to T180830: `setup-tomcat` failing with "range_list containes no elements" error from SGE.

$ qconf -sconf | grep MAX_DYN_EC gives no results, but MAX_DYN_EC is mentioned in sge_conf(5) man page and should have a default of 99, which we should not have ran out.

Fri, Nov 17, 11:59 PM · Toolforge
bd808 moved T180854: Create discourse-mediawiki.wmflabs.org (pilot instance) from Inbox to Needs discussion on the cloud-services-team (Kanban) board.
Fri, Nov 17, 11:13 PM · cloud-services-team (Kanban), Developer-Relations, Operations
bd808 edited projects for T180854: Create discourse-mediawiki.wmflabs.org (pilot instance), added: cloud-services-team (Kanban); removed cloud-services-team.
Fri, Nov 17, 11:12 PM · cloud-services-team (Kanban), Developer-Relations, Operations
bd808 reopened T96705: Create download statistics dashboard for tarballs as "Open".

I incorrectly assumed that the Extension Distributor dashboard also covered the mediawiki-core tarballs. We still need to track that somewhere. We do have a nice example to follow of the data that we would like to capture and report however.

Fri, Nov 17, 10:21 PM · Tools, MediaWiki-General-or-Unknown
bd808 closed T96705: Create download statistics dashboard for tarballs as Resolved.

This is exactly what I was hoping for oh so many years ago. :)

Fri, Nov 17, 9:08 PM · Tools, MediaWiki-General-or-Unknown
Quiddity awarded T96705: Create download statistics dashboard for tarballs a Love token.
Fri, Nov 17, 7:11 PM · Tools, MediaWiki-General-or-Unknown
bd808 added a comment to T180831: `setup-tomcat` failing with "range_list containes no elements" error.

With set -e and set -x added to the wrapper script

$ ./setup-tomcat
++ /bin/cat /etc/wmflabs-project
+ prefix=tools
++ /usr/bin/id -nu
++ sed -e 's/^tools.//'
+ tool=bd808-test
+ user=tools.bd808-test
++ getent passwd tools.bd808-test
++ cut -d : -f 6
++ sed -e 's/\/$//'
+ home=/data/project/bd808-test
++ getent group tools.bd808-test
++ cut -d : -f 1
+ '[' tools.bd808-test '!=' tools.bd808-test ']'
+ '[' -d /data/project/bd808-test/public_tomcat ']'
+ echo 'Setting up your public_tomcat directory...'
Setting up your public_tomcat directory...
+ /usr/bin/qsub -sync y -o /dev/null -e /dev/null -i /dev/null -q webgrid-generic -l h_vmem=512m -l release=trusty -b y -N setup-bd808-test tomcat7-instance-create public_tomcat
Fri, Nov 17, 6:50 PM · Toolforge
bd808 created T180831: `setup-tomcat` failing with "range_list containes no elements" error.
Fri, Nov 17, 6:48 PM · Toolforge
bd808 added a member for Security: aborrero.
Fri, Nov 17, 5:50 PM
bd808 archived User-bd808.
Fri, Nov 17, 4:58 AM
bd808 closed T172603: Tool "hackmd" loads assets from github and google as Declined.

hackmd is being abandoned by the org that was developing it (https://github.com/hackmdio/hackmd/pull/578#issuecomment-336280706) so I'm not going to work on getting it running on toolforge anymore. I may check back in a few months and see if the "community edition" is still getting any updates or not and work on it again then.

Fri, Nov 17, 4:57 AM · User-bd808, Tools
bd808 closed T172603: Tool "hackmd" loads assets from github and google, a subtask of T172065: Hunt for Toolforge tools that load resources from third party sites, as Declined.
Fri, Nov 17, 4:57 AM · Toolforge-standards-committee, Tools, Privacy
bd808 closed T167545: The link of the source code of this repo that is present on tools.wmflabs.org could be more discreet as Resolved.

The redesigned tools landing page has the source link in the footer.

Fri, Nov 17, 4:52 AM · User-bd808, Tools
bd808 edited projects for T96705: Create download statistics dashboard for tarballs, added: MediaWiki-General-or-Unknown, Tools; removed User-bd808.
Fri, Nov 17, 4:50 AM · Tools, MediaWiki-General-or-Unknown
bd808 updated the task description for T177126: 2017 Toolforge user survey.
Fri, Nov 17, 2:00 AM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge
bd808 added a comment to T177126: 2017 Toolforge user survey.

Privacy policy for this survey: https://wikimediafoundation.org/wiki/2017_Toolforge_Survey_Privacy_Statement

Fri, Nov 17, 1:59 AM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge

Thu, Nov 16

bd808 moved T114401: allow tool users to attach strace to their processes (at least on exec hosts) from Inbox to Needs discussion on the cloud-services-team (Kanban) board.
Thu, Nov 16, 8:52 PM · cloud-services-team (Kanban), Toolforge
bd808 edited projects for T114401: allow tool users to attach strace to their processes (at least on exec hosts), added: cloud-services-team (Kanban); removed Cloud-Services.

@MoritzMuehlenhoff Loosening this protection on the Toolforge exec nodes seems reasonable to me, but I wanted to check with you before putting in a Puppet patch and actually changing the live nodes. The protection seems to be primarily aimed at desktop systems to help prevent malware from inspecting processes. In our shared hosting environment it is not reasonable to allow sudo for gdb/ptrace and it is not scalable to have root holders perform inspections for tenants.

Thu, Nov 16, 8:52 PM · cloud-services-team (Kanban), Toolforge
bd808 closed T179380: hhvm-staging.hhvm.eqiad.wmflabs has high user/system CPU as Resolved.
Thu, Nov 16, 7:07 PM · User-bd808, cloud-services-team (Kanban), VPS-Projects, HHVM
bd808 closed T179380: hhvm-staging.hhvm.eqiad.wmflabs has high user/system CPU, a subtask of T179378: some labvirt servers are at full CPU capacity, as Resolved.
Thu, Nov 16, 7:07 PM · cloud-services-team, Cloud-VPS
bd808 added a comment to T175096: Identify tools hosting databases on labsdb100[13] and notify maintainers.

MassMessage sent to c3.labsdb database users (example).

Thu, Nov 16, 5:21 AM · cloud-services-team (Kanban), Data-Services, DBA

Wed, Nov 15

bd808 added a comment to T180233: Set `no-dev` as the default config in composer.json.

A potential fix would be to make our own CLI install manager system. This could start as a thin wrapper around Composer and grow as needed to encompass things like extension and skin management. This CLI manager could be self-hosted in mediawiki/core.git and self-bootstrapping as well. The hard part of this is finding a set of interested developers to design, implement, and maintain yet another component that is only tangentially related to the core system.

Wed, Nov 15, 11:38 PM · Upstream, Composer, Security
bd808 added a comment to T180233: Set `no-dev` as the default config in composer.json.

It used to work correctly for what its worth:

* Break: The install command now has --dev enabled by default. --no-dev can be used to install without dev requirements
Wed, Nov 15, 11:23 PM · Upstream, Composer, Security
bd808 added a comment to T180590: Regaining access to account with 2FA scratch codes.

@Pintoch This should work:

Wed, Nov 15, 10:09 PM · wikitech.wikimedia.org, Striker
bd808 closed T178963: add vhost names to nginx access log for project-proxy as Resolved.

Entries now look like:

c.tiles.wmflabs.org x.x.x.x - - [15/Nov/2017:19:09:11 +0000] "GET /hikebike/16/35147/24226.png HTTP/1.1" 200 5368 "-" "User-agent string here"
Wed, Nov 15, 7:10 PM · User-bd808, cloud-services-team (Kanban), Patch-For-Review, Cloud-VPS
bd808 closed T178963: add vhost names to nginx access log for project-proxy, a subtask of T178834: Provide any rough metrics for tool and project usage, as Resolved.
Wed, Nov 15, 7:10 PM · Developer-Relations, Cloud-VPS, Toolforge, cloud-services-team
bd808 committed rICMVa273e162ad24: Allow lines >100 chars if they are URLs (authored by bd808).
Allow lines >100 chars if they are URLs
Wed, Nov 15, 5:09 PM
bd808 committed rICMV71a836bb7970: Validate Change-Id and Depends-On values (authored by bd808).
Validate Change-Id and Depends-On values
Wed, Nov 15, 5:09 PM
bd808 committed rICMVf72a631fd5b3: Make rules for footer contents less strict (authored by bd808).
Make rules for footer contents less strict
Wed, Nov 15, 5:09 PM
bd808 committed rICMV2a00d08e54f5: Make rules for footer contents less strict (authored by bd808).
Make rules for footer contents less strict
Wed, Nov 15, 5:09 PM
bd808 committed rICMV2f0238c04abb: Remove StopIteration for PEP 479 compatibility (authored by bd808).
Remove StopIteration for PEP 479 compatibility
Wed, Nov 15, 5:09 PM
bd808 committed rICMV2c8251b05cc8: Validate Change-Id and Depends-On values (authored by bd808).
Validate Change-Id and Depends-On values
Wed, Nov 15, 5:09 PM
bd808 committed rICMVe83a542731bf: Make rules for footer contents less strict (authored by bd808).
Make rules for footer contents less strict
Wed, Nov 15, 5:09 PM
bd808 committed rICMVb2599e72d8ef: Change check_message_ok test text (authored by bd808).
Change check_message_ok test text
Wed, Nov 15, 5:09 PM
bd808 committed rICMVdb9bc950bbbb: Allow lines >100 chars if they are URLs (authored by bd808).
Allow lines >100 chars if they are URLs
Wed, Nov 15, 5:09 PM
bd808 committed rICMV06f2041af1a5: Add python artifacts to .gitignore (authored by bd808).
Add python artifacts to .gitignore
Wed, Nov 15, 5:09 PM
bd808 committed rICMV87a4bf8029b9: Add support for Depends-On statements (authored by bd808).
Add support for Depends-On statements
Wed, Nov 15, 5:09 PM
bd808 removed projects from T180558: Include namespace IDs and their names to mysql wikireplicas (meta_p database): Goal, cloud-services-team (FY2017-18), DBA.

From the see also task:

The database exists, and is enduser-provided. Nothing for ops to do here.

Wed, Nov 15, 5:28 AM · Data-Services
bd808 moved T177299: Revert temporary increase of floating-ip quota for 'cvn' project (trusty to debian migration) from Inbox to On-call on the cloud-services-team (Kanban) board.
Wed, Nov 15, 3:52 AM · cloud-services-team (Kanban), Cloud-VPS (Quota-requests)
bd808 added a project to T177299: Revert temporary increase of floating-ip quota for 'cvn' project (trusty to debian migration): cloud-services-team (Kanban).

@aborrero, do you want to do this quota reduction? The instructions for viewing and modifying a project's quota are at https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Nova-manage.

Wed, Nov 15, 3:52 AM · cloud-services-team (Kanban), Cloud-VPS (Quota-requests)

Tue, Nov 14

bd808 added a project to T178803: `qsub sync -y` jobs failing on Grid Engine with "range_list containes no elements" error: cloud-services-team (Kanban).
Tue, Nov 14, 11:47 PM · cloud-services-team (Kanban), Toolforge, Wikisource
bd808 added a project to T180462: puppet-compiler issue with CloudVPS instances: Cloud-VPS.
Tue, Nov 14, 11:35 PM · Cloud-VPS, cloud-services-team
bd808 added a comment to T180512: Install/upgrade toolforge to current phpunit.

Is an OS upgrade planned any time soon?

Tue, Nov 14, 11:29 PM · Toolforge
bd808 updated subscribers of T171881: CL support for Wikipedia Zero piracy problems.

Would it be fair to assume that the URL-encoding normalization rules for the upload.wikimedia.org URLs should be the same as the one we use for MediaWiki? Anyone know if there's any reason for it to vary from that?

Tue, Nov 14, 10:57 PM · Patch-For-Review, Community-Liaisons (Oct-Dec 2017), Zero
bd808 assigned T178661: Drop wb_entity_per_page views in Wiki Replicas to chasemp.

Assigning to @chasemp as current on-call. This fell through the cracks.

Tue, Nov 14, 9:07 PM · cloud-services-team (Kanban), Data-Services, Wikidata-Former-Sprint-Board, Wikidata
bd808 moved T180513: Document wiki-replicas architecture for future automation from Inbox to To-Do on the cloud-services-team (Kanban) board.
Tue, Nov 14, 9:05 PM · cloud-services-team (Kanban), Cloud-VPS
bd808 edited projects for T180513: Document wiki-replicas architecture for future automation, added: cloud-services-team (Kanban); removed cloud-services-team.
Tue, Nov 14, 9:05 PM · cloud-services-team (Kanban), Cloud-VPS
bd808 added a comment to T180421: Request creation of PartnerMetrics VPS project.

+1 once labvirt1015 is online and we have a bit more space for VMs

Tue, Nov 14, 7:20 PM · Cloud-VPS (Project-requests)
bd808 added a comment to T180347: Request creation of wikidata-primary-sources-tool VPS project.

+1 once labvirt1015 is online and we have a bit more space for VMs

Tue, Nov 14, 7:20 PM · Wikidata-primary-sources, Wikidata, Cloud-VPS (Project-requests)
bd808 added a comment to T180178: Request increased quota for traffic Cloud VPS project.

+1 once labvirt1015 is online

Tue, Nov 14, 7:19 PM · netops, Traffic, Operations, Cloud-VPS (Quota-requests)
bd808 updated the task description for T171473: labvirt1015 crashes.
Tue, Nov 14, 7:02 PM · cloud-services-team (Kanban), DC-Ops, ops-eqiad, Operations
bd808 added a comment to T180512: Install/upgrade toolforge to current phpunit.

Oh, PHP7 is probably too much to ask as well then?

Tue, Nov 14, 7:02 PM · Toolforge
bd808 added a comment to T180512: Install/upgrade toolforge to current phpunit.

I think the better solution to this is to uninstall the Ubuntu package and let anyone who wants/needs phpunit install it in their tool via Composer. I can't think of any reasonable way that we can manage a global install of this other than by using the ancient package that Ubuntu Trusty provides.

Tue, Nov 14, 6:25 PM · Toolforge
bd808 added a comment to T180512: Install/upgrade toolforge to current phpunit.

We have phpunit installed globally? The horror!

Tue, Nov 14, 6:22 PM · Toolforge
bd808 closed T179766: Redirect toolserver.org/~nikola/articlesby.php to tools.wmflabs.org/xtools/pages as Resolved.
$ curl -i https://toolserver.org/~nikola/articlesby.php
HTTP/1.1 301 Moved Permanently
Date: Tue, 14 Nov 2017 17:37:44 GMT
Server: Apache
Location: https://xtools.wmflabs.org/pages
Content-Length: 240
Content-Type: text/html; charset=iso-8859-1
Tue, Nov 14, 5:38 PM · User-bd808, cloud-services-team (Kanban), Patch-For-Review, XTools, Tools
bd808 updated the task description for T177126: 2017 Toolforge user survey.
Tue, Nov 14, 5:12 PM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge
bd808 added a project to T154150: role::puppetmaster::standalone has no firewall rule for port 8140: cloud-services-team (Kanban).
Tue, Nov 14, 3:28 PM · cloud-services-team (Kanban), Cloud-VPS, Puppet
bd808 added a comment to T180280: Reset 2FA for [[User:Jean-Frédéric]].

After validating the contents of /home/jeanfred/2-fa-reset.txt I disabled OATH for @JeanFred's developer account.

$ mwscript extensions/OATHAuth/maintenance/disableOATHAuthForUser.php --wiki=labswiki Jean-Frédéric
OATHAuth disabled for Jean-Frédéric.
Tue, Nov 14, 2:56 AM · Wikimedia-Site-requests, cloud-services-team, wikitech.wikimedia.org, Support-and-Safety

Mon, Nov 13

bd808 updated the task description for T177126: 2017 Toolforge user survey.
Mon, Nov 13, 11:19 PM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge
bd808 added a comment to T177126: 2017 Toolforge user survey.

I'm going to put the dates for the survey into the CE calendar as 2017-11-20 through 2017-12-01. I think that should work assuming that we get the privacy statement done this week. It looks like everything else is basically ready to go.

Mon, Nov 13, 11:09 PM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge
bd808 added a comment to T180380: "ERROR 2006 (HY000): MySQL server has gone away" failures for a variety of queries against Wiki Replica servers.

Not a definitive answer, but I seem to be able to make the example query using the sql wrapper (which is just a python script that calls execvp to run /usr/bin/mysql) using a normal Toolforge account. @Magnus's report is that it works for him via that method as well, but is failing from a scripted run related to a tool.

$ sql commonswiki
(u3518@commonswiki.labsdb) [commonswiki_p]> select distinct gil_wiki from globalimagelinks;
+----------------------+
| gil_wiki             |
+----------------------+
|                      |
| aawikibooks          |
...
| zuwiktionary         |
+----------------------+
805 rows in set (21.19 sec)

@Magnus Can you point me to a particular script that you are seeing this drop behavior on commonly? I'd like to see if I can find a way to "reliably" reproduce this intermittent failure. It seems like it could be on the client, the server, or even somewhere in-between, so knowing these things may help us narrow the problem down:

  • Implementation language (PHP, Python, tcl, ...)
  • Is the failing process running on the Job Grid or in Kubernetes?
  • Is the failing process running interactively, via a webservice, or as a cron task?
  • Do we know which node in the Job Grid or Kubernetes is running the process when it fails?
  • Do we know timestamps for any/all of the failures?
Mon, Nov 13, 9:59 PM · DBA, Data-Services
bd808 added a comment to T173511: Implement technical details and process for "datasets_p" on wikireplica hosts.

Do we need a full blown ETL pipeline system for Proposal C or can we just start with a Puppet module that manages some cron jobs and static scripts?

Mon, Nov 13, 9:14 PM · Data-Services, DBA, cloud-services-team (Kanban), Analytics, Research
bd808 added a comment to T177126: 2017 Toolforge user survey.

@bd808

  • Re privacy statement, I'm reviewing the survey now and I'll follow this page which will give you a privacy statement. Please review the intro paragraphs to last year's survey and confirm that from your pov, this is what we want to do this year, too. (I went over them now and they still make sense to me.)
Mon, Nov 13, 6:38 PM · User-bd808, Research, Research-2017-18-Q2, Goal, cloud-services-team (FY2017-18), Toolforge
bd808 renamed T180380: "ERROR 2006 (HY000): MySQL server has gone away" failures for a variety of queries against Wiki Replica servers from Toolforge DB replicas timeout [again] to "ERROR 2006 (HY000): MySQL server has gone away" failures for a variety of queries against Wiki Replica servers.
Mon, Nov 13, 6:07 PM · DBA, Data-Services
bd808 moved T180380: "ERROR 2006 (HY000): MySQL server has gone away" failures for a variety of queries against Wiki Replica servers from Backlog to Wiki replicas on the Data-Services board.
Mon, Nov 13, 6:05 PM · DBA, Data-Services
bd808 added projects to T180380: "ERROR 2006 (HY000): MySQL server has gone away" failures for a variety of queries against Wiki Replica servers: Data-Services, DBA.
Mon, Nov 13, 6:05 PM · DBA, Data-Services
bd808 created T180377: Does role::labs::mediawiki_vagrant provision cleanly on Debian Stretch hosts?.
Mon, Nov 13, 5:35 PM · MediaWiki-Vagrant, Cloud-VPS
bd808 added a comment to T180037: [Spike] Can the new render service run on Debian Stretch?.

I got a node running Debian Stretch up and running in the project.

$ ssh chromium-render-stretch.reading-web-staging.eqiad.wmflabs
Linux chromium-render-stretch 4.9.0-3-amd64 #1 SMP Debian 4.9.30-2+deb9u5 (2017-09-19) x86_64
Debian GNU/Linux 9.1 (stretch)
The last Puppet run was at Mon Nov 13 17:20:16 UTC 2017 (2 minutes ago).
Last login: Mon Nov 13 17:22:03 2017 from 10.68.17.232
bd808@chromium-render-stretch:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description:    Debian GNU/Linux 9.1 (stretch)
Release:        9.1
Codename:       stretch
bd808@chromium-render-stretch:~$

The only change I made was T180037#3755631 where I removed the role::labs::mediawiki_vagrant Puppet setting from project global Puppet config for the reading-web-staging project via the interface at https://horizon.wikimedia.org/. My reason for doing this was to remove any extra potential Puppet configuration that could be causing your multiple initial provisioning failures. Removing this global role will not remove existing MediaWiki-Vagrant packages that are on other instances, but it will prevent MediaWiki-Vagrant from being automatically installed on this and future instances in your project. It would be a good idea to go through the existing instances and enable role::labs::mediawiki_vagrant directly on the nodes where you are actively using it.

Mon, Nov 13, 5:31 PM · Readers-Web-Kanban-Board, Proton, Spike, Readers-Web-Backlog