bd808 (Bryan Davis)
Sr Software Engineer, Wikimedia Foundation

Projects (28)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.
User Since
Oct 3 2014, 2:36 PM (124 w, 2 d)
Availability
Available
IRC Nick
bd808
LDAP User
BryanDavis
MediaWiki User
BDavis (WMF)

I'm BDavis (WMF) on wiki, bd808 on irc, and BryanDavis on Gerrit and Wikitech.

I've got a thing for 🦄s. Don't judge.

I work for or provide services to the Wikimedia Foundation, but this is my only Phabricator account. Edits, statements, or other contributions made from this account are my own, and may not reflect the views of the Foundation.

Recent Activity

Yesterday

bd808 triaged T63042: MeetBot doesn't respect "Please note: Channel is logged and publicly posted (DO NOT REMOVE THIS NOTE)." as "Normal" priority.

Upping priority - we had two meetings today and had to change the topic twice every time. Very frustrating.

Sun, Feb 19, 11:22 PM · Upstream, Tool-Labs-tools-meetbot
bd808 added a comment to T158482: Remove shellmanagers group on wikitech.

@bd808 I understand. Is the process at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request still needed then?

Sun, Feb 19, 11:16 PM · Patch-For-Review, Labs, wikitech.wikimedia.org
bd808 updated subscribers of T156604: Enable Special:NovaSecurityGroup again in MediaWiki:Common.js.

@Andrew is there any reason not to remove this javascript band-aid?

Sun, Feb 19, 12:33 AM · wikitech.wikimedia.org, Labs

Sat, Feb 18

bd808 added a comment to T158482: Remove shellmanagers group on wikitech.

The automatic group management for shell was added in rEOST1d147bf7c32a: Revert "Revert "Automatically add to shell group when adding to a project"" for T97334: Grant shell user right with project memberships and remove autocreation of shell requests. The shell group itself is needed, but shellmanagers is not.

Sat, Feb 18, 11:09 PM · Patch-For-Review, Labs, wikitech.wikimedia.org
bd808 added a comment to T158315: Nemo_bis has admin (!= contentadmin) rights on wikitech.

I don't doubt it was a security issue, but @Nemo_bis should have been heard previously I think. In any case, I don't want to start a fight for this.

Sat, Feb 18, 6:02 PM · User-bd808, Labs, wikitech.wikimedia.org, Security
bd808 created T158478: Striker does not recognize tools as maintainers.
Sat, Feb 18, 5:44 PM · Striker
bd808 updated subscribers of T158315: Nemo_bis has admin (!= contentadmin) rights on wikitech.

It was marked as a security issue because it was. It is not now because it has been resolved by removing the rights that are not needed for general vandal fighting (and thank you @Nemo_bis for helping with that!).

Sat, Feb 18, 5:22 PM · User-bd808, Labs, wikitech.wikimedia.org, Security
bd808 added a comment to T156580: Newly created instance requires password to ssh in.

In the meanwhile all such links have disappeared, including those to create or delete instances, so I can't do any testing about this report. If instance creation was intentionally disabled on wikitech due to being broken, please close this invalid (but also write labs-announce about it).

Sat, Feb 18, 5:02 PM · Labs, Labs-Infrastructure
bd808 added a comment to T158405: Consider setting a Diffusion mirror of GitHub's Quentinv57's-tools.

@MarcoAurelio We can setup a mirror of the upstream GitHub repo in Diffusion relatively easily. The semi-manual procedure for this is documented at https://wikitech.wikimedia.org/wiki/Toolsadmin.wikimedia.org/FAQ

Sat, Feb 18, 4:29 PM · Tool-Labs-tools-Quentinv57's-tools, Tool-Labs, Labs, Tool-Labs-standards-committee
bd808 changed the visibility for T158315: Nemo_bis has admin (!= contentadmin) rights on wikitech.
Sat, Feb 18, 4:14 PM · User-bd808, Labs, wikitech.wikimedia.org, Security
bd808 accepted D571: Document the keyholder-auth.d/*.yaml config files.
Sat, Feb 18, 10:52 AM · Release-Engineering-Team
bd808 closed T158448: Jouncebot: Crashes when issued a command. as "Resolved".
[00:59]  <    bd808>	jouncebot: now
[00:59]  <jouncebot>	No deployments scheduled for the forseeable future!
[00:59]  <    bd808>	jouncebot: next
[00:59]  <jouncebot>	No deployments scheduled for the forseeable future!
[00:59] 		* bd808	declares victory
Sat, Feb 18, 1:01 AM · User-bd808, Patch-For-Review, Tool-Labs-tools-Other, Operations

Fri, Feb 17

bd808 added a comment to T158448: Jouncebot: Crashes when issued a command..
ERROR:root:Unhandled exception. Terminating.
Traceback (most recent call last):
  File "./jouncebot/jouncebot.py", line 281, in <module>
    bot.start()
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/bot.py", line 265, in start
    super(SingleServerIRCBot, self).start()
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 1273, in start
    self.reactor.process_forever()
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 276, in process_forever
    self.process_once(timeout)
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 257, in process_once
    self.process_data(i)
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 214, in process_data
    c.process_data()
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 583, in process_data
    self._process_line(line)
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 654, in _process_line
    self._handle_event(event)
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 677, in _handle_event
    self.reactor._handle_event(self, event)
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 396, in _handle_event
    result = handler.callback(connection, event)
  File "/data/project/jouncebot/virtenv/local/lib/python2.7/site-packages/irc/client.py", line 1236, in _dispatcher
    method(connection, event)
  File "./jouncebot/jouncebot.py", line 118, in on_pubmsg
    conn, event, event.target, msg_parts[1].strip())
  File "./jouncebot/jouncebot.py", line 140, in do_command
    conn, event, cmd, source, nickmask)
  File "./jouncebot/jouncebot.py", line 195, in do_command_now
    td = upcoming[0].start - ctime
IndexError: list index out of range
Fri, Feb 17, 9:23 PM · User-bd808, Patch-For-Review, Tool-Labs-tools-Other, Operations
bd808 added a comment to T158155: Allow running cronjobs on k8s.

@Legoktm I think 'we' can create a page on wikitech that collects documentation about 'advanced' Kubernetes usage. There are some things I can contribute from the Stashbot config about setting up and running a continuous job using a custom deployment file. The page needs to be very clear however that using these kinds of features is for intrepid adventurers only, could break at any moment, and not officially supported in any way by the Tool Labs/Cloud Services team.

Fri, Feb 17, 9:19 PM · Patch-For-Review, Tools-Kubernetes, Labs, Tool-Labs
bd808 added a comment to T158403: #Repository-Admins access for @MarcoAurelio.

@MarcoAurelio How about we just add you to the owner ACL for that repo?

Fri, Feb 17, 6:46 PM · Repository-Admins
bd808 added a comment to T158403: #Repository-Admins access for @MarcoAurelio.

For making other arbitrary Diffusion repos, the self-service answer is to use https://toolsadmin.wikimedia.org/ to create repos associated with tools.

Fri, Feb 17, 6:42 PM · Repository-Admins
bd808 added a comment to T158403: #Repository-Admins access for @MarcoAurelio.

@MarcoAurelio How about we just add you to the owner ACL for that repo?

Fri, Feb 17, 6:41 PM · Repository-Admins
bd808 updated subscribers of T72625: Migrate Tools access request process to Phabricator.

I haven't tested Striker yet because I would need a second SUL account for that (?),

Fri, Feb 17, 6:23 PM · Project-Admins, Labs, Tool-Labs
bd808 added a comment to T158408: Can't create account "Trizek (WMF)".

I prefer to have separate accounts, like I've done for all other accounts. Why is it not encouraged?

Fri, Feb 17, 5:08 PM · wikitech.wikimedia.org, Labs, Operations
bd808 added a comment to T158408: Can't create account "Trizek (WMF)".

@Trizek-WMF, I or any other Wikitech admin can make you an account that bypasses the title blacklist rules if you really want it. Typically we don't require or encourage "* WMF" technical contributor accounts.

Fri, Feb 17, 4:42 PM · wikitech.wikimedia.org, Labs, Operations
bd808 added a comment to T157838: Move wm-bot instance to Trusty.

You can enable role::labs::lvm::srv on your instance and force a puppet run via sudo -i puppet agent --test --verbose. This will create a partition that fills the remainder of your instance's disk quota and mount it at /srv on the instance.

Fri, Feb 17, 4:20 PM · Labs, WM-Bot
bd808 added a comment to T158383: deb.tools.wmflabs.org is not accessible from outside Tool Labs.

I wonder if we should use an https proxy in front of it instead? Getting debs from an insecure http connection seems like a bad idea generally and especially outside of the tools project internal network.

Fri, Feb 17, 4:05 AM · Labs, Tool-Labs
bd808 added a comment to T153616: Extension:SyntaxHighlight_GeSHi reports for pages with syntax highlighting errors are bogus.

Thanks for following up on it @scfc!

Fri, Feb 17, 1:19 AM · SyntaxHighlight, wikitech.wikimedia.org, Labs

Thu, Feb 16

bd808 edited the description of T158358: tin.eqiad.wmnet / partition is full.
Thu, Feb 16, 10:52 PM · Deployment-Systems, Release-Engineering-Team, Operations
bd808 added a comment to T151002: Expose tool-labs service names via environment variables.

"Real" service discovery is something that we should get from a PaaS layer or other orchestration system for containers. In reality all that will do however is manage some well known service names via a DNS proxy specific to each deployment. Adding a side car container to act as a transparent proxy for every external service needed is not a very scalable pattern.

Thu, Feb 16, 10:43 PM · Tool-Labs, Labs
bd808 added a comment to T149191: My first kubernetes + python3 + django app tutorial.

I still want something like https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/My_first_Flask_OAuth_tool but with a Django flavor.

Thu, Feb 16, 10:12 PM · Community-Tech-Tool-Labs, Tools-Kubernetes, Tool-Labs, Labs
bd808 added a comment to T153616: Extension:SyntaxHighlight_GeSHi reports for pages with syntax highlighting errors are bogus.
silver:~
bd808$ mwscript showJobs.php --wiki=labswiki --group
categoryMembershipChange: 7 queued; 8214 claimed (201 active, 8013 abandoned); 0 delayed
Thu, Feb 16, 9:54 PM · SyntaxHighlight, wikitech.wikimedia.org, Labs
bd808 added a comment to T158199: Provide snapshot of http://tools-elastic-01.tools.eqiad.wmflabs logs.

h/t to https://ma.ttias.be/nginx-cannot-assign-requested-address-for-upstream/ for leading me to think about TCP port exhaustion as the possible culprit here.

Thu, Feb 16, 9:37 PM · Labs
bd808 closed T149150: OAuth api access on wikitech fails with consumed nonce error as "Resolved".

@bd808: Is there anything left to do here?

Thu, Feb 16, 9:35 PM · User-bd808, MediaWiki-extensions-OAuth, Labs, wikitech.wikimedia.org
bd808 added a comment to T158199: Provide snapshot of http://tools-elastic-01.tools.eqiad.wmflabs logs.

There are a lot of error log entries that look like:

2017/02/15 09:55:45 [crit] 714#0: *1437567 connect() to 127.0.0.1:9200 failed (99: Cannot assign requested address) while connecting to upstream, client: 10.68.17.205, server: , request: "POST /wikifactmine-papers/_search HTTP/1.1", upstream: "http://127.0.0.1:9200/wikifactmine-papers/_search", host: "tools-elastic-01.tools.eqiad.wmflabs"
Thu, Feb 16, 9:22 PM · Labs
bd808 added a comment to T92826: Ready-to-use Docker package for MediaWiki.
  1. deploying extensions and skins using Git (i.e. no Composer or minimal composer). Composer once seemed to have promise but whether it is the supported, preferred method is no longer obvious to me (wouldn't mind a steer on this).
Thu, Feb 16, 8:55 PM · User-mobrovac, Services, MediaWiki-Containers, MediaWiki-Releasing, Wikimedia-Hackathon-2015
bd808 committed rKEYHOLDERff960e795a9c: README formatting (authored by bd808).
README formatting
Thu, Feb 16, 6:52 PM
bd808 closed D569: README formatting by committing rKEYHOLDERff960e795a9c: README formatting.
Thu, Feb 16, 6:52 PM · Release-Engineering-Team
bd808 closed T158315: Nemo_bis has admin (!= contentadmin) rights on wikitech as "Resolved".

Reduced from admin to contentadmin.

Thu, Feb 16, 6:33 PM · User-bd808, Labs, wikitech.wikimedia.org, Security
Artistickazmee awarded E498: bd808 @ WMCON a Love token.
Thu, Feb 16, 6:27 PM
bd808 removed invites for E498: bd808 @ WMCON: Artistickazmee.
Thu, Feb 16, 6:26 PM
bd808 updated subscribers of E498: bd808 @ WMCON.
Thu, Feb 16, 6:17 PM
bd808 created E498: bd808 @ WMCON.
Thu, Feb 16, 6:17 PM
bd808 updated subscribers of E497: bd808 vacation.
Thu, Feb 16, 6:16 PM
bd808 created E497: bd808 vacation.
Thu, Feb 16, 6:15 PM
bd808 committed rLTSTc891ec63f96c: Guard against multiple bots competing in channels (authored by bd808).
Guard against multiple bots competing in channels
Thu, Feb 16, 4:43 AM
bd808 committed rLTSTae4cae97a34c: flake8 fixes (authored by bd808).
flake8 fixes
Thu, Feb 16, 4:43 AM
bd808 committed rLTST28ffa342c055: Support Python3 (authored by bd808).
Support Python3
Thu, Feb 16, 4:43 AM
bd808 edited projects for T156895: stashbot_______ is now known as stashbot________, added: Stashbot; removed Tool-Labs-tools-Other.
Thu, Feb 16, 2:41 AM · Patch-For-Review, Stashbot, User-bd808
bd808 created D569: README formatting.
Thu, Feb 16, 1:21 AM · Release-Engineering-Team

Wed, Feb 15

bd808 committed rODIT13ca42e6cc07: Refactor apt-get actions in Dockerfiles (authored by bd808).
Refactor apt-get actions in Dockerfiles
Wed, Feb 15, 7:07 PM
bd808 added a comment to T115650: Create an authoritative and well promoted catalog of Wikimedia tools.

It's just 400 tools, and history has proven that this number won't grow exponentially.

Wed, Feb 15, 6:31 PM · Documentation, MediaWiki-Stakeholders-Group, Developer-Wishlist (2017), Community-Tech-Tool-Labs, Labs, Developer-Relations, Tool-Labs-tools-Other
bd808 committed rODITef0365c216e8: Refactor apt-get actions in Dockerfiles (authored by bd808).
Refactor apt-get actions in Dockerfiles
Wed, Feb 15, 5:37 PM
bd808 added a comment to T90687: Support a responsive grid system.

I'm sure that I don't know everything there is to know in this space, but a clone of the Bootstrap 12-column grid seems technically simple and generally well documented. There are a lot of good docs on using 12-column grids and Bootstrap has become widespread enough that a fair number of casual web developers are familiar with it. The big need in my mind is for a responsive grid that can be easily used for article content as well as special page layout and skins themselves. In my mind this points to a solution that reinvents as few things as possible so that it is easy to document and promote widely to on-wiki content curators as well as developers.

Wed, Feb 15, 4:53 PM · MediaWiki-Stakeholders-Group, Developer-Wishlist (2017), UI-Standardization, UI-Standardization-Kanban, OOjs-UI
bd808 added a comment to T115650: Create an authoritative and well promoted catalog of Wikimedia tools.

"being developed now for Commons" with an expected first ship date about a year from today based on the timelines I've seen.

Wed, Feb 15, 5:52 AM · Documentation, MediaWiki-Stakeholders-Group, Developer-Wishlist (2017), Community-Tech-Tool-Labs, Labs, Developer-Relations, Tool-Labs-tools-Other
bd808 added a comment to T115650: Create an authoritative and well promoted catalog of Wikimedia tools.

Ideally such a catalog would include all tools (users don't care that much about Tool Labs vs Labs vs gadets vs somebody's personal server; and it would be great to have a library/bot catalog as well although the audience is different for that).

Wed, Feb 15, 5:12 AM · Documentation, MediaWiki-Stakeholders-Group, Developer-Wishlist (2017), Community-Tech-Tool-Labs, Labs, Developer-Relations, Tool-Labs-tools-Other
bd808 added a comment to T156626: k8s webservice restart failure with `ValueError: get() more than one object; use filter`.

The patched version still has the problem of failing if pod = self._find_obj(pykube.Pod, self.webservice_label_selector) matches more than one pod.

Wed, Feb 15, 4:20 AM · Patch-For-Review, Tools-Kubernetes, Labs, Tool-Labs
bd808 closed T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes as "Resolved".

Kubernetes & Python 2

tools.bd808-test@tools-bastion-02:~$ webservice --backend=kubernetes python2 shell
If you don't see a command prompt, try pressing enter.
tools.bd808-test@interactive:~$
tools.bd808-test@interactive:~$ virtualenv venv-python2-icu
Running virtualenv with interpreter /usr/bin/python2
New python executable in venv-python2-icu/bin/python2
Also creating executable in venv-python2-icu/bin/python
Installing setuptools, pip...done.
tools.bd808-test@interactive:~$ venv-python2-icu/bin/pip install --upgrade pip
Downloading/unpacking pip from https://pypi.python.org/packages/b6/ac/7015eb97dc749283ffdec1c3a88ddb8ae03b8fad0f0e611408f196358da3/pip-9.0.1-py2.py3-none-any.whl#md5=297dbd16ef53bcef0447d245815f5144
  Downloading pip-9.0.1-py2.py3-none-any.whl (1.3MB): 1.3MB downloaded
Installing collected packages: pip
  Found existing installation: pip 1.5.6
    Uninstalling pip:
      Successfully uninstalled pip
Successfully installed pip
Cleaning up...
tools.bd808-test@interactive:~$ venv-python2-icu/bin/pip install pyicu
Collecting pyicu
  Downloading PyICU-1.9.5.tar.gz (181kB)
    100% |████████████████████████████████| 184kB 1.1MB/s
Installing collected packages: pyicu
  Running setup.py install for pyicu ... done
Successfully installed pyicu-1.9.5
tools.bd808-test@interactive:~$ venv-python2-icu/bin/py
python@    python2*   python2.7@
tools.bd808-test@interactive:~$ venv-python2-icu/bin/python2
Python 2.7.9 (default, Jun 29 2016, 13:08:31)
[GCC 4.9.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import icu
>>> dir(icu)
['BreakIterator', 'Calendar', 'CanonicalIterator', 'Char', 'CharacterIterator', 'CharsetDetector', 'CharsetMatch', 'ChoiceFormat', 'CollationElementIterator', 'CollationKey', 'Collator', 'CompactDecimalFormat', 'CurrencyAmount', 'CurrencyPluralInfo', 'CurrencyUnit', 'DateFormat', 'DateFormatSymbols', 'DateInterval', 'DateIntervalFormat', 'DateIntervalInfo', 'DateTimePatternGenerator', 'DecimalFormat', 'DecimalFormatSymbols', 'DictionaryBasedBreakIterator', 'FLOATING_TZNAME', 'FieldPosition', 'FilteredNormalizer2', 'FloatingTZ', 'Format', 'Formattable', 'ForwardCharacterIterator', 'GregorianCalendar', 'ICUError', 'ICU_VERSION', 'ICUtzinfo', 'InvalidArgsError', 'LEFontInstance', 'LanguageCode', 'LayoutEngine', 'ListFormatter', 'Locale', 'LocaleData', 'Measure', 'MeasureFormat', 'MeasureUnit', 'MessageFormat', 'Normalizer', 'Normalizer2', 'NumberFormat', 'ParsePosition', 'PluralFormat', 'PluralRules', 'RegexMatcher', 'RegexPattern', 'Replaceable', 'ResourceBundle', 'RuleBasedBreakIterator', 'RuleBasedCollator', 'RuleBasedNumberFormat', 'Script', 'ScriptCode', 'SearchIterator', 'SelectFormat', 'Shape', 'SimpleDateFormat', 'SimpleTimeZone', 'SpoofChecker', 'StringCharacterIterator', 'StringEnumeration', 'StringSearch', 'TimeUnitFormat', 'TimeZone', 'Transliterator', 'UBlockCode', 'UCalendarAMPMs', 'UCalendarDateFields', 'UCalendarDaysOfWeek', 'UCalendarMonths', 'UCharCategory', 'UCharCharacterIterator', 'UCharDirection', 'UCharNameChoice', 'UCollAttribute', 'UCollAttributeValue', 'UCollationResult', 'UCurrencySpacing', 'UDateTimePatternConflict', 'UDateTimePatternField', 'UDateTimePatternMatchOptions', 'UDisplayContext', 'UDisplayContextType', 'UIDNA_ALLOW_UNASSIGNED', 'UIDNA_DEFAULT', 'UIDNA_USE_STD3_RULES', 'ULocDataLocaleType', 'ULocaleDataDelimiterType', 'ULocaleDataExemplarSetType', 'UMatchDegree', 'UMeasurementSystem', 'UNICODE_VERSION', 'UNormalizationCheckResult', 'UNormalizationMode', 'UNormalizationMode2', 'UNumberCompactStyle', 'UObject', 'UProperty', 'UPropertyNameChoice', 'URBNFRuleSetTag', 'URegexpFlag', 'UResType', 'URestrictionLevel', 'USET_ADD_CASE_MAPPINGS', 'USET_CASE_INSENSITIVE', 'USET_IGNORE_SPACE', 'UScriptCode', 'UScriptUsage', 'USearchAttribute', 'USearchAttributeValue', 'USetSpanCondition', 'USpoofChecks', 'UTimeUnitFormatStyle', 'UTransDirection', 'UTransPosition', 'U_COMPARE_CODE_POINT_ORDER', 'U_FOLD_CASE_DEFAULT', 'U_FOLD_CASE_EXCLUDE_SPECIAL_I', 'UnicodeFilter', 'UnicodeFunctor', 'UnicodeMatcher', 'UnicodeSet', 'UnicodeSetIterator', 'UnicodeString', 'VERSION', '__builtins__', '__doc__', '__file__', '__name__', '__package__']
>>>
Wed, Feb 15, 3:48 AM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
bd808 closed T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes , a subtask of T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking), as "Resolved".
Wed, Feb 15, 3:48 AM · Tracking, Tool-Labs, Labs, Tools-Kubernetes
bd808 closed T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes , a subtask of T157767: Issues related to tool.spiarticleanalyzer, as "Resolved".
Wed, Feb 15, 3:48 AM · Tool-Labs-tools-Other, Tracking
bd808 added a comment to T115650: Create an authoritative and well promoted catalog of Wikimedia tools.

I have planned work for Striker that is related (T149458: Manage shared tool accounts via Striker). From that task:

The collected metadata should be stored somewhere that is accessible outside of Striker to allow others to experiment with different interfaces for searching. Ideally this exposed storage would be in Elasticsearch which provides a lot of features for filtering and other aggregate operations.

Wed, Feb 15, 3:10 AM · Documentation, MediaWiki-Stakeholders-Group, Developer-Wishlist (2017), Community-Tech-Tool-Labs, Labs, Developer-Relations, Tool-Labs-tools-Other
bd808 moved T156340: Update Tool Labs account creation docs on wikitech to mention Striker from Backlog to Ready on the Striker board.
Wed, Feb 15, 3:02 AM · Documentation, Community-Tech-Tool-Labs, wikitech.wikimedia.org, Labs, Striker
bd808 edited the description of T136429: [EPIC] Migrate base image to Debian Jessie.
Wed, Feb 15, 2:55 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant
bd808 added a comment to T92963: Fix tool kmlexport.

He did. "Do what you want" = public domain.

Wed, Feb 15, 12:36 AM · Tool-Labs-tools-Other
bd808 closed T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes as "Resolved".

Please open a new ticket to track additional issues beyond the libicu install.

Wed, Feb 15, 12:04 AM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
bd808 closed T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes , a subtask of T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking), as "Resolved".
Wed, Feb 15, 12:04 AM · Tracking, Tool-Labs, Labs, Tools-Kubernetes
bd808 added a comment to T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes .

@bd808 Thanks for merging. Do(es) particular container(s) need to be rebuilt now? (discussion of next steps)

Wed, Feb 15, 12:02 AM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other

Tue, Feb 14

bd808 added a comment to T92963: Fix tool kmlexport.

@Thgoiter I can't license it as anything. Only @Para and his existing contributors can do that.

Tue, Feb 14, 8:21 PM · Tool-Labs-tools-Other
bd808 added a project to T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes : Tools-Kubernetes.
Tue, Feb 14, 7:30 PM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
bd808 edited the description of T158099: Upgrade Openstack Horizon to Mitaka.
Tue, Feb 14, 7:15 PM · Developer-notice, Patch-For-Review, Horizon, Labs
bd808 committed R2043:e3d4860e4ecc: Add a JSON dump of the dashboard data (authored by bd808).
Add a JSON dump of the dashboard data
Tue, Feb 14, 6:30 PM
MarcoAurelio awarded T127792: Enable Flow on wikitech (labswiki and labtestwiki), then turn on for Tool talk namespace a Dislike token.
Tue, Feb 14, 10:18 AM · DBA, Patch-For-Review, Wikimedia-Extension-setup, Community-Tech-Tool-Labs, Tool-Labs, Flow, Labs, wikitech.wikimedia.org, Collaboration-Team-Triage

Mon, Feb 13

bd808 added a comment to T46791: [[wikitech:Server_admin_log]] should not rely on freenode irc for logmsgbot entries.

Some related thoughts/explanations on T156079: autolog scap3 deployments in beta.

Mon, Feb 13, 11:56 PM · Operations, Stashbot, Deployment-Systems

Sun, Feb 12

bd808 added a comment to T119366: Disable caching on the main page for anonymous users.

I believe the day magic words/parser functions have some special logic that reduces the parser cache time.

Example: https://phabricator.wikimedia.org/source/mediawiki/browse/master/includes/MagicWord.php;dffa61be3e9d245871d04980ed584cfbdaef05e3$178.

There are many cache layers. It sounds like we're possibly not doing a great job purging/invalidating some HTML cache layer?

Sun, Feb 12, 11:45 PM · Traffic, Operations, Wikimedia-General-or-Unknown
bd808 added a comment to T119366: Disable caching on the main page for anonymous users.

I would suggest, lowering this from UNB! back to High and changing the task summery to make the goal being educating various wiki communities about parse time magic words that should not be used to provide content or link targets.

Sun, Feb 12, 10:35 PM · Traffic, Operations, Wikimedia-General-or-Unknown
bd808 added a comment to T119366: Disable caching on the main page for anonymous users.

trwiki is using {{#time:Y-m-d}} which again is incompatible with any type of caching.

Sun, Feb 12, 10:33 PM · Traffic, Operations, Wikimedia-General-or-Unknown
bd808 edited projects for T119366: Disable caching on the main page for anonymous users, added: Traffic; removed MediaWiki-Cache.

Is the problem primarily that the Main Page uses [[{{LOCALDAY}}. {{LOCALMONTHNAME}}]] [[{{LOCALYEAR}}]]? These are all magic words that are fundamentally incompatible with content caching. If they were changed daily using a bot instead MediaWiki would send out the proper purge events.

Sun, Feb 12, 10:27 PM · Traffic, Operations, Wikimedia-General-or-Unknown
bd808 added a comment to T92963: Fix tool kmlexport.

Why not just leave the task open as we do with thousands of other tasks?
This tool is important as it is massively used all over Wikimedia!

Sun, Feb 12, 9:23 PM · Tool-Labs-tools-Other
bd808 added inline comments to R2048:113098a3d5dc: Use Twitter Bootstrap.
Sun, Feb 12, 8:52 PM
bd808 committed R2048:6c160185a3cc: Use yaml.safe_load (authored by bd808).
Use yaml.safe_load
Sun, Feb 12, 8:50 PM
bd808 committed R2048:56cc9d7a4728: Add tox.ini for flake8 testing (authored by bd808).
Add tox.ini for flake8 testing
Sun, Feb 12, 8:50 PM
bd808 committed R2048:d3b6b0eec364: Fix missing comma found by Ricordisamoa (authored by bd808).
Fix missing comma found by Ricordisamoa
Sun, Feb 12, 8:50 PM
bd808 added a comment to T134494: Create a "my first Python webservice" tutorial for Tool Labs.

The current tutorial does use mwoauth to do all the tricky work. It would be nice for someone to test things out with the updated flask-mwoauth blueprint. The original tutorial I started from was written by @valhallasw to showcase flask-mwoauth, but when I tried to use it it was not functional and I was unable to debug why. I'm not a flask expert by any means, but I decided that if I couldn't debug failures it would be unlikely that a beginner would be able to.

Sun, Feb 12, 8:36 PM · User-bd808, Developer-Relations, Community-Tech-Tool-Labs, Documentation, Tool-Labs, Labs
Ricordisamoa awarded T134494: Create a "my first Python webservice" tutorial for Tool Labs a Doubloon token.
Sun, Feb 12, 6:38 AM · User-bd808, Developer-Relations, Community-Tech-Tool-Labs, Documentation, Tool-Labs, Labs

Sat, Feb 11

bd808 added a comment to T157847: Preperation for api for community-labs-monitoring.

To secure, would a manually generated API key work? Or would something more secure be necessary?

Sat, Feb 11, 12:45 AM · Tool-Labs, Labs, community-labs-monitoring, Striker
bd808 added a parent task for T157847: Preperation for api for community-labs-monitoring: T53434: Implement a system to monitor tools on tool-labs.
Sat, Feb 11, 12:38 AM · Tool-Labs, Labs, community-labs-monitoring, Striker
bd808 added a subtask for T53434: Implement a system to monitor tools on tool-labs: T157847: Preperation for api for community-labs-monitoring.
Sat, Feb 11, 12:38 AM · community-labs-monitoring, Labs, Tool-Labs
bd808 edited the description of T136429: [EPIC] Migrate base image to Debian Jessie.
Sat, Feb 11, 12:23 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant
bd808 closed T154295: Make parallels provider work with a Jessie base image, a subtask of T136429: [EPIC] Migrate base image to Debian Jessie, as "Resolved".
Sat, Feb 11, 12:13 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant
bd808 closed T154295: Make parallels provider work with a Jessie base image as "Resolved".
Sat, Feb 11, 12:13 AM · User-bd808, Patch-For-Review, MediaWiki-Vagrant
bd808 closed T154293: Make hyperv provider work with a Jessie base image as "Resolved".
Sat, Feb 11, 12:13 AM · User-bd808, Patch-For-Review, MediaWiki-Vagrant
bd808 closed T154293: Make hyperv provider work with a Jessie base image, a subtask of T136429: [EPIC] Migrate base image to Debian Jessie, as "Resolved".
Sat, Feb 11, 12:13 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant

Fri, Feb 10

bd808 added a comment to T53434: Implement a system to monitor tools on tool-labs.

@bd808 if I provided some sort of CRUD API, could we use Striker as a front end? if that answer is yes, I'll create a task to discuss specifics. This will handle @scfc 's issues with regard to user input.

Fri, Feb 10, 11:52 PM · community-labs-monitoring, Labs, Tool-Labs
bd808 added a comment to T86969: [scap] Log directly to logstash via syslog input.

The notes about redis input are horribly out of date. The redis input queue was killed fairly soon after being deployed.

Fri, Feb 10, 6:33 PM · Scap
bd808 added a comment to T149312: Developing community norms for vital bots and tools.

@bd808 are there any other remaining action items on this task? If not, I would close this as resolved!

Fri, Feb 10, 5:36 PM · Developer-Relations, Community-Tech-Tool-Labs, Tool-Labs, Labs, User-bd808, Wikimedia-Developer-Summit (2017)
bd808 added a comment to T157766: webservice for tool.spiarticleanalyzer: 404 Error.

Also, to note, I tried the following:

source $HOME/www/python/virtualenv/bin/activate (activating virtualenv)

Fri, Feb 10, 5:00 AM · Tool-Labs-tools-Other
bd808 edited projects for T157767: Issues related to tool.spiarticleanalyzer, added: Tool-Labs-tools-Other; removed Tool-Labs, Labs.
Fri, Feb 10, 4:18 AM · Tool-Labs-tools-Other, Tracking
bd808 edited projects for T157766: webservice for tool.spiarticleanalyzer: 404 Error, added: Tool-Labs-tools-Other; removed Labs, Tool-Labs.

Do you have your code in ~/www/python/src? Have you checked for error logs?

Fri, Feb 10, 4:17 AM · Tool-Labs-tools-Other
bd808 added a comment to T157399: Archive/delete tool morebots.

Can we migrate those to stashbot?

Fri, Feb 10, 4:01 AM · Tool-Labs-tools-Morebots-archived, Stashbot, Labs, Tool-Labs

Thu, Feb 9

bd808 removed a project from T157749: Delete tool "contributions-summary": Tracking.
Thu, Feb 9, 10:54 PM · Labs, Tool-Labs
bd808 added a comment to T157749: Delete tool "contributions-summary".

I shutdown the webservice.

Thu, Feb 9, 10:54 PM · Labs, Tool-Labs
bd808 added a comment to T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes .

The fundamental design of the getAllUser.py workflow is going to be difficult to scale for multiple concurrent users on tools.wmflabs.org. I would recommend looking in to using a javascript library and the map tile servers that Wikimedia maintains. See https://www.mediawiki.org/wiki/Maps for more information.

Thu, Feb 9, 10:46 PM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
bd808 added a comment to T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes .
  • Are these C libaries, Python packages, or something else? Providing links to the upstream projects would help.
  • What specific runtime environment do you need them in (job grid, kubernetes)?
  • Is this for a project that already works I can view the source of or demo somewhere or a speculative installation to support future work?
Thu, Feb 9, 10:33 PM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other
bd808 created T157733: Create developer environment using Docker images from Tool Labs Kubernetes.
Thu, Feb 9, 9:11 PM · Tool-Labs, Labs
bd808 added a comment to T156174: Rewrite /usr/local/bin/crontab in python; fix bugs.

@zhuyifei1999 Looks like a good start. I think we should move the script from Puppet to https://gerrit.wikimedia.org/r/#/admin/projects/labs/toollabs and make the change in Puppet to populate /etc/toollabs-cronhost (name can be bikesheded). Do you want to take a shot at the patches for that?

Thu, Feb 9, 7:44 PM · Patch-For-Review, Tool-Labs, Labs