tom29739 (tom29739)
Worker

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Feb 1 2016, 6:51 PM (59 w, 4 d)
Availability
Available
IRC Nick
tom29739
LDAP User
Tom29739
MediaWiki User
Tom29739

Hello. :)

Recent Activity

Tue, Mar 21

tom29739 added a comment to T138464: Single Image Batch Upload.

@tom29739: That would be wonderful, would it be a good idea to have a small chat on IRC this evening or tomorrow to discuss how we see the project and some next steps?

Tue, Mar 21, 11:33 PM · Single-Image-Batch-Upload, Outreachy (Round-14), Google-Summer-of-Code (2017), Outreach-Programs-Projects, Commons, Possible-Tech-Projects, Wikimania-Hackathon-2016
tom29739 added a comment to T138464: Single Image Batch Upload.

I can help with this project. I have experience in Python for software development, and I maintain a few tools on Tool Labs. I've also used Wikimedia's OAuth in one of my tools.

Tue, Mar 21, 12:04 AM · Single-Image-Batch-Upload, Outreachy (Round-14), Google-Summer-of-Code (2017), Outreach-Programs-Projects, Commons, Possible-Tech-Projects, Wikimania-Hackathon-2016

Wed, Mar 15

tom29739 added a comment to T157838: Move wm-bot instance to Trusty.

The easiest and safest solution would probably be using something like Bucardo (live migration tutorial).

Wed, Mar 15, 5:25 PM · Labs, WM-Bot

Thu, Feb 23

tom29739 added a comment to T158704: Wikibugs always points to the creation of the task.

It only happens sometimes, for example this message a few hours before the task in the description links to the correct task:
<wikibugs> Labs, Tool-Labs, Tool-Labs-tools-Database-Queries: nlwiki Labs replica with problems - https://phabricator.wikimedia.org/T138927#3043967 (Sjoerddebruin) Resolved>Open It shouldn't be that this page and two **privacy violations** keep appearing on pages as https://tools.wmflabs.org/wikidata-to...

Thu, Feb 23, 9:51 AM · Wikibugs

Feb 14 2017

tom29739 added a comment to T157744: tools.spiarticleanalyzer: requesting installation of icu on bastion and kubernetes .

PyICU requires the underlying C++ library to work, and this is in the libicu52 apt package on Debian Jessie. When this is installed, PyICU can then be installed in a virtualenv. Alternatively, the python-pyicu apt package can be installed, which installs PyICU and the underlying C++ library systemwide. One of the above packages would need to be installed in the python 2 Docker image to be used in Kubernetes containers.

Feb 14 2017, 3:06 PM · User-bd808, Tools-Kubernetes, Tool-Labs-tools-Other

Jan 12 2017

tom29739 added a comment to T155063: Create Updated NodeJS container for Tool Labs.

The current version that is on Tool Labs, v0.10.25, was made end of life over 3 months ago. This means that it's a security risk.

Jan 12 2017, 12:00 AM · Tool-Labs, Labs

Jan 4 2017

tom29739 added a comment to T154551: Investigation: Plan for rewriting XTools.

The rebirth code is written using the Symfony framework: http://symfony.com/. I opted to use the framework because it is very similar to Ruby on Rails, with regard to the Model-View-Controller scheme. Also, it includes caching and profiling out of the box.

Jan 4 2017, 9:00 PM · Community-Tech, Tool-Labs-tools-Xtools

Dec 17 2016

GitHub <noreply@github.com> committed R1934:47ddd66dcf92: Add packagecloud badge. (authored by tom29739).
Add packagecloud badge.
Dec 17 2016, 2:54 AM

Dec 4 2016

tom29739 added a comment to T137146: Disable xdebug on Tool Labs.

@scfc: I ran the tests and reported back in T137146#2388908. I found that while xdebug slowed down the requests by a small amount, it was NFS that slowed down the requests the most.

Dec 4 2016, 8:59 PM · Labs, Tool-Labs

Nov 24 2016

tom29739 added a comment to T143939: Request creation of labs-vpn labs project.

To recap some of the arguments from #wikimedia-labs:

  • ProxyCommand is complex for windows users; a VPN would allow a much more user-friendly connection (directly connecting to e.g. tools-exec-1201.eqiad.wmflabs from putty) […]

Is the configuration really that complex? https://wikitech.wikimedia.org/wiki/Help:Access_to_instances_with_PuTTY_and_WinSCP#How_to_set_up_PuTTY_for_proxying_through_bastion.wmflabs.org_to_your_instance looks tedious to repeat for every instance, but fairly simple.

Nov 24 2016, 8:18 PM · Labs

Nov 11 2016

tom29739 added a comment to T143449: Install libenchant1c2a in the toollabs-python2-base docker image.

The interim solution of using a compiled wheel of pyenchant no longer works because the wheel at http://tools-docker-builder-01.eqiad.wmflabs/pyenchant-1.6.7-py2.py3.cp27.cp32.cp33.cp34.cp35.pp27.pp33-none-any.whl has been taken down. Having the enchant C library (libenchant1c2a) installed in the image would remove the need for the wheel to be compiled and hosted.

Nov 11 2016, 6:12 PM · Patch-For-Review, Tool-Labs, Labs, Tools-Kubernetes

Nov 2 2016

tom29739 added a comment to T136265: Develop evaluation criteria for comparing Platform as a Service (PaaS) solutions.

Being able to use custom Docker images would be extremely helpful, because it removes the need to have to compile source or find binaries and/or ask for packages to be installed.

Nov 2 2016, 10:16 PM · Community-Tech-Tool-Labs, Tools-Kubernetes, Labs, Tool-Labs

Oct 23 2016

tom29739 added a member for Tool-Labs-tools-Zppixbot: tom29739.
Oct 23 2016, 9:41 PM

Oct 1 2016

tom29739 awarded T147051: Provide at least 2 separate service endpoints: one for slow, long running queries; and another for quick, web requests a Mountain of Wealth token.
Oct 1 2016, 12:47 PM · Patch-For-Review, DBA, Labs-Infrastructure, Labs

Sep 17 2016

tom29739 added a comment to T145907: Use .wiki domains instead of .org on wiki sites owned by wikimedia foundation.

Why not just redirect the .wiki domains to the .org domains?

Sep 17 2016, 12:32 PM · Traffic, WMF-Legal, Domains, Operations

Sep 9 2016

tom29739 renamed T145130: Gerrit in Microsoft Edge doesn't display the git commands in the download box from "Microsoft Edge in gerrit dosent display the git commands in the download box" to "Gerrit in Microsoft Edge doesn't display the git commands in the download box".
Sep 9 2016, 12:26 AM · Upstream, Patch-For-Review, Gerrit

Sep 5 2016

tom29739 edited Description on privpol-captcha.
Sep 5 2016, 8:22 PM
tom29739 edited Description on privpol-captcha.
Sep 5 2016, 8:22 PM

Aug 26 2016

tom29739 added a comment to T127367: Overhaul logging setup for Tools (Tracking).

Graylog (https://github.com/graylog2/graylog2-server, https://www.graylog.org/) seems to cover most of these points:

  1. Take load off NFS - logs are stored on an Elasticsearch cluster
  2. Make it far faster to see the actual logs from processes - doesn't depend on NFS, so should be fast
  3. Be able to search through logs easier - searching is easy: http://docs.graylog.org/en/2.0/pages/queries.html, "The search syntax is very close to the Lucene syntax. By default all message fields are included in the search if you don’t specify a message field to search in."
  4. Automatically drop older logs - index rotation can be configured based on message count, index size, or index time: http://docs.graylog.org/en/2.0/pages/index_model.html#eviction-of-indices-and-messages
  5. Provide a Filesystem based interface for log ingress - Graylog supports this: http://docs.graylog.org/en/2.0/pages/sending_data.html#reading-from-files, "we provide the Collector Sidecar which acts as a supervisor process for other programs, such as nxlog and Filebeats, which have specifically been built to collect log messages from local files and ship them to remote systems like Graylog."
  6. Provide more standard and modern interfaces (gelf? etc) for log ingress - Graylog supports GELF and syslog: http://docs.graylog.org/en/2.0/pages/sending_data.html
  7. Provide a filesystem based interface for log reading - I don't think this is supported, but you can export search results to CSV: http://docs.graylog.org/en/2.0/pages/queries.html#export-results-as-csv
  8. Provide a more modern interface for log reading as well - Graylog's interface looks fairly modern and easy to use to me:
  9. Be secure in allowing only authenticated members to read a particular tool's logs. - Graylog has access control out-of-the-box, and can integrate with LDAP users and groups: http://docs.graylog.org/en/2.0/pages/users_and_roles/external_auth.html#ldap-active-directory

Graylog has Streams (basically categories for log messages): http://docs.graylog.org/en/2.0/pages/streams.html, alerting based on those streams: http://docs.graylog.org/en/2.0/pages/getting_started/stream_alerts.html, and dashboards: http://docs.graylog.org/en/2.0/pages/dashboards.html.

Aug 26 2016, 6:04 PM · Tracking, Labs, Tool-Labs
tom29739 added a comment to T143939: Request creation of labs-vpn labs project.

Doesn't the ssh of Cygwin / MinGW / MSYS (not an expert here) work?

Aug 26 2016, 1:02 PM · Labs

Aug 25 2016

tom29739 added a comment to T143939: Request creation of labs-vpn labs project.

OpenVPN server can be configured to only provide routes to certain IP ranges/hosts

Aug 25 2016, 10:41 PM · Labs
tom29739 added a comment to T143939: Request creation of labs-vpn labs project.

Sane configuration, not allowing traffic through labs (e.g. user -> labs -> google)

Note that it is possible to configure openvpn so it only provides routes to a subrange (ie. labs hosts). It could be blocked anyway¹ but that would require the user misconfigurating his routes.

¹ Not sure if it is worth it, since labs users already can access the internet through their instances.

Aug 25 2016, 10:38 PM · Labs
tom29739 added a comment to T143939: Request creation of labs-vpn labs project.

You'd need labsdb/wmnet for database replica access. I'm not quite sure how DNS would work actually - the client would need to be able to resolve these, but then all their own DNS lookups would be going through labs?

Aug 25 2016, 10:34 PM · Labs
tom29739 added a comment to T143939: Request creation of labs-vpn labs project.

OpenVPN

Aug 25 2016, 10:19 PM · Labs
tom29739 edited the description of T143939: Request creation of labs-vpn labs project.
Aug 25 2016, 9:52 PM · Labs
tom29739 edited the description of T143939: Request creation of labs-vpn labs project.
Aug 25 2016, 9:45 PM · Labs
tom29739 created T143939: Request creation of labs-vpn labs project.
Aug 25 2016, 9:40 PM · Labs

Aug 24 2016

tom29739 awarded T136256: Deploy "Striker" Tool Labs console to WMF production a Baby Tequila token.
Aug 24 2016, 8:11 PM · User-bd808, Patch-For-Review, Striker, Community-Tech-Tool-Labs, Tool-Labs, Labs

Aug 19 2016

tom29739 created T143449: Install libenchant1c2a in the toollabs-python2-base docker image.
Aug 19 2016, 8:33 PM · Patch-For-Review, Tool-Labs, Labs, Tools-Kubernetes

Aug 12 2016

tom29739 renamed T142877: Request increased quota for contintcloud labs project from "Request increased quota for <Replace Me> labs project" to "Request increased quota for contintcloud labs project".
Aug 12 2016, 10:34 PM · Continuous-Integration-Infrastructure, Labs

Aug 8 2016

tom29739 added a comment to T142166: Create a new labs flavor available to all project: largedisk.

But Horizon tells you how much RAM/CPU/storage that flavour gives the instance when you pick the flavour on there

Aug 8 2016, 11:42 PM · Labs, Labs-Infrastructure

Aug 5 2016

tom29739 renamed T142253: Update npm to 2.x on tools from "Update npm to 2.x on lolrrit-wm" to "Update npm to 2.x on tools".
Aug 5 2016, 8:00 PM · Tool-Labs, grrrit-wm, Labs

Aug 4 2016

tom29739 added a comment to T140592: About 71 users are missing replica.my.cnf.

I have a replica.my.cnf in my home dir that was created in January 2016. There has been far more than 6 new users on Tool Labs so far this year.

Aug 4 2016, 9:50 PM · Tool-Labs, Labs
tom29739 edited the description of T131796: Convert most top level tool and bastion dns records to CNAMEs.
Aug 4 2016, 12:52 AM · Labs, Tool-Labs
tom29739 renamed T131796: Convert most top level tool and bastion dns records to CNAMEs from "Convert most top level tool and bastion dns redcords to CNAMEs" to "Convert most top level tool and bastion dns records to CNAMEs".
Aug 4 2016, 12:51 AM · Labs, Tool-Labs

Aug 1 2016

tom29739 edited the description of T76375: New Labs project requests (tracking).
Aug 1 2016, 7:17 PM · Tracking, Labs

Jul 26 2016

tom29739 added a comment to T140486: Potential ambiguities in the Labs Terms of Use.

Perhaps it would make sense to have a separate notice, given that the username isn't as confidential as say, an IP address or similar

Jul 26 2016, 12:57 AM · WMF-Legal, Labs
tom29739 added a comment to T140486: Potential ambiguities in the Labs Terms of Use.

Ok in that case, going back to the second question - while a username might not be categorized as private information like IP addresses and passwords per se, should we still treat them with sensitivity in some cases since users might want to keep their association with particular tools confidential? That is even if we don't categorize usernames as information that must be purged or anonymized after 30 days, is this information still sensitive enough to warrant warning the user about the possibility of disclosure as covered in the current "If my tools collect Private Information..." disclaimer notice?

Jul 26 2016, 12:55 AM · WMF-Legal, Labs
tom29739 added a comment to T140486: Potential ambiguities in the Labs Terms of Use.

I don't think that's the case. The user using OAuth via a tool will have their username disclosed to the tool though (subject to the usual private info restrictions at present).

Additionally, can someone clarify this statement:

A tool that edit on a user's behalf via OAuth automatically disclose the username to MediaWiki revision table, thus publicly and permanently storing "This username has used this tool", and there's no way for the tool at all to change that fact.

The tool used by a particular user, via OAuth, are publicly available information? If so, is this desired behavior (e.g. are there circumstance where a user might not want that fact they are using a tool to be disclosed)?

Jul 26 2016, 12:41 AM · WMF-Legal, Labs

Jul 25 2016

tom29739 updated the image for Striker from F4294828: profile to F4305628: profile.
Jul 25 2016, 1:25 PM

Jul 22 2016

tom29739 added a subtask for T139107: Issues with 'webservice' kubernetes backend (tracking): T141098: Kubernetes does not mount shared path.
Jul 22 2016, 2:12 PM · Tracking, Tool-Labs, Tools-Kubernetes, Labs
tom29739 added a parent task for T141098: Kubernetes does not mount shared path: T139107: Issues with 'webservice' kubernetes backend (tracking).
Jul 22 2016, 2:12 PM · Tools-Kubernetes
tom29739 added a project to T139107: Issues with 'webservice' kubernetes backend (tracking): Tracking.
Jul 22 2016, 2:12 PM · Tracking, Tool-Labs, Tools-Kubernetes, Labs
tom29739 added a parent task for T141082: Install jq, sed, grep, sort in k8s images: T141041: Odd kubernetes error.
Jul 22 2016, 10:12 AM · Tool-Labs, Labs, Tools-Kubernetes
tom29739 added a subtask for T141041: Odd kubernetes error: T141082: Install jq, sed, grep, sort in k8s images.
Jul 22 2016, 10:12 AM · Tools-Kubernetes
tom29739 edited the description of T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking).
Jul 22 2016, 10:06 AM · Tracking, Tool-Labs, Tools-Kubernetes, Labs
tom29739 removed a project from T141082: Install jq, sed, grep, sort in k8s images: Tracking.
Jul 22 2016, 10:04 AM · Tool-Labs, Labs, Tools-Kubernetes
tom29739 added a comment to T141041: Odd kubernetes error.

@Magnus: T140110: Packages to be installed in Tool Labs Kubernetes Images (Tracking) is the tracking task for packages to be installed in Kubernetes containers. You'll need to create a subtask of that.

Jul 22 2016, 9:57 AM · Tools-Kubernetes

Jul 20 2016

tom29739 added a comment to T121279: Figure out a way to keep MerlBot running when the HTTP POST loophole is closed.

Java 1.8 is supported on Kubernetes in Tool Labs. If the SGE scripts could be converted or replaced with Kubernetes equivalents, then MerlBot could probably run on that. I recall that not being able to use Java 1.8 was a blocker in getting MerlBot to use HTTPS because it could not use an updated version of a library or additional features provided in Java 1.8 (I might be remembering this wrong. Probably)

Jul 20 2016, 5:08 PM · Labs, Tool-Labs

Jul 19 2016

tom29739 added a comment to T115231: dplbot webservice on Tools Labs fails repeatedly.

Works for me.

Jul 19 2016, 5:35 PM · Labs, Tool-Labs
tom29739 added a comment to T140486: Potential ambiguities in the Labs Terms of Use.

IMHO, username shouldn't be private information. Rather, the association of a username and other private information (IP address, User agent) should be private.

Jul 19 2016, 12:01 PM · WMF-Legal, Labs
tom29739 added a comment to T140486: Potential ambiguities in the Labs Terms of Use.

Quarry would be non compliant because the ToU classes usernames as private information. The ToU states that you *must* show this disclaimer before collecting the private information (in this case the username):

By using this project, you agree that any private information you give to this project may be made publicly available and not be treated as confidential.
By using this project, you agree that the volunteer administrators of this project will have access to any data you submit. This can include your IP address, your username/password combination for accounts created in Labs services, and any other information that you send. The volunteer administrators of this project are bound by the Wikimedia Labs Terms of Use, and are not allowed to share this information or use it in any non-approved way.
Since access to this information is fundamental to the operation of Wikimedia Labs, these terms regarding use of your data expressly override the Wikimedia Foundation's Privacy Policy as it relates to the use and access of your personal information.

Jul 19 2016, 12:23 AM · WMF-Legal, Labs

Jul 15 2016

tom29739 created T140486: Potential ambiguities in the Labs Terms of Use.
Jul 15 2016, 6:01 PM · WMF-Legal, Labs

Jul 12 2016

tom29739 added a comment to T140103: Needing help running the webservice for a simple flask application.

@Dalba

tools.piagetbot@tools-bastion-03:~$ virtualenv ~/venv -p /usr/bin/python3
Running virtualenv with interpreter /usr/bin/python3
Using base prefix '/usr'
New python executable in /data/project/piagetbot/venv/bin/python3
Also creating executable in /data/project/piagetbot/venv/bin/python
Installing setuptools, pip...done.

(of course replace the "~/venv" with the directory you want the virtualenv to go)

Jul 12 2016, 3:28 PM · Tool-Labs, Labs

Jul 11 2016

Cosine02 awarded T139264: wm-bot is not responding to any messages a Like token.
Jul 11 2016, 9:53 AM · Labs, WM-Bot

Jul 5 2016

tom29739 added a comment to T100526: Investigate why Joe is default editor on toollabs.
tom29739@tools-bastion-03:~$ update-alternatives --config editor
There are 12 choices for the alternative editor (providing /usr/bin/editor).
Jul 5 2016, 5:31 PM · Patch-For-Review, Labs, Tool-Labs
tom29739 added a comment to T100526: Investigate why Joe is default editor on toollabs.

Just typing editor in a shell prompt brings up joe, which on further investigation:

tom29739@tools-bastion-03:~$ type editor
editor is /usr/bin/editor
tom29739@tools-bastion-03:~$ file /usr/bin/editor
/usr/bin/editor: symbolic link to `/etc/alternatives/editor'
tom29739@tools-bastion-03:~$ file /etc/alternatives/editor
/etc/alternatives/editor: symbolic link to `/usr/bin/joe'
Jul 5 2016, 2:51 PM · Patch-For-Review, Labs, Tool-Labs

Jul 4 2016

tom29739 added a comment to T139264: wm-bot is not responding to any messages.

I think it's that.

Jul 4 2016, 2:10 PM · Labs, WM-Bot
tom29739 added a comment to T139264: wm-bot is not responding to any messages.

That's weird. It should be back on then...

Jul 4 2016, 11:53 AM · Labs, WM-Bot
tom29739 added a comment to T139264: wm-bot is not responding to any messages.

It doesn't appear to be working. It's not on IRC, so I'd assume it's not working. @yuvipanda did you delete the pid files when you tried to get it working? It crashed last time, so those files need to be removed.

sudo rm -iv /mnt/share/wm-bot/*.pid

Should do that according to the docs.

Jul 4 2016, 11:51 AM · Labs, WM-Bot
tom29739 added a comment to T139264: wm-bot is not responding to any messages.

Or alternatively wait for one of the bot's roots to come along, but that
might take a while.

Jul 4 2016, 11:02 AM · Labs, WM-Bot

Jul 3 2016

tom29739 created T139264: wm-bot is not responding to any messages.
Jul 3 2016, 1:37 PM · Labs, WM-Bot

Jul 1 2016

tom29739 edited the description of T139162: Query runs over 5 hours without being killed.
Jul 1 2016, 2:11 PM · Quarry

Jun 28 2016

tom29739 added a comment to T136712: Virtualenvs slow on tool labs NFS.

On running strace for pip -V (which took about 20s), I get:

$ strace -o /tmp/pip-strace-counts -f -c pip -V
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
 73.62    1.648355         350      4716      4158 open
 24.50    0.548619         248      2209      2018 stat
  0.45    0.010146         122        83         4 lstat
  0.29    0.006464        3232         2           wait4
  0.17    0.003729           5       728           read
  0.16    0.003644           6       580           close
  0.16    0.003563         210        17           openat 
  0.12    0.002582          70        37        21 access
  0.09    0.002057           5       381           mmap
  0.08    0.001770          89        20           write
  0.07    0.001568           2       882           fstat
  0.07    0.001514           6       275           munmap
  0.06    0.001412         282         5         2 readlink
  0.06    0.001251          15        82           rt_sigaction
  0.04    0.000898          26        34           getdents
  0.02    0.000530           9        56           mprotect
  0.01    0.000307           7        42           brk
  0.00    0.000099          25         4           execve
  0.00    0.000096          16         6         1 ioctl
  0.00    0.000052          13         4           arch_prctl
  0.00    0.000044          22         2           set_robust_list
  0.00    0.000039          13         3           dup2
  0.00    0.000034          17         2           geteuid
  0.00    0.000028          14         2           getpid
  0.00    0.000026          13         2           getppid
  0.00    0.000025           8         3           fcntl
  0.00    0.000021           5         4           uname
  0.00    0.000017           9         2           getrlimit
  0.00    0.000016           8         2         1 futex
Jun 28 2016, 2:16 PM · Labs, Tool-Labs
tom29739 added a comment to T136712: Virtualenvs slow on tool labs NFS.

Perhaps ulimits are causing it?

Jun 28 2016, 2:08 PM · Labs, Tool-Labs
tom29739 added a comment to T136712: Virtualenvs slow on tool labs NFS.

Indeed, or even a few months ago. The only significant thing I can think of as having changed since then is the NFS rate limiting, so I'd still like to maybe completely remove that and try testing this again to see if that's the cause.

Jun 28 2016, 7:53 AM · Labs, Tool-Labs
tom29739 added a comment to T136712: Virtualenvs slow on tool labs NFS.

NFS was much faster about 5-6 months ago, when I joined. It's having an impact on the speed of other things too (e.g. the speed of webservices, especially with PHP).

Jun 28 2016, 7:50 AM · Labs, Tool-Labs
tom29739 added a comment to T136712: Virtualenvs slow on tool labs NFS.

That's another set of results, but note that the version of pip on my tool is pip 1.5.4 when @zhuyifei1999's results were with pip 8.1.2, so this might cause a difference. Pip 1.5.4 appears to be the default version on tool labs (just tested with a new virtualenv with no packages)

It's more likely that I simply have too many packages required to run my tool :)

19s is still a long time when it's supposed to run for less than a second.

Jun 28 2016, 12:18 AM · Labs, Tool-Labs

Jun 27 2016

tom29739 added a comment to T136712: Virtualenvs slow on tool labs NFS.
(newsopel)tools.piagetbot@tools-bastion-03:~$ time pip -V
pip 1.5.4 from /data/project/piagetbot/.virtualenvs/newsopel/local/lib/python2.7/site-packages (python 2.7)
Jun 27 2016, 10:55 PM · Labs, Tool-Labs
tom29739 reopened T138787: tools-exec-1216 down as "Open".

@valhallasw looks like it's down again.

Jun 27 2016, 9:30 PM · Tool-Labs, Labs
tom29739 added a comment to T137924: Copy labmon data to new SSDs.

It looks like it's spewing out incorrect gzipped data, which the browser can't decode so it downloads it as a file instead.
Maybe the default DocumentRoot is in the wrong place so that the webserver is selecting the wrong file for the user's browser to interpret? That's the only plausible explanation that I can think of where setting the DocumentRoot would fix it.

Jun 27 2016, 6:06 PM · Patch-For-Review, Labs-Infrastructure, Labs
tom29739 added a comment to T137924: Copy labmon data to new SSDs.

@yuvipanda Chrome Version 51.0.2704.103 m (32 bit) on Windows 7. download.gz is 707 bytes from the https:// version. WinRAR can open it, there's a file named 'download' inside which is 677 bytes.

Jun 27 2016, 5:58 PM · Patch-For-Review, Labs-Infrastructure, Labs
tom29739 added a comment to T137924: Copy labmon data to new SSDs.

@yuvipanda neither 1. or 2. work for me, chrome tries to download a file called 'download.gz'. Both work with curl.

Jun 27 2016, 5:50 PM · Patch-For-Review, Labs-Infrastructure, Labs
tom29739 added a comment to T138438: Initial puppet run failing for new instances in privpol-captcha.

@chasemp it just happens randomly, not every time but still often enough to get annoying. I don't think it's anything that I'm doing because Niharika was having the exact same issue on their project.

Jun 27 2016, 2:54 PM · Labs
tom29739 added a comment to T91162: RFC: Shadow namespaces.

A potential problem I foresee is different languages wanting to use the same page name. If wikis A, B and C all want to use page name X, then which wiki's content is used?

Jun 27 2016, 12:06 AM · Wikimedia-Developer-Summit (2017), ArchCom-Has-shepherd, RfC, ArchCom-RfC

Jun 22 2016

tom29739 added a project to T138438: Initial puppet run failing for new instances in privpol-captcha: Labs.
Jun 22 2016, 8:47 PM · Labs
tom29739 created T138438: Initial puppet run failing for new instances in privpol-captcha.
Jun 22 2016, 8:47 PM · Labs
tom29739 created T138417: Nova_Resource:Puppet.privpol-captcha.eqiad.wmflabs will not go away.
Jun 22 2016, 3:25 PM · Labs
tom29739 added a comment to T138373: wikitech: Tell people to log out and in again?.

I got really confused by this yesterday, nothing worked, because I didn't know about this.

Jun 22 2016, 12:09 PM · wikitech.wikimedia.org, Labs
tom29739 renamed T138138: Install debootstrap and fakechroot on tools from "Install debootstrap, fakechroot and fakeroot on tools" to "Install debootstrap and fakechroot on tools".
Jun 22 2016, 10:40 AM · Labs, Tool-Labs
tom29739 added a comment to T138138: Install debootstrap and fakechroot on tools.

My tools often need different packages to be installed, and sometimes these can be installed easily (binaries available to download) but often the only options for binaries is a custom apt repo, or compiling from source, which is very time consuming and doesn't always work. These packages would make it possible to make a chroot as a non root user, so packages can be installed inside the chroot with apt and can be used.

Jun 22 2016, 10:39 AM · Labs, Tool-Labs

Jun 21 2016

tom29739 created T138348: Create new labs project privpol-captcha.
Jun 21 2016, 8:15 PM · User-bd808, Labs, Tool-Labs
tom29739 closed T138097: Create new labs project tools-xdebug-testing as "Resolved".

No longer needed.

Jun 21 2016, 7:46 PM · Labs
tom29739 closed T138097: Create new labs project tools-xdebug-testing, a subtask of T76375: New Labs project requests (tracking), as "Resolved".
Jun 21 2016, 7:46 PM · Tracking, Labs
tom29739 closed T138097: Create new labs project tools-xdebug-testing, a subtask of T137146: Disable xdebug on Tool Labs, as "Resolved".
Jun 21 2016, 7:46 PM · Labs, Tool-Labs
tom29739 added a comment to T137146: Disable xdebug on Tool Labs.

That project is no longer needed.

Jun 21 2016, 7:45 PM · Labs, Tool-Labs

Jun 18 2016

tom29739 created T138138: Install debootstrap and fakechroot on tools.
Jun 18 2016, 12:40 PM · Labs, Tool-Labs

Jun 17 2016

tom29739 added a subtask for T137146: Disable xdebug on Tool Labs: T138097: Create new labs project tools-xdebug-testing.
Jun 17 2016, 6:16 PM · Labs, Tool-Labs
tom29739 added a parent task for T138097: Create new labs project tools-xdebug-testing: T137146: Disable xdebug on Tool Labs.
Jun 17 2016, 6:16 PM · Labs
tom29739 added a comment to T137146: Disable xdebug on Tool Labs.

I have requested a new labs project for testing the impact that xdebug has: T138097: Create new labs project tools-xdebug-testing

Jun 17 2016, 6:12 PM · Labs, Tool-Labs
tom29739 added a parent task for T138097: Create new labs project tools-xdebug-testing: T137146: Disable xdebug on Tool Labs.
Jun 17 2016, 6:11 PM · Labs
tom29739 created T138097: Create new labs project tools-xdebug-testing.
Jun 17 2016, 5:12 PM · Labs
tom29739 claimed T137146: Disable xdebug on Tool Labs.

I discovered that NFS was a huge slowdown of all webservices, and that running a webservice in /tmp, I copied the files to the bastion /tmp and made a symlink, and it worked (strangely, lighttpd could access the bastion's /tmp, because there wasn't anything in the webserver host's /tmp when I checked).
Although NFS did slow down the webservice hugely, other factors (like xdebug) are still affecting the webservice. I'm going to assign myself this task and do some more testing to find out whether xdebug (and maybe other factors) make a difference in the speed of the webservice.

Jun 17 2016, 4:26 PM · Labs, Tool-Labs

Jun 16 2016

tom29739 edited the description of T137956: wmbot command for@seen should ignore trailing spaces after user name.
Jun 16 2016, 12:35 PM · WM-Bot
tom29739 edited the description of T137956: wmbot command for@seen should ignore trailing spaces after user name.
Jun 16 2016, 11:30 AM · WM-Bot

Jun 6 2016

tom29739 created T137146: Disable xdebug on Tool Labs.
Jun 6 2016, 8:07 PM · Labs, Tool-Labs

May 26 2016

tom29739 edited the description of T136335: Allow self-serve database credential and permissions management for Tool Labs projects.
May 26 2016, 10:52 PM · Labs, DBA, Tool-Labs
tom29739 edited the description of T136335: Allow self-serve database credential and permissions management for Tool Labs projects.
May 26 2016, 10:48 PM · Labs, DBA, Tool-Labs
tom29739 created T136335: Allow self-serve database credential and permissions management for Tool Labs projects.
May 26 2016, 5:20 PM · Labs, DBA, Tool-Labs
tom29739 added a comment to T136264: Evaluate Kubernetes based workflow replacement options for SGE.

There's Flynn and Dokku. Shipyard might be appropriate too.

We should only consider things that run on top of Kubernetes, IMO.

May 26 2016, 5:18 PM · Epic, Community-Tech-Tool-Labs, Tools-Kubernetes, Tool-Labs, Labs