Page MenuHomePhabricator

Amitie_10g (Amitie 10g)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 21 2015, 8:05 PM (177 w, 5 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Amitie 10g [ Global Accounts ]

Active member of the Spanish Wikipedia.
Patroller, Rollbacker, File mover and License reviewer at Wikimedia Commons.

Recent Activity

Jan 25 2019

Amitie_10g closed T212620: When starting webservice, ConfigParser.NoSectionError: No section: 'Default' as Resolved.

Resolved, but I think this behaviour should not happen.

Jan 25 2019, 11:28 AM · Toolforge

Dec 30 2018

Amitie_10g edited P7942 deployment file generated for webarchivebot.
Dec 30 2018, 11:21 PM
Amitie_10g edited P7942 deployment file generated for webarchivebot.
Dec 30 2018, 11:15 PM

Dec 29 2018

Amitie_10g edited P7942 deployment file generated for webarchivebot.
Dec 29 2018, 2:37 PM
Amitie_10g edited P7942 deployment file generated for webarchivebot.
Dec 29 2018, 2:06 PM
Amitie_10g edited P7942 deployment file generated for webarchivebot.
Dec 29 2018, 2:48 AM

Dec 28 2018

Amitie_10g edited P7942 deployment file generated for webarchivebot.
Dec 28 2018, 2:35 AM
Amitie_10g created P7942 deployment file generated for webarchivebot.
Dec 28 2018, 1:51 AM

Dec 27 2018

Amitie_10g added a comment to T212620: When starting webservice, ConfigParser.NoSectionError: No section: 'Default'.

@Amitie_10g Do you have a ~/.webservicerc file?

Dec 27 2018, 11:55 PM · Toolforge

Aug 4 2018

Amitie_10g created T201242: Content Translation tool locks pages already in translation by other users.
Aug 4 2018, 5:37 PM · ContentTranslation

Jun 1 2018

Amitie_10g added a comment to T189634: block expiry too long cause mediawiki crash.

Mmm, then, anything where the DB field is Timestamp in the MediaWiki function may be hardcoded to reject any value greater than 2147483647 (January 19, 3038), and send the proper message to the browser, until the Y2K38 problem is fixed in both HHVM and MariaDB.

Jun 1 2018, 2:10 PM · MediaWiki-User-management, MediaWiki-Special-pages

May 31 2018

Amitie_10g added a comment to T189634: block expiry too long cause mediawiki crash.

As I know, the limit for the current UNIX Timestamp implementation is ca. 2038 (as the Timestamp value is a 14 digit, signed 32-bit Integer), and this issue is related to PHP/HHVM and MySQL/MariaDB rather than MediaWiki.

May 31 2018, 12:51 PM · MediaWiki-User-management, MediaWiki-Special-pages

May 30 2018

Amitie_10g created T196006: toolforge: sqlite3 not found in the Grid engine.
May 30 2018, 7:32 PM · Patch-For-Review, Toolforge

May 2 2017

Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

My request at GitHub has been answered: The HHVM developers don't have plans to add support for more than one index file. However, Pull requests are welcome.

May 2 2017, 11:30 PM · Cloud-Services, Toolforge

May 1 2017

Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

I'll document that tomorrow.

A good way to get debug information is using the logs, that I'll add to the configuration file. Also, should be a good idea to try HHVM in Daemon instead of the default Server mode (wich uses a PID file, and declaring the logs path is required. Just for experimenting.

Running HHVM in demon mode is actually a bad idea. I had to clean up about 17 orphaned HHVM process that were started from your tool and the one I was testing from that were in demon mode on various job grid hosts. Processes running on the job grid should stay in the foreground. When they demonize they get "lost" and are not cleaned up when webservice stop is run.

May 1 2017, 4:34 AM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

I'll document that tomorrow.

May 1 2017, 4:06 AM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

For the record, I'm currently running the WebArchiveBOT's Web service as generic web service using the script provided by@bd808 since several hours ago.

May 1 2017, 3:56 AM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

As HHVM in Proxygen mode worked properly, do you think is appropriate to document that at Wikitech as an experimental deployment (until the became official)? Also keep in mind my but report at GitHub.

May 1 2017, 3:36 AM · Cloud-Services, Toolforge

Apr 30 2017

Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

I attempted to use Repo Authoritative by adding the following to hhvm-webservice.sh:

hhvm.repo.authoritative=true
hhvm.repo.central.path=${HOME}/hhvm.hhbc

As @ori wrote upstream in https://github.com/facebook/hhvm/issues/6878, RepoAuth mode is difficult to get right. A tool would have to be very, very active before dealing with the complexity of RepoAuth would be remotely worth while. I'm not going to work on integrating it with webservice.

Apr 30 2017, 10:04 PM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

I attempted to use Repo Authoritative by adding the following to hhvm-webservice.sh:

Apr 30 2017, 9:20 PM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

I spent some time exploring running HHVM in proxygen mode using webservice generic and a bootstrapping script that generates an HHVM ini file and starts HHVM in server mode. This does make a working webservice, but it has several drawbacks:

  • Documentation for configuring HHVM's proxygen webserver is lacking upstream. Information can be found, but it requires a lot of digging.
  • No obvious support for alias configuration to easily map https://tools.wmflabs.org/my-tool-name/ to the tool's $HOME/public_html. This can be worked around using hhvm.virtual_host[default][rewrite_rules] settings.
  • No obvious way to do multi-view indexing as noted by @Amitie_10g in T164161#3224126

    My experiments show that using proxygen mode is certainly possible, but based on the lack of documentation and that we don't use it in WMF production I would recommend against it for the average Tool Labs user. I will be looking more closely at fcgi mode configuration for integration with webservice.

    For those who are curious, here's the script that I came up with to generate an appropriate configuration file and start the HHVM service using `webservice --backend=gridengine generic start ${HOME}/hhvm-webservice.sh:
hhvm-webservice.sh
#!/usr/bin/env bash
# Run an HHVM webservice
#
# usage: webservice --backend=gridengine generic start hhvm-webservice.sh
set -e

TOOLNAME=${USER#tools.}

if [[ -z $PORT ]]; then
  echo "PORT environment variable not set." >&2
  echo "usage: webservice --backend=gridengine generic start $0" >&2
  exit 1
fi

/bin/cat << EOF > ${HOME}/server.ini
date.timezone = UTC
hhvm.enable_obj_destruct_call = true
hhvm.enable_zend_compat = true
hhvm.error_handling.call_user_handler_on_fatals = true
hhvm.hack.lang.iconv_ignore_correct = true
hhvm.jit = true
hhvm.log.always_log_unhandled_exceptions = true
hhvm.log.level = Warning
hhvm.log.native_stack_trace = false
hhvm.log.runtime_error_reporting_level = HPHP_ALL
hhvm.log.use_log_file = true
hhvm.log.use_syslog = false
hhvm.pcre_cache_type = lru
hhvm.pid_file =
hhvm.repo.central.path = /tmp/hhvm-${TOOLNAME}.hhbc
hhvm.server.apc.expire_on_sets = true
hhvm.server.apc.expire_on_sets = true
hhvm.server.apc.purge_frequency = 4096
hhvm.server.apc.table_type = concurrent
hhvm.server.apc.ttl_limit = 172800
hhvm.server.default_document = index.php
hhvm.server.dns_cache.enable = true
hhvm.server.dns_cache.ttl = 300
hhvm.server.exit_on_bind_fail = true
hhvm.server.port = ${PORT}
hhvm.server.source_root = ${HOME}/public_html
hhvm.server.stat_cache = true
hhvm.server.thread_count = 4
hhvm.server.type = proxygen
hhvm.virtual_host[default][rewrite_rules][0][pattern] = "^/${TOOLNAME}(.*)\$"
hhvm.virtual_host[default][rewrite_rules][0][qsa] = true
hhvm.virtual_host[default][rewrite_rules][0][to] = "\$1"
max_execution_time = 60
memory_limit = 128M
EOF

exec /usr/bin/hhvm -m server -c ${HOME}/server.ini -c ${HOME}/hhvm.ini

Well, I'm running my tool with the generic webserver you provided and works perfectly. I only need to tweak the links to point to the right index.html at the /doc.

Apr 30 2017, 8:42 PM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

I'm trying to run HHVM in Proxygen mode inside my tool account and I opened the page successfully. Following is the way to run HHVM:

Apr 30 2017, 6:33 AM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

HHVM in Proxygen mode supports only numbered ports. Then, a Kubernetes container can run two instances of HHVM in Proxygen mode, listening the ports 80 and 443. Then, nginx proxy forwards the traffic originated to https://tools.wmflabs.org/**webarchivebot** to the HHVMs instances running inside the WebArchiveBOT's Kubernetes container. Everything (enabling SSL and setting the certificates paths) should be declared in the command line,or in the configuration file.

Only one backend instance of the HHVM proxygen (or fcgi) server is needed. HTTPS requests are handled by the Tool Labs nginx proxy which has the proper SSL certificates. Requests from the nginx proxy to each tool's webservice are done via plain HTTP across the Labs network segment. An X-Forwarded-Proto header is added to requests sent through the proxy to ecah webservice so that the webservice can determine the protocol in use by the client.

Apr 30 2017, 5:38 AM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

If we try proxygen mode, the webservice backend will need to provide a way for the user to provide configuration settings for the HHVM process in some per-tool config file. This would be needed for things like setting up rewrite rules for tools that use a dispatcher script.

Apr 30 2017, 4:26 AM · Cloud-Services, Toolforge
Amitie_10g added a comment to T164161: Add HHVM backend for webservice.

As the user who is interested in this, I have some question that has been not answered at the IRC. Based in my knlwledge, I see the following situations:

Apr 30 2017, 4:21 AM · Cloud-Services, Toolforge

Apr 19 2017

Amitie_10g added a comment to T163340: Judy PECL module not available in Tool labs, need to install it.

After trying to install from bastion to an alternative php_dir, I got phpize missing, and php5-dev is required for that.

Apr 19 2017, 5:52 PM · Cloud-Services, Toolforge
Amitie_10g added a comment to T163340: Judy PECL module not available in Tool labs, need to install it.

Yes, there is not php5-judy, and it is only available from PECL. When I trying to install judy from PECL (in bastion), the following error appears:

$ pecl install judy
Cannot install, php_dir for channel "pecl.php.net" is not writeable by the current user

that means I don't have permission to install it (at least from bastion), and I don't know if using an alternative php_dir will work at the bastion and the grid.

Apr 19 2017, 5:39 PM · Cloud-Services, Toolforge
Amitie_10g created T163340: Judy PECL module not available in Tool labs, need to install it.
Apr 19 2017, 3:39 PM · Cloud-Services, Toolforge

Aug 2 2016

Amitie_10g added a comment to T111815: SVG files larger than 10 MB cannot be thumbnailed.

I ran a bot and got a (huge) list of files SVGs > 10 MB (more than 8000 ones). I'll post the list soon, so, I don't have the time to see every file for rendering errors, so, please take it.

Aug 2 2016, 9:19 PM · User-notice, Operations, Commons, Wikimedia-SVG-rendering

Jun 22 2016

Amitie_10g added a comment to T111815: SVG files larger than 10 MB cannot be thumbnailed.

I see the files that {{HugeSVG}} ins transcluded, but them're still unable to render as PNG.

Jun 22 2016, 4:44 PM · User-notice, Operations, Commons, Wikimedia-SVG-rendering

Apr 10 2016

Amitie_10g added a comment to T111815: SVG files larger than 10 MB cannot be thumbnailed.

Meanwhile the bug is resolved (or scheduled for resolving), could be a good idea to add {{HugeSVG}} at the Description in the Upload Wizard.

Apr 10 2016, 1:44 AM · User-notice, Operations, Commons, Wikimedia-SVG-rendering

Oct 29 2015

Amitie_10g added a comment to T20871: Include at least some EXIF metadata in resized pictures.

According to this thread at the Commons Village Pump, the Community is urged that this issue should be corrected as soon as possible. T111722 is another recent issue that request the preserving, at least, the Copyright information in Exif metadata.

Oct 29 2015, 7:37 PM · Patch-For-Review, WMF-Legal, Commons, Multimedia, MediaWiki-File-management