Page MenuHomePhabricator

JeanFred (Jean-Frédéric)
Volunteer

Projects (7)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 6 2014, 10:01 PM (254 w, 2 d)
Availability
Available
IRC Nick
JeanFred
LDAP User
Jean-Frédéric
MediaWiki User
Jean-Frédéric [ Global Accounts ]

Developer of Tool-inteGraality. Maintainer of Tool-wikiloves and Wiki-Loves-Monuments

Recent Activity

Sat, Aug 17

Roy17 awarded T220474: UploadWizard requires description at least 5 characters long, does not work well in languages like Japanese or Korean a The World Burns token.
Sat, Aug 17, 3:53 PM · Multimedia, UploadWizard

Fri, Aug 16

JeanFred assigned T134617: Implement CSV/TSV import/export for tabular data set to TheDJ.
Fri, Aug 16, 9:36 PM · Wikimania-Hackathon-2019, Commons-Datasets
JeanFred added a comment to T134617: Implement CSV/TSV import/export for tabular data set.

Now a gadget at https://commons.wikimedia.org/wiki/MediaWiki:Gadget-TabularImportExport.js

Fri, Aug 16, 9:36 PM · Wikimania-Hackathon-2019, Commons-Datasets

Thu, Aug 15

JeanFred merged T202281: no jstop command available in a GridEngine job into T230562: jstop/jsub is not available on compute hosts.
Thu, Aug 15, 4:15 PM · Wikimania-Hackathon-2019, Toolforge
JeanFred merged task T202281: no jstop command available in a GridEngine job into T230562: jstop/jsub is not available on compute hosts.
Thu, Aug 15, 4:15 PM · cloud-services-team (Kanban), Wiki-Loves-Monuments-Database
JeanFred created T230562: jstop/jsub is not available on compute hosts.
Thu, Aug 15, 3:52 PM · Wikimania-Hackathon-2019, Toolforge

Sat, Aug 10

JeanFred created T230258: UploadWizard Flickr on Wikimedia Commons hangs, infinitely spins on 3 pictures.
Sat, Aug 10, 10:22 AM · Multimedia, UploadWizard

Mon, Jul 29

JeanFred committed R2566:04248f94e768: Add Ansible playbook for Toolforge deployment (authored by JeanFred).
Add Ansible playbook for Toolforge deployment
Mon, Jul 29, 11:49 AM

Jul 11 2019

Amire80 awarded T210951: Evaluate Indico as submission software for Wikimania a Like token.
Jul 11 2019, 4:04 PM · Events Team

Jul 8 2019

JeanFred committed R2566:ae16d683a9b4: Add flask as known-third-party in isort configuration (authored by JeanFred).
Add flask as known-third-party in isort configuration
Jul 8 2019, 1:54 AM
JeanFred committed R2566:728a8d2188d7: Fix directory excludes in tox configuration (authored by JeanFred).
Fix directory excludes in tox configuration
Jul 8 2019, 1:54 AM
JeanFred committed R2566:394be6a29cb4: Fix formatting warnings in test_pages_processor.py (authored by JeanFred).
Fix formatting warnings in test_pages_processor.py
Jul 8 2019, 1:54 AM
JeanFred committed R2566:d101ca1fe0f4: Remove unused variable in exception catching (authored by JeanFred).
Remove unused variable in exception catching
Jul 8 2019, 1:53 AM
JeanFred committed R2566:ab902279ac9c: Override edit summary for weekly update (authored by JeanFred).
Override edit summary for weekly update
Jul 8 2019, 1:53 AM
JeanFred committed R2566:5b4a1c639ca9: Move edit summary string as class attribute (authored by JeanFred).
Move edit summary string as class attribute
Jul 8 2019, 1:53 AM

Jul 6 2019

JeanFred added a comment to T219198: Wikimedia Hackathon 2019 volunteer group: Blog .

Even more belatedly, here is mine: https://commonists.wordpress.com/2019/07/06/the-story-of-integraality-or-my-quest-to-make-it-at-the-wikimedia-hackathon/

Jul 6 2019, 2:49 PM · International-Developer-Events, User-Jdlrobson, Developer-Advocacy (Apr-Jun 2019), Wikimedia-Hackathon-2019-Organization, Wikimedia-Hackathon-2019

Jun 14 2019

JeanFred edited projects for T217019: wikiloves - Incorrect usage of crontab in Toolforge, added: Tool-wikiloves; removed Tools.
Jun 14 2019, 6:12 PM · Tool-wikiloves

Jun 12 2019

JeanFred updated JeanFred.
Jun 12 2019, 8:10 AM

Jun 5 2019

JeanFred committed R1969:aabd6ec2b0b2: Update database query after schema changes (authored by JeanFred).
Update database query after schema changes
Jun 5 2019, 3:56 PM
JeanFred updated subscribers of T224862: Use img_actor when querying user id.

I think this is the most important announcement (although not the only one): https://lists.wikimedia.org/pipermail/cloud/2019-May/000653.html

Jun 5 2019, 3:31 PM · Data-Services, Tool-wikiloves
JeanFred closed T224862: Use img_actor when querying user id as Resolved.
2019-06-05_15:15:08 Starting database update.
Fetching configuration...
Found 26 events in the configuration.
Updating only 1 event(s): earth2019.
Fetching data for earth2019...
Saved earth2019: 27sec, 36 countries, 67572 uploads
2019-06-05_15:15:38 Done with the update!
Jun 5 2019, 3:29 PM · Data-Services, Tool-wikiloves

Jun 3 2019

JeanFred renamed T224862: Use img_actor when querying user id from Some images have no `img_user` in the `image` table in Commons Wiki replicas to Use img_actor when querying user id.
Jun 3 2019, 1:25 PM · Data-Services, Tool-wikiloves
JeanFred added a comment to T224862: Use img_actor when querying user id.

@JeanFred Please read the several announcements on the cloud list of production database changes over the last 3 months. Specifically I don't believe such fields are canonical anymore, and actor id should be used instead. See T167246. DBAs are aware of this but they are not involved on the day to day changes, please ask on that ticker or on the cloud-l list.

Jun 3 2019, 1:11 PM · Data-Services, Tool-wikiloves
JeanFred lowered the priority of T224862: Use img_actor when querying user id from High to Normal.

I played with and stripped down the query until isolating the issue, and the question boils down to:

Jun 3 2019, 11:55 AM · Data-Services, Tool-wikiloves
JeanFred renamed T224862: Use img_actor when querying user id from wikiloves database query returns images with no user to Some images have no `img_user` in the `image` table in Commons Wiki replicas.
Jun 3 2019, 11:53 AM · Data-Services, Tool-wikiloves
JeanFred renamed T224862: Use img_actor when querying user id from No update since May 29 to wikiloves database query returns images with no user.
Jun 3 2019, 9:25 AM · Data-Services, Tool-wikiloves
JeanFred added a comment to T224862: Use img_actor when querying user id.

@JeanFred: Updates of what? This task completely lacks any context :) Feel free to add a project tag.

Jun 3 2019, 9:17 AM · Data-Services, Tool-wikiloves
JeanFred updated the task description for T224862: Use img_actor when querying user id.
Jun 3 2019, 9:17 AM · Data-Services, Tool-wikiloves
JeanFred added a comment to T224862: Use img_actor when querying user id.

This query illustrates the issue: https://quarry.wmflabs.org/query/36585

Jun 3 2019, 9:16 AM · Data-Services, Tool-wikiloves
JeanFred added a comment to T224862: Use img_actor when querying user id.

Interestingly, a python database.py africa2019runs just fine.
But not on earth2019

Jun 3 2019, 9:15 AM · Data-Services, Tool-wikiloves
JeanFred added a comment to T224862: Use img_actor when querying user id.

Last successful update was 2019-05-29_15:00:34:

2019-05-29_15:00:34 Starting database update.
Fetching configuration...
Found 26 events in the configuration.
Updating only 1 event(s): earth2019.
Fetching data for earth2019...
Saved earth2019: 363sec, 24 countries, 54610 uploads
2019-05-29_15:06:40 Done with the update!
Jun 3 2019, 8:46 AM · Data-Services, Tool-wikiloves
JeanFred created T224862: Use img_actor when querying user id.
Jun 3 2019, 8:45 AM · Data-Services, Tool-wikiloves

May 31 2019

JeanFred added a comment to T224651: Manual update - stale file handle.

Thanks for investigating and fixing @aborrero !

May 31 2019, 7:58 AM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality

May 30 2019

JeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ kubectl get pod
NAME                            READY     STATUS             RESTARTS   AGE
integraality-2123637710-142v5   0/1       CrashLoopBackOff   6          6m
tools.integraality@tools-sgebastion-07:~$ kubectl logs integraality-2123637710-142v5
Traceback (most recent call last):
  File "/usr/bin/webservice-runner", line 20, in <module>
    tool = Tool.from_currentuser()
  File "/usr/lib/python2.7/dist-packages/toollabs/common/tool.py", line 96, in from_currentuser
    pwd_entry = pwd.getpwuid(os.geteuid())
KeyError: 'getpwuid(): uid not found: 54041'
May 30 2019, 12:14 PM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality
JeanFred added a comment to T224651: Manual update - stale file handle.

Even after nuking the venv and reinstalling everything, the service does not get healthy:

tools.integraality@tools-sgebastion-07:~$ kubectl get pod
NAME                            READY     STATUS             RESTARTS   AGE
integraality-2123637710-142v5   0/1       CrashLoopBackOff   3          1m
May 30 2019, 12:09 PM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality
JeanFred added a comment to T224651: Manual update - stale file handle.

Grrr, wanted to nuke the virtualenv and provision it from scratch but:

tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 shell
Pod is not ready in time
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 stop
Stopping webservice
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 shell
Traceback (most recent call last):
  File "/usr/local/bin/webservice", line 198, in <module>
    job.shell()
  File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 491, in shell
    pykube.Pod(self.api, podSpec).create()
  File "/usr/lib/python2.7/dist-packages/pykube/objects.py", line 76, in create
    self.api.raise_for_status(r)
  File "/usr/lib/python2.7/dist-packages/pykube/http.py", line 104, in raise_for_status
    raise HTTPError(payload["message"])
pykube.exceptions.HTTPError: object is being deleted: pods "interactive" already exists
May 30 2019, 12:03 PM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality
JeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 stop
Stopping webservice
tools.integraality@tools-sgebastion-07:~$ kubectl get pod
<>
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 start
Starting webservice...
tools.integraality@tools-sgebastion-07:~$ kubectl get pod
NAME                            READY     STATUS    RESTARTS   AGE
integraality-2123637710-denbu   0/1       Error     2          30s
May 30 2019, 11:56 AM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality
JeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ kubectl get po
NAME                            READY     STATUS             RESTARTS   AGE
integraality-2123637710-p5b8o   0/1       CrashLoopBackOff   15         56m
May 30 2019, 11:54 AM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality
JeanFred added a project to T224651: Manual update - stale file handle: Toolforge.
May 30 2019, 11:03 AM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality
JeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 status
Your webservice of type python3.5 is running

yet, https://tools.wmflabs.org/integraality/ goes in 502 ; and also nothing in uwsgi.log (I hand-rotated the file to uwgi.log.1, and it does not get recreated 🤔 )

May 30 2019, 11:01 AM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality
JeanFred added a comment to T224651: Manual update - stale file handle.

Thanks for reporting.

May 30 2019, 10:59 AM · cloud-services-team (Kanban), Toolforge, Tool-inteGraality

May 29 2019

Restricted Application added a project to T224604: Allow to middle-click through to the Wikidata item from search results when adding Depicts statements: Multimedia.
May 29 2019, 4:10 PM · Structured-Data-Backlog, Structured Data Engineering
JeanFred added a comment to T219368: Basic depicts support for campaigns in UploadWizard.

Need to find a user with campaign creation rights on production to test this there.

May 29 2019, 9:14 AM · Structured-Data-Backlog (Current Work), MW-1.33-notes (1.33.0-wmf.25; 2019-04-09), SDC-Statements (Other-statements-running), Structured-Data-Team-Current-Work, Structured Data Engineering

May 24 2019

JeanFred moved T224229: Grouping by property is not powerful enough for some use-cases from Backlog to Enhancements on the Tool-inteGraality board.
May 24 2019, 9:00 AM · Tool-inteGraality
JeanFred closed T223918: Report error when there is no end-template as Resolved.

Confirmed this is working: together with R2566:6b6c07ca62, the user immediately gets an explicit error message:

May 24 2019, 9:00 AM · Tool-inteGraality

May 23 2019

JeanFred updated the task description for T224229: Grouping by property is not powerful enough for some use-cases.
May 23 2019, 2:57 PM · Tool-inteGraality
JeanFred updated the task description for T224229: Grouping by property is not powerful enough for some use-cases.
May 23 2019, 2:40 PM · Tool-inteGraality
JeanFred updated subscribers of T224229: Grouping by property is not powerful enough for some use-cases.
May 23 2019, 2:38 PM · Tool-inteGraality
JeanFred created T224229: Grouping by property is not powerful enough for some use-cases.
May 23 2019, 2:38 PM · Tool-inteGraality
JeanFred moved T224226: grouping_threshold is behaving in unexpected way from Backlog to Bugs on the Tool-inteGraality board.
May 23 2019, 2:17 PM · Tool-inteGraality
JeanFred created T224226: grouping_threshold is behaving in unexpected way.
May 23 2019, 2:17 PM · Tool-inteGraality
JeanFred moved T224212: grouping type should be inferred from Wikidata itself, not hardcoded from Backlog to Enhancements on the Tool-inteGraality board.
May 23 2019, 2:14 PM · Tool-inteGraality
JeanFred added a comment to T223930: Implement image as special higher grouping type.

I’m closing this in favour of T224212: grouping type should be inferred from Wikidata itself, not hardcoded, which is a more generic and robust approach to this.

May 23 2019, 9:15 AM · Tool-inteGraality
JeanFred merged T223930: Implement image as special higher grouping type into T224212: grouping type should be inferred from Wikidata itself, not hardcoded.
May 23 2019, 9:14 AM · Tool-inteGraality
JeanFred merged task T223930: Implement image as special higher grouping type into T224212: grouping type should be inferred from Wikidata itself, not hardcoded.
May 23 2019, 9:14 AM · Tool-inteGraality
JeanFred created T224212: grouping type should be inferred from Wikidata itself, not hardcoded.
May 23 2019, 9:14 AM · Tool-inteGraality

May 22 2019

JeanFred committed R2566:8e76a8a85b81: Add 'string' as valid higher_grouping_type (authored by JeanFred).
Add 'string' as valid higher_grouping_type
May 22 2019, 4:38 PM
JeanFred closed T224090: Number are off when items fall under several groups as Resolved.
May 22 2019, 2:48 PM · Tool-inteGraality
JeanFred committed R2566:e6cabda5a6da: Add link to homepage in navbar in base template (authored by JeanFred).
Add link to homepage in navbar in base template
May 22 2019, 2:19 PM
JeanFred committed R2566:0636cde4d6e2: Move toolinfo.json to static directory (authored by JeanFred).
Move toolinfo.json to static directory
May 22 2019, 1:36 PM
JeanFred committed R2566:c17cb780b486: Do not double-count items falling under several groups (authored by JeanFred).
Do not double-count items falling under several groups
May 22 2019, 1:10 PM
JeanFred committed R2566:6b6c07ca62c5: Catch Exception in Flask app when processing the page (authored by JeanFred).
Catch Exception in Flask app when processing the page
May 22 2019, 1:10 PM
JeanFred committed R2566:2fdede20c8e9: Do not crash when there are no results for a property (authored by JeanFred).
Do not crash when there are no results for a property
May 22 2019, 1:10 PM
JeanFred renamed T224090: Number are off when items fall under several groups from Number are off when a higher-grouping is not unique to Number are off when items fall under several groups.
May 22 2019, 1:05 PM · Tool-inteGraality
JeanFred updated the task description for T224001: Provide path towards SPARQL queries .
May 22 2019, 11:58 AM · Tool-inteGraality
JeanFred committed R2566:8b0b21c76337: Add human-readable error message to Exception (authored by JeanFred).
Add human-readable error message to Exception
May 22 2019, 11:38 AM
JeanFred committed R2566:22b2657ff596: Raise ConfigException when the PropertyStatistics cannot be built (authored by JeanFred).
Raise ConfigException when the PropertyStatistics cannot be built
May 22 2019, 11:32 AM
JeanFred committed R2566:6b6b295389e7: Catch Processing exception in Flask application (authored by JeanFred).
Catch Processing exception in Flask application
May 22 2019, 11:32 AM
JeanFred committed R2566:00d3b6804691: Throw Exception when there is no End Template (authored by JeanFred).
Throw Exception when there is no End Template
May 22 2019, 11:32 AM
JeanFred committed R2566:d1adb015d44d: Catch ConfigException in process_all (authored by JeanFred).
Catch ConfigException in process_all
May 22 2019, 11:32 AM
JeanFred committed R2566:59674a9cefde: Introduce superclass ProcessingException (authored by JeanFred).
Introduce superclass ProcessingException
May 22 2019, 11:32 AM
JeanFred committed R2566:12be3eb18fcc: Switch logging to pywikibot logging (authored by JeanFred).
Switch logging to pywikibot logging
May 22 2019, 11:32 AM
JeanFred moved T223930: Implement image as special higher grouping type from Backlog to Enhancements on the Tool-inteGraality board.
May 22 2019, 11:28 AM · Tool-inteGraality
JeanFred moved T224090: Number are off when items fall under several groups from Backlog to Bugs on the Tool-inteGraality board.
May 22 2019, 11:28 AM · Tool-inteGraality
JeanFred moved T224001: Provide path towards SPARQL queries from Backlog to Enhancements on the Tool-inteGraality board.
May 22 2019, 11:28 AM · Tool-inteGraality
JeanFred added a project to T224081: Need Ctrl/Cmd select multiple files for "Depict" feature on Commons: UploadWizard.
May 22 2019, 9:06 AM · Structured-Data-Backlog, UploadWizard, SDC-Statements
JeanFred edited projects for T224081: Need Ctrl/Cmd select multiple files for "Depict" feature on Commons, added: SDC-Statements; removed Wikidata.
May 22 2019, 9:05 AM · Structured-Data-Backlog, UploadWizard, SDC-Statements
JeanFred created T224090: Number are off when items fall under several groups.
May 22 2019, 8:53 AM · Tool-inteGraality

May 21 2019

JeanFred committed R2566:4671ea8f31b0: Rename variable start_templates_with_params (authored by JeanFred).
Rename variable start_templates_with_params
May 21 2019, 4:27 PM
JeanFred committed R2566:05f16931ef5a: Do not parse empty parameter (authored by JeanFred).
Do not parse empty parameter
May 21 2019, 4:27 PM
JeanFred committed R2566:a4f58e10db58: Extract method parse_config_from_params and add unit tests for it (authored by JeanFred).
Extract method parse_config_from_params and add unit tests for it
May 21 2019, 4:27 PM
JeanFred added a comment to T224001: Provide path towards SPARQL queries .

I’m not keen on 1/, because generating crazy amount of arbitrary ShortURLs will eat up short URLs for no good reason (also, pretty sure this would be throttled).

May 21 2019, 3:30 PM · Tool-inteGraality
JeanFred created T224001: Provide path towards SPARQL queries .
May 21 2019, 1:01 PM · Tool-inteGraality
JeanFred added a comment to T223974: Manually run the bot on a given page?.

Ah nevermind there is already a link, I just did not look on the right-hand side.

May 21 2019, 12:44 PM · Tool-inteGraality
JeanFred added a watcher for Tool-inteGraality: JeanFred.
May 21 2019, 12:41 PM
JeanFred added a comment to T220219: Wikidata property statistics service.

See also Tool-inteGraality

May 21 2019, 8:52 AM · Tools, Wikimedia-Hackathon-2019, Wikidata
JeanFred added a comment to T223930: Implement image as special higher grouping type.

the main problem right now is that the tool somehow converts the image file name to all UPPERCASE, which then impedes fetching the file from Commons.

May 21 2019, 7:19 AM · Tool-inteGraality

May 20 2019

JeanFred created T223930: Implement image as special higher grouping type.
May 20 2019, 7:13 PM · Tool-inteGraality
JeanFred committed R2566:e4b2a8442e98: Add link to report bugs on Phabricator (authored by JeanFred).
Add link to report bugs on Phabricator
May 20 2019, 3:52 PM
JeanFred edited Description on Tool-inteGraality.
May 20 2019, 3:42 PM
JeanFred created T223918: Report error when there is no end-template.
May 20 2019, 3:38 PM · Tool-inteGraality
JeanFred created Tool-inteGraality.
May 20 2019, 3:36 PM
JeanFred committed R2566:8e47643e96cb: Do not crash when SPARQL query return nothing (authored by JeanFred).
Do not crash when SPARQL query return nothing
May 20 2019, 3:34 PM
JeanFred committed R2566:e712b15bcbe3: Do not crash when SPARQL query return nothing (authored by JeanFred).
Do not crash when SPARQL query return nothing
May 20 2019, 3:32 PM

May 19 2019

waldyrious awarded T220219: Wikidata property statistics service a Yellow Medal token.
May 19 2019, 6:16 PM · Tools, Wikimedia-Hackathon-2019, Wikidata
JeanFred committed R2566:5266ee00d08c: Need to escape curly braces in Jinja templates (authored by JeanFred).
Need to escape curly braces in Jinja templates
May 19 2019, 2:02 PM
JeanFred committed R2566:596ce43caf0d: Clarify home page with clearer instructions (authored by JeanFred).
Clarify home page with clearer instructions
May 19 2019, 2:02 PM
JeanFred closed T220219: Wikidata property statistics service as Resolved.

This is basically done :)

May 19 2019, 1:45 PM · Tools, Wikimedia-Hackathon-2019, Wikidata
JeanFred committed R2566:04e56f5283b1: Add two examples on index page (authored by JeanFred).
Add two examples on index page
May 19 2019, 1:34 PM
JeanFred committed R2566:46982efb3897: Rename variable for clarity (authored by JeanFred).
Rename variable for clarity
May 19 2019, 1:00 PM