Developer of Tool-inteGraality. Maintainer of Tool-wikiloves and Wiki-Loves-Monuments
User Details
User Details
- User Since
- Oct 6 2014, 10:01 PM (254 w, 2 d)
- Availability
- Available
- IRC Nick
- JeanFred
- LDAP User
- Jean-Frédéric
- MediaWiki User
- Jean-Frédéric [ Global Accounts ]
Sat, Aug 17
Sat, Aug 17
Roy17 awarded T220474: UploadWizard requires description at least 5 characters long, does not work well in languages like Japanese or Korean a The World Burns token.
Fri, Aug 16
Fri, Aug 16
JeanFred added a comment to T134617: Implement CSV/TSV import/export for tabular data set.
Thu, Aug 15
Thu, Aug 15
Sat, Aug 10
Sat, Aug 10
Mon, Jul 29
Mon, Jul 29
JeanFred committed R2566:04248f94e768: Add Ansible playbook for Toolforge deployment (authored by JeanFred).
Add Ansible playbook for Toolforge deployment
Jul 11 2019
Jul 11 2019
Amire80 awarded T210951: Evaluate Indico as submission software for Wikimania a Like token.
Jul 8 2019
Jul 8 2019
JeanFred committed R2566:ae16d683a9b4: Add flask as known-third-party in isort configuration (authored by JeanFred).
Add flask as known-third-party in isort configuration
JeanFred committed R2566:728a8d2188d7: Fix directory excludes in tox configuration (authored by JeanFred).
Fix directory excludes in tox configuration
JeanFred committed R2566:394be6a29cb4: Fix formatting warnings in test_pages_processor.py (authored by JeanFred).
Fix formatting warnings in test_pages_processor.py
JeanFred committed R2566:d101ca1fe0f4: Remove unused variable in exception catching (authored by JeanFred).
Remove unused variable in exception catching
JeanFred committed R2566:ab902279ac9c: Override edit summary for weekly update (authored by JeanFred).
Override edit summary for weekly update
JeanFred committed R2566:5b4a1c639ca9: Move edit summary string as class attribute (authored by JeanFred).
Move edit summary string as class attribute
Jul 6 2019
Jul 6 2019
JeanFred added a comment to T219198: Wikimedia Hackathon 2019 volunteer group: Blog .
Even more belatedly, here is mine: https://commonists.wordpress.com/2019/07/06/the-story-of-integraality-or-my-quest-to-make-it-at-the-wikimedia-hackathon/
Jun 14 2019
Jun 14 2019
JeanFred edited projects for T217019: wikiloves - Incorrect usage of crontab in Toolforge, added: Tool-wikiloves; removed Tools.
Jun 12 2019
Jun 12 2019
Jun 5 2019
Jun 5 2019
JeanFred committed R1969:aabd6ec2b0b2: Update database query after schema changes (authored by JeanFred).
Update database query after schema changes
JeanFred updated subscribers of T224862: Use img_actor when querying user id.
2019-06-05_15:15:08 Starting database update. Fetching configuration... Found 26 events in the configuration. Updating only 1 event(s): earth2019. Fetching data for earth2019... Saved earth2019: 27sec, 36 countries, 67572 uploads 2019-06-05_15:15:38 Done with the update!
Jun 3 2019
Jun 3 2019
JeanFred renamed T224862: Use img_actor when querying user id from Some images have no `img_user` in the `image` table in Commons Wiki replicas to Use img_actor when querying user id.
JeanFred added a comment to T224862: Use img_actor when querying user id.
I played with and stripped down the query until isolating the issue, and the question boils down to:
JeanFred renamed T224862: Use img_actor when querying user id from wikiloves database query returns images with no user to Some images have no `img_user` in the `image` table in Commons Wiki replicas.
JeanFred renamed T224862: Use img_actor when querying user id from No update since May 29 to wikiloves database query returns images with no user.
JeanFred added a comment to T224862: Use img_actor when querying user id.
JeanFred updated the task description for T224862: Use img_actor when querying user id.
JeanFred added a comment to T224862: Use img_actor when querying user id.
This query illustrates the issue: https://quarry.wmflabs.org/query/36585
JeanFred added a comment to T224862: Use img_actor when querying user id.
Interestingly, a python database.py africa2019runs just fine.
But not on earth2019
JeanFred added a comment to T224862: Use img_actor when querying user id.
Last successful update was 2019-05-29_15:00:34:
2019-05-29_15:00:34 Starting database update. Fetching configuration... Found 26 events in the configuration. Updating only 1 event(s): earth2019. Fetching data for earth2019... Saved earth2019: 363sec, 24 countries, 54610 uploads 2019-05-29_15:06:40 Done with the update!
May 31 2019
May 31 2019
JeanFred added a comment to T224651: Manual update - stale file handle.
Thanks for investigating and fixing @aborrero !
May 30 2019
May 30 2019
JeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ kubectl get pod
NAME READY STATUS RESTARTS AGE
integraality-2123637710-142v5 0/1 CrashLoopBackOff 6 6m
tools.integraality@tools-sgebastion-07:~$ kubectl logs integraality-2123637710-142v5
Traceback (most recent call last):
File "/usr/bin/webservice-runner", line 20, in <module>
tool = Tool.from_currentuser()
File "/usr/lib/python2.7/dist-packages/toollabs/common/tool.py", line 96, in from_currentuser
pwd_entry = pwd.getpwuid(os.geteuid())
KeyError: 'getpwuid(): uid not found: 54041'JeanFred added a comment to T224651: Manual update - stale file handle.
Even after nuking the venv and reinstalling everything, the service does not get healthy:
tools.integraality@tools-sgebastion-07:~$ kubectl get pod NAME READY STATUS RESTARTS AGE integraality-2123637710-142v5 0/1 CrashLoopBackOff 3 1m
JeanFred added a comment to T224651: Manual update - stale file handle.
Grrr, wanted to nuke the virtualenv and provision it from scratch but:
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 shell
Pod is not ready in time
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 stop
Stopping webservice
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 shell
Traceback (most recent call last):
File "/usr/local/bin/webservice", line 198, in <module>
job.shell()
File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 491, in shell
pykube.Pod(self.api, podSpec).create()
File "/usr/lib/python2.7/dist-packages/pykube/objects.py", line 76, in create
self.api.raise_for_status(r)
File "/usr/lib/python2.7/dist-packages/pykube/http.py", line 104, in raise_for_status
raise HTTPError(payload["message"])
pykube.exceptions.HTTPError: object is being deleted: pods "interactive" already existsJeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 stop Stopping webservice tools.integraality@tools-sgebastion-07:~$ kubectl get pod <> tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 start Starting webservice... tools.integraality@tools-sgebastion-07:~$ kubectl get pod NAME READY STATUS RESTARTS AGE integraality-2123637710-denbu 0/1 Error 2 30s
JeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ kubectl get po NAME READY STATUS RESTARTS AGE integraality-2123637710-p5b8o 0/1 CrashLoopBackOff 15 56m
JeanFred added a comment to T224651: Manual update - stale file handle.
tools.integraality@tools-sgebastion-07:~$ webservice --backend=kubernetes python3.5 status Your webservice of type python3.5 is running
yet, https://tools.wmflabs.org/integraality/ goes in 502 ; and also nothing in uwsgi.log (I hand-rotated the file to uwgi.log.1, and it does not get recreated 🤔 )
JeanFred added a comment to T224651: Manual update - stale file handle.
Thanks for reporting.
May 29 2019
May 29 2019
Restricted Application added a project to T224604: Allow to middle-click through to the Wikidata item from search results when adding Depicts statements: Multimedia.
JeanFred added a comment to T219368: Basic depicts support for campaigns in UploadWizard.
May 24 2019
May 24 2019
JeanFred moved T224229: Grouping by property is not powerful enough for some use-cases from Backlog to Enhancements on the Tool-inteGraality board.
Confirmed this is working: together with R2566:6b6c07ca62, the user immediately gets an explicit error message:
May 23 2019
May 23 2019
JeanFred updated the task description for T224229: Grouping by property is not powerful enough for some use-cases.
JeanFred updated the task description for T224229: Grouping by property is not powerful enough for some use-cases.
JeanFred updated subscribers of T224229: Grouping by property is not powerful enough for some use-cases.
JeanFred moved T224226: grouping_threshold is behaving in unexpected way from Backlog to Bugs on the Tool-inteGraality board.
JeanFred moved T224212: grouping type should be inferred from Wikidata itself, not hardcoded from Backlog to Enhancements on the Tool-inteGraality board.
JeanFred added a comment to T223930: Implement image as special higher grouping type.
I’m closing this in favour of T224212: grouping type should be inferred from Wikidata itself, not hardcoded, which is a more generic and robust approach to this.
May 22 2019
May 22 2019
JeanFred committed R2566:8e76a8a85b81: Add 'string' as valid higher_grouping_type (authored by JeanFred).
Add 'string' as valid higher_grouping_type
JeanFred committed R2566:e6cabda5a6da: Add link to homepage in navbar in base template (authored by JeanFred).
Add link to homepage in navbar in base template
JeanFred committed R2566:0636cde4d6e2: Move toolinfo.json to static directory (authored by JeanFred).
Move toolinfo.json to static directory
JeanFred committed R2566:c17cb780b486: Do not double-count items falling under several groups (authored by JeanFred).
Do not double-count items falling under several groups
JeanFred committed R2566:6b6c07ca62c5: Catch Exception in Flask app when processing the page (authored by JeanFred).
Catch Exception in Flask app when processing the page
JeanFred committed R2566:2fdede20c8e9: Do not crash when there are no results for a property (authored by JeanFred).
Do not crash when there are no results for a property
JeanFred renamed T224090: Number are off when items fall under several groups from Number are off when a higher-grouping is not unique to Number are off when items fall under several groups.
JeanFred updated the task description for T224001: Provide path towards SPARQL queries .
JeanFred committed R2566:8b0b21c76337: Add human-readable error message to Exception (authored by JeanFred).
Add human-readable error message to Exception
JeanFred committed R2566:22b2657ff596: Raise ConfigException when the PropertyStatistics cannot be built (authored by JeanFred).
Raise ConfigException when the PropertyStatistics cannot be built
JeanFred committed R2566:6b6b295389e7: Catch Processing exception in Flask application (authored by JeanFred).
Catch Processing exception in Flask application
JeanFred committed R2566:00d3b6804691: Throw Exception when there is no End Template (authored by JeanFred).
Throw Exception when there is no End Template
Catch ConfigException in process_all
JeanFred committed R2566:59674a9cefde: Introduce superclass ProcessingException (authored by JeanFred).
Introduce superclass ProcessingException
Switch logging to pywikibot logging
JeanFred moved T223930: Implement image as special higher grouping type from Backlog to Enhancements on the Tool-inteGraality board.
JeanFred moved T224090: Number are off when items fall under several groups from Backlog to Bugs on the Tool-inteGraality board.
JeanFred moved T224001: Provide path towards SPARQL queries from Backlog to Enhancements on the Tool-inteGraality board.
JeanFred edited projects for T224081: Need Ctrl/Cmd select multiple files for "Depict" feature on Commons, added: SDC-Statements; removed Wikidata.
May 21 2019
May 21 2019
JeanFred committed R2566:4671ea8f31b0: Rename variable start_templates_with_params (authored by JeanFred).
Rename variable start_templates_with_params
Do not parse empty parameter
JeanFred committed R2566:a4f58e10db58: Extract method parse_config_from_params and add unit tests for it (authored by JeanFred).
Extract method parse_config_from_params and add unit tests for it
JeanFred added a comment to T224001: Provide path towards SPARQL queries .
I’m not keen on 1/, because generating crazy amount of arbitrary ShortURLs will eat up short URLs for no good reason (also, pretty sure this would be throttled).
JeanFred added a comment to T223974: Manually run the bot on a given page?.
JeanFred added a comment to T220219: Wikidata property statistics service.
See also Tool-inteGraality
JeanFred added a comment to T223930: Implement image as special higher grouping type.
May 20 2019
May 20 2019
JeanFred committed R2566:e4b2a8442e98: Add link to report bugs on Phabricator (authored by JeanFred).
Add link to report bugs on Phabricator
JeanFred edited Description on Tool-inteGraality.
JeanFred committed R2566:8e47643e96cb: Do not crash when SPARQL query return nothing (authored by JeanFred).
Do not crash when SPARQL query return nothing
JeanFred committed R2566:e712b15bcbe3: Do not crash when SPARQL query return nothing (authored by JeanFred).
Do not crash when SPARQL query return nothing
May 19 2019
May 19 2019
waldyrious awarded T220219: Wikidata property statistics service a Yellow Medal token.
JeanFred committed R2566:5266ee00d08c: Need to escape curly braces in Jinja templates (authored by JeanFred).
Need to escape curly braces in Jinja templates
JeanFred committed R2566:596ce43caf0d: Clarify home page with clearer instructions (authored by JeanFred).
Clarify home page with clearer instructions
This is basically done :)
Add two examples on index page
Rename variable for clarity