Page MenuHomePhabricator

JeanFred (Jean-Frédéric)
Volunteer

Projects (8)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 6 2014, 10:01 PM (380 w, 17 h)
Availability
Available
IRC Nick
JeanFred
LDAP User
Jean-Frédéric
MediaWiki User
Jean-Frédéric [ Global Accounts ]

Developer of Tool-inteGraality. Maintainer of Tool-wikiloves and Wiki-Loves-Monuments

Recent Activity

Mon, Dec 20

JeanFred added a comment to T290300: Serve WCQS Sparql endpoint through api.wikimedia.org with OAuth 2.

I share the opinion of @Multichill, @LucasWerkmeister and others: I understand the rationale for authentication, and I think I can live with it as user ; but as a tool developer, I don’t want to have to implement OAuth2 in my tools (such as Tool-inteGraality) − I was planning to add WCQS to inteGraality (T294893) but frankly I’m unlikely to do so if I have to throw in oauth on top.

Mon, Dec 20, 6:29 PM · Wikidata-Query-Service, Wikidata

Dec 16 2021

JeanFred added a comment to T294889: Assess whether integraality works/makese sense for Lexemes.

For lexemes a good grouping predicate would be wikibase:lexicalCategory and dct:language

Dec 16 2021, 8:42 PM · Tool-inteGraality

Nov 27 2021

JeanFred committed R2566:bb322b5fa454: Move ColumnConfig classes to their own module (authored by JeanFred).
Move ColumnConfig classes to their own module
Nov 27 2021, 1:02 PM

Nov 13 2021

JeanFred moved T224229: Grouping by property is not powerful enough for some use-cases from Enhancements to Needs input on the Tool-inteGraality board.
Nov 13 2021, 9:09 PM · Tool-inteGraality
JeanFred moved T294892: integraality for Wikibases? from Backlog to Needs input on the Tool-inteGraality board.
Nov 13 2021, 9:09 PM · Wikibase (3rd party installations), Tool-inteGraality
JeanFred added a comment to T294892: integraality for Wikibases?.

@Addshore From a product perspective, would it make sense to ship integraality with wikibase / make it easy to add it to the setup (probably along the lines of a Docker image to add to the docker-compose setup) − is that smth that would be beneficial to users? I mean, it’s no QuickStatements, but it has proven valuable for many.

Nov 13 2021, 9:08 PM · Wikibase (3rd party installations), Tool-inteGraality
JeanFred added a comment to T224229: Grouping by property is not powerful enough for some use-cases.

One year later, some more thoughts:

Nov 13 2021, 8:59 PM · Tool-inteGraality

Nov 8 2021

JeanFred updated the task description for T295296: Create Grafana dashboard.
Nov 8 2021, 3:13 PM · Tool-inteGraality
JeanFred triaged T295296: Create Grafana dashboard as Low priority.
Nov 8 2021, 3:07 PM · Tool-inteGraality
JeanFred created T295296: Create Grafana dashboard.
Nov 8 2021, 3:07 PM · Tool-inteGraality
JeanFred added a comment to T293543: Unable to login via API key with Pattypan, Commonist, and VicuñaUploader.

As far as I can tell, there was no such outreach to Pattypan and Vicuna.

I filed https://github.com/yarl/vicuna/issues/154 back in July.

Nov 8 2021, 2:40 PM · MediaWiki-API, Commons
JeanFred updated subscribers of T293543: Unable to login via API key with Pattypan, Commonist, and VicuñaUploader.

There was direct outreach to Commonist by @Reedy with https://github.com/ritschwumm/commonist/issues/25 − August 24th (7 days before the days before the deadline) − which the volunteer maintainer acknowledged on September 12th. As far as I can tell, there was no such outreach to Pattypan and Vicuna.

Nov 8 2021, 8:30 AM · MediaWiki-API, Commons
JeanFred added a comment to T280806: Remove old action api token parameters.

The MediaWiki API developers and the Pywikibot framework maintainers had a bit of miscommunication causing deprecated code to still be in use. By forcing this change through you're effectively punishing the Pywikibot framework users for a mistake made by other people.

Nov 8 2021, 8:13 AM · MW-1.38-notes (1.38.0-wmf.2; 2021-09-28), Patch-For-Review, MW-1.37-notes (1.37.0-wmf.23; 2021-09-13), User-notice, Technical-Debt, MediaWiki-API, Platform Team Workboards (MW Expedition)

Nov 6 2021

JeanFred merged T295215: Several Wikimedia Commons upload tools authentication mechanism broken recently into T293543: Unable to login via API key with Pattypan, Commonist, and VicuñaUploader.
Nov 6 2021, 9:43 PM · MediaWiki-API, Commons
JeanFred merged task T295215: Several Wikimedia Commons upload tools authentication mechanism broken recently into T293543: Unable to login via API key with Pattypan, Commonist, and VicuñaUploader.
Nov 6 2021, 9:43 PM · Commons
JeanFred added a comment to T295215: Several Wikimedia Commons upload tools authentication mechanism broken recently.

@JeanFred: Hi, what is supposed to happen with and in this very ticket? :)

Nov 6 2021, 9:42 PM · Commons
JeanFred added a comment to T295238: Upgrade pywikibot to latest version.

Oh joy: tests fail with
AttributeError: <module 'pywikibot' from 'heritage/.tox/py37/lib/python3.5/site-packages/pywikibot/__init__.py'> does not have the attribute 'ImagePage'

Nov 6 2021, 9:02 PM · Wiki-Loves-Monuments-Database
JeanFred created T295238: Upgrade pywikibot to latest version.
Nov 6 2021, 9:02 PM · Wiki-Loves-Monuments-Database
JeanFred added a project to T295215: Several Wikimedia Commons upload tools authentication mechanism broken recently: Commons.
Nov 6 2021, 4:51 AM · Commons
JeanFred updated the task description for T295215: Several Wikimedia Commons upload tools authentication mechanism broken recently.
Nov 6 2021, 4:48 AM · Commons
JeanFred created T295215: Several Wikimedia Commons upload tools authentication mechanism broken recently.
Nov 6 2021, 4:46 AM · Commons

Nov 3 2021

VIGNERON awarded T294889: Assess whether integraality works/makese sense for Lexemes a Party Time token.
Nov 3 2021, 8:13 PM · Tool-inteGraality
JeanFred added a comment to T294892: integraality for Wikibases?.

integraality

  • reads the configuration template {{Property dashboard}} to know the SPARQL bits and pieces to use to construct the SPARQL queries
  • Throws these SPARQL queries into the SPARQL endpoint using pywikibot (via pywikibot.data.sparql)
  • computes stuff
  • writes the table as wikitext
Nov 3 2021, 12:59 PM · Wikibase (3rd party installations), Tool-inteGraality
JeanFred added a comment to T294889: Assess whether integraality works/makese sense for Lexemes.

Thanks @VIGNERON for fixing the dashboard! Also made the transposed one https://www.wikidata.org/wiki/User:Jean-Fr%C3%A9d%C3%A9ric/Integraality/Lexemes_bis

Nov 3 2021, 9:42 AM · Tool-inteGraality
JeanFred added a comment to T294889: Assess whether integraality works/makese sense for Lexemes.

Sooo, smth like https://www.wikidata.org/wiki/User:Jean-Fr%C3%A9d%C3%A9ric/Integraality/Lexemes does return smth (no idea whether it makes any sense though ^^)

Nov 3 2021, 8:25 AM · Tool-inteGraality
JeanFred closed T236960: Bug while updating as Resolved.

Probably resolved during the last fix sprint: https://www.wikidata.org/wiki/User:Jean-Fr%C3%A9d%C3%A9ric/T236960 is updated.

Nov 3 2021, 8:16 AM · Tool-inteGraality
JeanFred added a comment to T236937: InteGraality should support combining properties in Either/Or mode.

Actually, would https://www.wikidata.org/wiki/Wikidata:Tools/inteGraality#Using_two_properties_as_alternative_groupings just work there?

Nov 3 2021, 8:14 AM · Tool-inteGraality
JeanFred moved T294889: Assess whether integraality works/makese sense for Lexemes from Backlog to Needs input on the Tool-inteGraality board.
Nov 3 2021, 8:13 AM · Tool-inteGraality
JeanFred moved T251008: Qualifier cells do not contain the qualifier information from Backlog to Bugs on the Tool-inteGraality board.
Nov 3 2021, 8:13 AM · Tool-inteGraality
JeanFred moved T237276: Re-evaluate the grouping-link behaviour from Backlog to Needs input on the Tool-inteGraality board.
Nov 3 2021, 8:13 AM · Tool-inteGraality
JeanFred moved T284684: Support for aliases from Enhancements to Needs input on the Tool-inteGraality board.
Nov 3 2021, 8:13 AM · Tool-inteGraality
JeanFred moved T278101: integraality does not handle "No value" groupings from Backlog to Enhancements on the Tool-inteGraality board.
Nov 3 2021, 8:12 AM · Tool-inteGraality
JeanFred triaged T251008: Qualifier cells do not contain the qualifier information as High priority.
Nov 3 2021, 8:12 AM · Tool-inteGraality
JeanFred closed T279236: Add timings/instrumentation as Resolved.

Probably good enough instrumentation for now.

Nov 3 2021, 8:11 AM · Tool-inteGraality
JeanFred created T294893: integraality for Structured Data on Commons?.
Nov 3 2021, 7:59 AM · StructuredDataOnCommons, Tool-inteGraality
JeanFred created T294892: integraality for Wikibases?.
Nov 3 2021, 7:54 AM · Wikibase (3rd party installations), Tool-inteGraality
JeanFred added a comment to T294889: Assess whether integraality works/makese sense for Lexemes.

So, I don’t know the first thing about the Lexemes data model, but some early thoughts:

Nov 3 2021, 7:35 AM · Tool-inteGraality
JeanFred created T294889: Assess whether integraality works/makese sense for Lexemes.
Nov 3 2021, 7:28 AM · Tool-inteGraality

Nov 1 2021

JeanFred committed R2566:972a1df69246: Do not use `COUNT(DISTINCT *)` in SPARQL queries (authored by JeanFred).
Do not use `COUNT(DISTINCT *)` in SPARQL queries
Nov 1 2021, 8:30 PM

Oct 30 2021

JeanFred committed R2566:b6940b01f641: Remove useless grouping/ordering/limiting in `get_info_no_grouping_query` (authored by JeanFred).
Remove useless grouping/ordering/limiting in `get_info_no_grouping_query`
Oct 30 2021, 7:36 PM
JeanFred committed R2566:c1628b9ab811: Remove print statements from unit tests (authored by JeanFred).
Remove print statements from unit tests
Oct 30 2021, 7:36 PM

Oct 29 2021

JeanFred committed R2566:40c8cd3c7341: Remove unused import pywikibot.pagegenerators (authored by JeanFred).
Remove unused import pywikibot.pagegenerators
Oct 29 2021, 9:49 AM
JeanFred committed R2566:af49babe53b8: Fix crash for unknown value for grouping by year (authored by JeanFred).
Fix crash for unknown value for grouping by year
Oct 29 2021, 9:47 AM
JeanFred closed T294570: integraality broken since Oct 28th (both interactive and command-line) as Resolved.

Both the interactive and command-line updates are working! Yay! 🎉

Oct 29 2021, 9:39 AM · Tool-inteGraality
JeanFred committed R2566:2260c8fa740d: Replace pywikibot's ReferringPageGenerator with Page.getReferences (authored by JeanFred).
Replace pywikibot's ReferringPageGenerator with Page.getReferences
Oct 29 2021, 9:26 AM
JeanFred committed R2566:0a4560aaa1e4: First round of dependency upgrades (authored by JeanFred).
First round of dependency upgrades
Oct 29 2021, 9:07 AM
JeanFred committed R2566:de296cdfaf6f: Upgrade pywikibot from 6.0.1 to latest version 6.6.1 (authored by JeanFred).
Upgrade pywikibot from 6.0.1 to latest version 6.6.1
Oct 29 2021, 9:07 AM

Oct 28 2021

JeanFred updated subscribers of T294570: integraality broken since Oct 28th (both interactive and command-line).

@LucasWerkmeister on Telegram

I think you might need to upgrade to Pywikibot 6.6.1 or later? earlier versions used a deprecated method of getting API tokens, which was disabled at some point in Wikimedia (same error message at T291202)

Oct 28 2021, 8:57 PM · Tool-inteGraality
JeanFred added a comment to T294570: integraality broken since Oct 28th (both interactive and command-line).

And I still can’t reproduce locally. All updates done locally are working.

Oct 28 2021, 8:53 PM · Tool-inteGraality
JeanFred added a comment to T294570: integraality broken since Oct 28th (both interactive and command-line).

So what happened is:

Oct 28 2021, 8:41 PM · Tool-inteGraality
JeanFred renamed T294570: integraality broken since Oct 28th (both interactive and command-line) from Error when trying to update a dashboard to integraality broken since Oct 28th (both interactive and command-line).
Oct 28 2021, 8:06 PM · Tool-inteGraality
JeanFred added a comment to T294570: integraality broken since Oct 28th (both interactive and command-line).

I rollbacked all recent changes − no luck :-(

Oct 28 2021, 5:14 PM · Tool-inteGraality
JeanFred added a comment to T294570: integraality broken since Oct 28th (both interactive and command-line).

I must have broken something when deploying 0a8e7fb8...

Oct 28 2021, 4:59 PM · Tool-inteGraality
JeanFred committed R2566:0a8e7fb8fd6a: Add support to group by year of date properties (authored by JeanFred).
Add support to group by year of date properties
Oct 28 2021, 12:38 PM
JeanFred committed R2566:098c89733fbf: Add support to group by year of date properties (authored by JeanFred).
Add support to group by year of date properties
Oct 28 2021, 12:36 PM
JeanFred closed T278156: WDQS timeout errors should be more gracefully handled as Resolved.

With 30a2f2ba the offending SPARQL query should be always surfaced to the user. Closing as Resolved.

Oct 28 2021, 11:32 AM · Tool-inteGraality
JeanFred committed R2566:30a2f2bac506: Extend QueryException with the query itself and surface it in the error page (authored by JeanFred).
Extend QueryException with the query itself and surface it in the error page
Oct 28 2021, 11:31 AM
JeanFred closed T273226: integraality does not handle "Unknown value" groupings well as Resolved.
Oct 28 2021, 11:30 AM · Tool-inteGraality
JeanFred committed R2566:5c547d821a62: Extend QueryException with the query itself and surface it in the error page (authored by JeanFred).
Extend QueryException with the query itself and surface it in the error page
Oct 28 2021, 11:27 AM
JeanFred committed R2566:b4f12bc140e9: Display traceback in the webapp in case of unknown errors (authored by JeanFred).
Display traceback in the webapp in case of unknown errors
Oct 28 2021, 10:16 AM
JeanFred committed R2566:8dbc09902007: Add support for Unknown value grouping (authored by JeanFred).
Add support for Unknown value grouping
Oct 28 2021, 9:07 AM
JeanFred committed R2566:137f5b82d2fd: Add grouping_property to the queries HTML template (authored by JeanFred).
Add grouping_property to the queries HTML template
Oct 28 2021, 9:07 AM
JeanFred committed R2566:8e0b9ca0d068: Add test for make_stats_for_one_grouping with unknown values (authored by JeanFred).
Add test for make_stats_for_one_grouping with unknown values
Oct 28 2021, 9:07 AM
JeanFred committed R2566:c816e41c6fff: Add test for _get_grouping_counts_from_sparql with unknown values (authored by JeanFred).
Add test for _get_grouping_counts_from_sparql with unknown values
Oct 28 2021, 9:07 AM
JeanFred added a comment to T292931: Manual update gets an error.

Oops, that was a sloppy mistake. Thanks for pointing it out!

Oct 28 2021, 7:59 AM · Tool-inteGraality
JeanFred closed T284183: Unsupported syntax in `columns` field results in uncaught `AttributeError` exception as Resolved.

I went for option 2, “integraality throws an error when encountering any invalid syntax in columns and will not update the dashboard at all.”

Oct 28 2021, 7:58 AM · Tool-inteGraality

Oct 27 2021

JeanFred committed R2566:6194d8417f80: Add test for get_grouping_information with unknown values (authored by JeanFred).
Add test for get_grouping_information with unknown values
Oct 27 2021, 9:32 AM
JeanFred added a comment to T284941: [S] Add note explaining that EXIF geolocation metadata may be uploaded with Commons images.

See also T218057: Determine workflow to selectively purge potentially privacy-sensitive EXIF fields, such as geocoordinates, from a Wikimedia Commons file and T222675: Explore possibilities for users to remove/exclude geo data from EXIF on images

Oct 27 2021, 8:07 AM · QTE-TestingOverview, MW-1.38-notes (1.38.0-wmf.9; 2021-11-16), Commons, Structured-Data-Backlog (Current Work), cloud-services-team (Kanban), Privacy Engineering
JeanFred added a comment to T218057: Determine workflow to selectively purge potentially privacy-sensitive EXIF fields, such as geocoordinates, from a Wikimedia Commons file.

Cross-linking T284941: [S] Add note explaining that EXIF geolocation metadata may be uploaded with Commons images.

Oct 27 2021, 8:06 AM · Privacy Engineering, Multimedia, Privacy, Commons, UploadWizard, MediaWiki-File-management

Oct 26 2021

JeanFred added a comment to T278156: WDQS timeout errors should be more gracefully handled.

Basically, a SPARQL timeout error is not something we can solve on integraalit. The issue lies with the underlying queries − either it’s misconfigured or just more likely too expensive (try making a dashboard of all scientific articles… ;-þ)

Oct 26 2021, 2:28 PM · Tool-inteGraality
JeanFred merged T236965: TimeoutError into T278156: WDQS timeout errors should be more gracefully handled.
Oct 26 2021, 2:25 PM · Tool-inteGraality
JeanFred merged task T236965: TimeoutError into T278156: WDQS timeout errors should be more gracefully handled.
Oct 26 2021, 2:25 PM · Tool-inteGraality
JeanFred merged T240726: Timeout error on InteGraality into T278156: WDQS timeout errors should be more gracefully handled.
Oct 26 2021, 2:25 PM · Tool-inteGraality
JeanFred merged task T240726: Timeout error on InteGraality into T278156: WDQS timeout errors should be more gracefully handled.
Oct 26 2021, 2:25 PM · Tool-inteGraality
JeanFred renamed T278156: WDQS timeout errors should be more gracefully handled from pywikibot.exceptions.TimeoutError to WDQS timeout errors should be more gracefully handled.
Oct 26 2021, 2:24 PM · Tool-inteGraality
JeanFred triaged T278156: WDQS timeout errors should be more gracefully handled as Medium priority.
Oct 26 2021, 2:24 PM · Tool-inteGraality

Oct 25 2021

JeanFred committed R2566:7e3343a5731d: Catch WDQS Timeouts and raise proper exception (authored by JeanFred).
Catch WDQS Timeouts and raise proper exception
Oct 25 2021, 11:16 PM
JeanFred committed R2566:977236b42dae: Raise ConfigException when using incorrect Column syntax (authored by JeanFred).
Raise ConfigException when using incorrect Column syntax
Oct 25 2021, 11:16 PM
JeanFred committed R2566:ef0f537565b4: Add unit test for the unsupported Aliases syntax (authored by JeanFred).
Add unit test for the unsupported Aliases syntax
Oct 25 2021, 11:16 PM
JeanFred committed R2566:c859c45affa2: Deprecate get_[qualifier|property]_info_no_grouping to use generalized queries (authored by JeanFred).
Deprecate get_[qualifier|property]_info_no_grouping to use generalized queries
Oct 25 2021, 11:16 PM
JeanFred committed R2566:5526cb378d58: Deprecate get_[qualifier|property]_info to use generalized queries (authored by JeanFred).
Deprecate get_[qualifier|property]_info to use generalized queries
Oct 25 2021, 11:16 PM
JeanFred committed R2566:3e4c2de25298: Deprecate get_totals_for_[qualifier|property] to use generalized queries (authored by JeanFred).
Deprecate get_totals_for_[qualifier|property] to use generalized queries
Oct 25 2021, 11:16 PM
JeanFred committed R2566:e940ae7f7c55: Reorganize tests in TestPropertyConfig in subclasses (authored by JeanFred).
Reorganize tests in TestPropertyConfig in subclasses
Oct 25 2021, 11:16 PM
JeanFred committed R2566:765b314f72a4: Move query methods from TextConfig to ColumnConfig in generalized form (authored by JeanFred).
Move query methods from TextConfig to ColumnConfig in generalized form
Oct 25 2021, 11:16 PM
JeanFred committed R2566:5dfef39f4d0c: Standardise naming and whitespace in SPARQL queries (authored by JeanFred).
Standardise naming and whitespace in SPARQL queries
Oct 25 2021, 11:16 PM
JeanFred added a comment to T292931: Manual update gets an error.

Since T284183 you should get a proper error message: Unknown column syntax 9732. The issue is you entered 9732, not P9732.

Oct 25 2021, 8:24 PM · Tool-inteGraality
JeanFred merged T292931: Manual update gets an error into T284183: Unsupported syntax in `columns` field results in uncaught `AttributeError` exception.
Oct 25 2021, 8:23 PM · Tool-inteGraality
JeanFred merged task T292931: Manual update gets an error into T284183: Unsupported syntax in `columns` field results in uncaught `AttributeError` exception.
Oct 25 2021, 8:23 PM · Tool-inteGraality

Sep 2 2021

JeanFred closed T290234: Add Armenia to the Wiki Loves Monuments 2021 as Resolved.
Sep 2 2021, 1:00 PM · Tool-wikiloves
JeanFred added a comment to T290234: Add Armenia to the Wiki Loves Monuments 2021.

Thanks for the report, and @Ashot1997 for the PR!

Sep 2 2021, 12:59 PM · Tool-wikiloves

Sep 1 2021

JeanFred added a comment to T289929: Statistics page falsely reports no monuments for some datasets.

This is however more problem of us calling the field "country" rather than the more correct "dataset".

Sep 1 2021, 10:42 AM · Wiki-Loves-Monuments-Database

Aug 11 2021

JeanFred added a comment to T278918: Switch heritage over to new replicas design.

@JeanFred Would you mind merging the patch?

Aug 11 2021, 3:28 PM · Wiki-Loves-Monuments-Database
JeanFred added a comment to T286354: Add India in English (on Commons) to database.

Aliases for parameters seem to be quite frequently used which I'm not sure the harvester supports (will dig into it unless @JeanFred remembers?)

Aug 11 2021, 3:25 PM · Wiki-Loves-Monuments (2021), Wiki-Loves-Monuments-Sources

Jul 19 2021

JeanFred closed T264301: WLM 2019 statistics is missing as Resolved.
Jul 19 2021, 11:17 AM · Tool-wikiloves
JeanFred closed T264217: Images with oversighted uploader name cause crash as Resolved.
Jul 19 2021, 11:17 AM · Tool-wikiloves
JeanFred added a comment to T286813: WLE portugal 2021 statistics page gives Country not found..

I restarted the webserver, it seems to work now: https://wikiloves.toolforge.org/earth/2021/Portugal

Jul 19 2021, 11:12 AM · Tool-wikiloves
JeanFred added a comment to T286813: WLE portugal 2021 statistics page gives Country not found..

Thanks for reporting!

Jul 19 2021, 11:12 AM · Tool-wikiloves

Jun 24 2021

JeanFred moved T284183: Unsupported syntax in `columns` field results in uncaught `AttributeError` exception from Backlog to Bugs on the Tool-inteGraality board.
Jun 24 2021, 2:29 PM · Tool-inteGraality
JeanFred moved T284684: Support for aliases from Backlog to Enhancements on the Tool-inteGraality board.
Jun 24 2021, 2:29 PM · Tool-inteGraality

Jun 23 2021

JeanFred committed R2566:591eec40184c: Optimize SPARQL queries by using COUNT(*) wherever possible (authored by JeanFred).
Optimize SPARQL queries by using COUNT(*) wherever possible
Jun 23 2021, 2:52 PM