Page MenuHomePhabricator
Feed Advanced Search

Sep 1 2018

Emijrp updated subscribers of T203303: Update stats for WLM 2018.

adding Dennis for that tool

Sep 1 2018, 4:02 PM · Wiki-Loves-Monuments (2018)
Emijrp closed T203303: Update stats for WLM 2018 as Resolved.

wlm-stats and wlm-maps are updated now. Regards!

Sep 1 2018, 11:50 AM · Wiki-Loves-Monuments (2018)

Oct 4 2017

Emijrp added a comment to T175300: OAuth token broken for OAuth file uploader.

I got the same error using Flickr2Commons, though apparently it is authenticated correctly.

Oct 4 2017, 8:34 PM · Tools

Sep 19 2017

Emijrp added a comment to T176110: Toolforge tool.heritage webservice keeps crashing.

Yes, it is ok now. Thanks.

Sep 19 2017, 9:25 AM · Toolforge, Wiki-Loves-Monuments-Database
Emijrp raised the priority of T176110: Toolforge tool.heritage webservice keeps crashing from Medium to High.

My map doesn't show any monuments https://tools.wmflabs.org/wlm-maps/ I guess this bug is related.

Sep 19 2017, 7:36 AM · Toolforge, Wiki-Loves-Monuments-Database

Aug 13 2017

Emijrp added a comment to T173269: Wikidata.org currently very slow.

Editing is very slow, edits aren't saved https://grafana.wikimedia.org/dashboard/db/wikidata-edits?refresh=1m&orgId=1&from=1502637379598&to=1502647684878

Aug 13 2017, 6:10 PM · Wikidata.org, DBA, SRE, Wikidata
Emijrp added a comment to T171263: Wikidata Dispatcher and Job Queue is overflowed.

Editing Wikidata is pretty slow for me now.

Aug 13 2017, 5:55 PM · User-Daniel, Wikidata-Former-Sprint-Board, Performance Issue, Wikidata.org, MediaWiki-extensions-WikibaseRepository, Wikidata

Aug 12 2017

Emijrp closed T173073: Tool "wlm-maps" loads tiles from OSM as Resolved.

I have fixed the tiles links. It should be ok now.

Aug 12 2017, 3:50 PM · Tools
Emijrp closed T173073: Tool "wlm-maps" loads tiles from OSM, a subtask of T172065: Hunt for Toolforge tools that load resources from third party sites, as Resolved.
Aug 12 2017, 3:50 PM · Privacy Engineering, Toolforge-standards-committee, Tools, Privacy

Aug 4 2017

Emijrp added a comment to T172395: Tool "commons-coverage" loads map tiles from OSM.

@Ricordisamoa Thanks. Then I think I don't have to use it in my code anymore.

Aug 4 2017, 7:42 AM · Tools

Aug 3 2017

Emijrp closed T172395: Tool "commons-coverage" loads map tiles from OSM as Resolved.

I have changed this in my code:

Aug 3 2017, 3:21 PM · Tools
Emijrp closed T172395: Tool "commons-coverage" loads map tiles from OSM, a subtask of T172065: Hunt for Toolforge tools that load resources from third party sites, as Resolved.
Aug 3 2017, 3:21 PM · Privacy Engineering, Toolforge-standards-committee, Tools, Privacy

Jul 29 2017

Emijrp added a comment to T171263: Wikidata Dispatcher and Job Queue is overflowed.

@Emijrp the point is that at least some people should have an eye on bot edits some time, otherwise nobody will notice when a bot goes wrong. Bot edits on wikidata should be marked as such on client wikis too (let me know if they are not), so people can filter them out. But skipping propagation alltogether would mean that wikidata bots effectively run unsupervised. That would not be good.

Now, if we need an emergency way to cut down the backlog, I agree that it's better to drop bot edits than to drop manual edits.

Jul 29 2017, 8:18 PM · User-Daniel, Wikidata-Former-Sprint-Board, Performance Issue, Wikidata.org, MediaWiki-extensions-WikibaseRepository, Wikidata
Emijrp added a comment to T171263: Wikidata Dispatcher and Job Queue is overflowed.

To avoid confusion: dispatch lag is the time that changes sit around before they go into the client wikis' job queue. The time they spent in the job queue is not the issue here! Changes "sit around" because finding the changes relevant for a given wiki, and pushing them to that wiki's job queue, takes time. We are dispatching changes to over 800 wikis.

In any case: one thing we could do is skip old changes. Changes older than a day are unlikely to be seen on the client wiki's recentchanges feed anyway. Or perhaps, instead of skipping, they could go to a slow propagation queue, so new changes are pushed out quickly, but "stale" changes still get propagated eventually.

Jul 29 2017, 6:10 PM · User-Daniel, Wikidata-Former-Sprint-Board, Performance Issue, Wikidata.org, MediaWiki-extensions-WikibaseRepository, Wikidata

Jul 28 2017

Emijrp added a comment to T171263: Wikidata Dispatcher and Job Queue is overflowed.

I think that the current dispatchlag growing is due to ResearchBot academic paper item creation. I say that because some days ago my bot was editing at 60 ed/min and ResearchBot was doing a similar rate. I stopped my bot for a few hours and the dispatchlag kept growing. So I concluded that it wasn't my fault. It is strange because ResearchBot creations aren't linked to any Wikipedia, but I am inclined to think that it is the current cause for lag raising.

Jul 28 2017, 6:12 PM · User-Daniel, Wikidata-Former-Sprint-Board, Performance Issue, Wikidata.org, MediaWiki-extensions-WikibaseRepository, Wikidata
Emijrp added a comment to T171263: Wikidata Dispatcher and Job Queue is overflowed.

Stalest wiki now more than one day behind again. Median is fine, but as the stalest wiki is enwiki, that’s not a great consolation.

Jul 28 2017, 1:33 PM · User-Daniel, Wikidata-Former-Sprint-Board, Performance Issue, Wikidata.org, MediaWiki-extensions-WikibaseRepository, Wikidata

Jul 21 2017

Emijrp added a comment to T171263: Wikidata Dispatcher and Job Queue is overflowed.

1 million queued jobs is absolutely normal. Problem lies somewhere else.

Jul 21 2017, 10:55 AM · User-Daniel, Wikidata-Former-Sprint-Board, Performance Issue, Wikidata.org, MediaWiki-extensions-WikibaseRepository, Wikidata
Emijrp added a comment to T171263: Wikidata Dispatcher and Job Queue is overflowed.

I don't know how many server resources are dedicated to Wikidata (CPU, memory, etc), but could be possible to increase them? Setting another job server?

Jul 21 2017, 10:24 AM · User-Daniel, Wikidata-Former-Sprint-Board, Performance Issue, Wikidata.org, MediaWiki-extensions-WikibaseRepository, Wikidata

Jul 17 2017

Emijrp added a comment to T170775: Feed Entity Suggester with ASCII equivalents of labels.

i leave this link here with a discussion about how a full version of this feature could be undesired https://www.wikidata.org/w/index.php?title=User_talk:Emijrp&oldid=522355148#Aliases_on_given_name

Jul 17 2017, 8:04 AM · Wikidata

Mar 24 2017

Emijrp created T161297: WARNING: API error modification-failed: Malformed input: قائمة ويكيميديا.
Mar 24 2017, 9:56 AM · Wikidata

Mar 7 2017

Emijrp added a comment to T159618: Job queue rising to nearly 3 million jobs.

@Esc3300 About 3 days (72 hours), at a roughly edit rate of 600 epm, I did 2.5 million edits, more or less. Just a note, my bot edits add descriptions in dozens of languages.[1] I don't know if that makes jobs difficult.

Mar 7 2017, 11:09 AM · Wikidata, MediaWiki-Core-JobQueue, SRE

Mar 6 2017

Emijrp added a comment to T159618: Job queue rising to nearly 3 million jobs.

Anything else we need to do here?

Mar 6 2017, 12:09 PM · Wikidata, MediaWiki-Core-JobQueue, SRE

Mar 5 2017

Emijrp added a comment to T159618: Job queue rising to nearly 3 million jobs.

Done. I added a put_throttle = 3 seconds. Anyway I think I will wait for the job queue to go down.

Mar 5 2017, 11:09 PM · Wikidata, MediaWiki-Core-JobQueue, SRE
Emijrp added a comment to T157803: Micro-contributions: translate images captions on Commons.

I did something like this back in 2007. My bot copied thumb descriptions from different Wikipedias into Commons.[1] That way you have a lot of work done, though having a review method is better.

Mar 5 2017, 8:28 AM · Microcontribution, Wikidata, SDC General
Emijrp added a comment to T159618: Job queue rising to nearly 3 million jobs.

All my bots follow the maxlag policy, as defined by default in Pywikibot user-config.py.

Mar 5 2017, 7:53 AM · Wikidata, MediaWiki-Core-JobQueue, SRE

Nov 8 2016

Emijrp added a comment to T149049: Create a chart showing percentage of new articles created each month that have not survived to the present.

@Neil_P._Quinn_WMF: Hmm, something doesn't add up here. According to @Emijrp's charts, enwiki editors create about 800-900 new articles a day, and they delete about 600-700 articles per day. Thus it seems the survival rate (currently) should be about 25%. Your chart above, however, shows a survival rate of about 75%. Somebody's statistics are way off.

Nov 8 2016, 9:49 AM · Contributors-Analysis

May 25 2016

Emijrp closed T136195: currentevents is using 248G in Tools as Resolved.

Hello! I just deleted all the files. Regards.

May 25 2016, 8:14 PM · Cloud-Services, Toolforge
Emijrp closed T136195: currentevents is using 248G in Tools, a subtask of T136212: Contact tool maintainters using large amounts of disk space, as Resolved.
May 25 2016, 8:14 PM · Goal, Toolforge, Cloud-Services

Oct 22 2015

Emijrp created T116286: Links broken for old English Wikipedia 2010-03-12 dumps.
Oct 22 2015, 3:34 PM · Datasets-General-or-Unknown

Sep 6 2015

Emijrp added a member for ArticlePlaceholder: Emijrp.
Sep 6 2015, 8:38 AM

Sep 3 2015

Emijrp added a comment to T111252: monuments_all table is missing.

Can you please update the database only handly?

Sep 3 2015, 12:33 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T111252: monuments_all table is missing.

There is something wrong in monuments_all again. SQL queries are sloooow and don't finish. In _tmp are OK.

Sep 3 2015, 12:29 PM · Wiki-Loves-Monuments-Database

Sep 2 2015

Emijrp added a comment to T111252: monuments_all table is missing.

There is a "monuments_all_tmp" table, btw.

Sep 2 2015, 9:29 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

@JeanFred The monuments_all table doesn't exist right now!

Sep 2 2015, 9:06 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

@JeanFred Can you change the Russian config from Wikipedia to Wikivoyage? https://phabricator.wikimedia.org/T110665

Sep 2 2015, 7:59 AM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

I don't see the Spain monuments in the map yet. https://tools.wmflabs.org/wlm-maps/#9/40.2387/-3.7189

Sep 2 2015, 7:48 AM · Wiki-Loves-Monuments-Database

Sep 1 2015

Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

I don't see the Spain monuments in the map yet. https://tools.wmflabs.org/wlm-maps/#9/40.2387/-3.7189

Sep 1 2015, 10:18 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

@Emijrp, do note that when/even if I manage to get these countries working as part of the full run, the issues listed in P1940 will persist (I’m thinking of the 277 missing primkeys)

Sep 1 2015, 4:11 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

Try changing line 482 in update_database.py from:

Sep 1 2015, 3:54 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

Where is the code for erfgoed bot? I want to check it.

Sep 1 2015, 3:45 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110497: Run a full update of the monuments database.
MariaDB [s51138__heritage_p]> select count(*) from monuments_all where lang='es' and country='es';
+----------+
| count(*) |
+----------+
|        0 |
+----------+
1 row in set (0.00 sec)
Sep 1 2015, 3:40 PM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110420: Harvesting of several countries does not work because of Namespace filtering issue.

So, the namespace error is fixed? What is the new error now? Which countries are affected?

Sep 1 2015, 7:08 AM · Wiki-Loves-Monuments-Database

Aug 31 2015

Emijrp created T110861: access.log files are not being updated.
Aug 31 2015, 7:20 AM · Toolforge, Cloud-Services

Aug 28 2015

Emijrp added a comment to P1940 ErfgoedBot run on 'es,es'.

I think that the bot tried to update this page but it failed https://commons.wikimedia.org/w/index.php?title=Commons:Monuments_database/Unknown_fields/monuments_es_%28es%29&action=history

Aug 28 2015, 10:34 AM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110497: Run a full update of the monuments database.

Yay! Is the bot still running? I see some points in Spain map, but there are still many gaps. For example, this list is not parsed yet https://es.wikipedia.org/wiki/Anexo:Bienes_de_inter%C3%A9s_cultural_de_la_Comunidad_de_Madrid

Aug 28 2015, 9:47 AM · Wiki-Loves-Monuments-Database

Aug 27 2015

Emijrp added a comment to T17552: API's list=recentchanges should have rcrelated parameter (provide Special:RelatedChanges/Special:RecentChangesLinked functionality via API).

Not solved yet?

Aug 27 2015, 10:04 AM · Developer-Wishlist (2017), MediaWiki-Action-API
Emijrp added a comment to T110497: Run a full update of the monuments database.

It fails with 102, 104... special namespaces. It seems that you have to add them into the family file in families directory?

Aug 27 2015, 9:54 AM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T110497: Run a full update of the monuments database.

Mainland Spain is still empty https://tools.wmflabs.org/wlm-maps/#7/37.182/-4.982

Aug 27 2015, 9:38 AM · Wiki-Loves-Monuments-Database
Emijrp added a comment to T105818: Port ErfgoedBot to Pywikibot-core .

I think that Spanish Wikipedia hasn't been updated. You can see data from pt, gl and ca, but not es https://tools.wmflabs.org/wlm-maps/#7/41.034/-4.872

Aug 27 2015, 7:59 AM · Wikimania-Hackathon-2015, Pywikibot-compat-to-core, Wiki-Loves-Monuments-Database