Page MenuHomePhabricator

awight (Adam Wight)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Oct 12 2014, 9:02 PM (371 w, 6 d)
Availability
Available
IRC Nick
awight
LDAP User
Awight
MediaWiki User
Adamw [ Global Accounts ]

WMDE Technical Wishes staff developer

Recent Activity

Fri, Nov 26

awight renamed T291120: Consistent and comprehensive event streams - Decision Statement Overview from Constant and comprehensive event streams - Decision Statement Overview to Consistent and comprehensive event streams - Decision Statement Overview.
Fri, Nov 26, 11:21 PM · Platform Engineering, Data-Engineering, Analytics, Event-Platform, tech-decision-forum
awight created T296556: Request creation of capacity-exchange VPS project.
Fri, Nov 26, 10:22 PM · Cloud-VPS (Project-requests)
awight updated the task description for T294339: Deploy versioned maps to the beta cluster.
Fri, Nov 26, 3:07 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight added a comment to T296465: VE template search bar should look like a search.

We might want to split this task or rename to focus on the follow-up work. The field now has a search indicator, which was the only "must-have" requirement in the original list.

Fri, Nov 26, 2:52 PM · MW-1.38-notes (1.38.0-wmf.11; 2021-11-30), Accessibility, Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, VisualEditor, WMDE-TechWish, VisualEditor-MediaWiki-Templates, WMDE-Templates-FocusArea
awight moved T296512: Merge maps revid varnish changes from Doing to Tech Review on the WMDE-TechWish-Sprint-2021-11-24 board.
Fri, Nov 26, 2:40 PM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight awarded T144187: Better handling for one-hit-wonder objects a Evil Spooky Haunted Tree token.
Fri, Nov 26, 1:54 PM · Traffic-Icebox, Performance-Team (Radar), Patch-For-Review, SRE
awight claimed T296512: Merge maps revid varnish changes.
Fri, Nov 26, 1:41 PM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight moved T296512: Merge maps revid varnish changes from Sprint Backlog to Doing on the WMDE-TechWish-Sprint-2021-11-24 board.
Fri, Nov 26, 1:41 PM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight placed T293905: Performance review of proposed Kartographer/Kartotherian revid support up for grabs.
Fri, Nov 26, 1:40 PM · Performance-Team, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish
awight moved T293905: Performance review of proposed Kartographer/Kartotherian revid support from Doing to Watching / Epic / Stalled on the WMDE-TechWish-Sprint-2021-11-24 board.
Fri, Nov 26, 1:40 PM · Performance-Team, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish
awight closed T293841: Estimate impact of our changes on production caches as Resolved.
Fri, Nov 26, 1:38 PM · WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea, WMDE-TechWish-Sprint-2021-10-13
awight closed T293841: Estimate impact of our changes on production caches, a subtask of T293843: Plan detailed migration for our revid / mapdata changes, as Resolved.
Fri, Nov 26, 1:38 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish, WMDE-GeoInfo-FocusArea
awight closed T293841: Estimate impact of our changes on production caches, a subtask of T293905: Performance review of proposed Kartographer/Kartotherian revid support, as Resolved.
Fri, Nov 26, 1:38 PM · Performance-Team, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish
awight updated the task description for T294339: Deploy versioned maps to the beta cluster.
Fri, Nov 26, 1:34 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight moved T296512: Merge maps revid varnish changes from Backlog to In sprint on the WMDE-GeoInfo-FocusArea board.
Fri, Nov 26, 1:32 PM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight renamed T293905: Performance review of proposed Kartographer/Kartotherian revid support from [stub] Performance review of proposed Kartographer/Kartotherian revid support to Performance review of proposed Kartographer/Kartotherian revid support.
Fri, Nov 26, 1:28 PM · Performance-Team, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish
awight claimed T293905: Performance review of proposed Kartographer/Kartotherian revid support.
Fri, Nov 26, 11:54 AM · Performance-Team, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish
awight placed T296512: Merge maps revid varnish changes up for grabs.

Moving back to the backlog. The guard condition is in a POC branch, ready for review.

Fri, Nov 26, 11:53 AM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight claimed T296512: Merge maps revid varnish changes.
Fri, Nov 26, 11:52 AM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight moved T296512: Merge maps revid varnish changes from Sprint Backlog to Doing on the WMDE-TechWish-Sprint-2021-11-24 board.
Fri, Nov 26, 11:12 AM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight created T296512: Merge maps revid varnish changes.
Fri, Nov 26, 11:11 AM · Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight closed T294735: Write Kartotherian tests for revid pass-through, a subtask of T293844: Merge "safe" revid changes to production, as Resolved.
Fri, Nov 26, 10:52 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish, WMDE-GeoInfo-FocusArea
awight closed T294735: Write Kartotherian tests for revid pass-through as Resolved.
Fri, Nov 26, 10:52 AM · WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish, WMDE-GeoInfo-FocusArea

Thu, Nov 25

awight added a comment to T296465: VE template search bar should look like a search.

Confirmed with Elisha that we want the full "SearchInputField" behavior including the clear action, if possible.

Thu, Nov 25, 2:59 PM · MW-1.38-notes (1.38.0-wmf.11; 2021-11-30), Accessibility, Patch-For-Review, WMDE-TechWish-Sprint-2021-11-24, VisualEditor, WMDE-TechWish, VisualEditor-MediaWiki-Templates, WMDE-Templates-FocusArea
awight updated the task description for T294339: Deploy versioned maps to the beta cluster.
Thu, Nov 25, 2:22 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-GeoInfo-FocusArea
awight updated the task description for T293844: Merge "safe" revid changes to production.
Thu, Nov 25, 2:16 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish, WMDE-GeoInfo-FocusArea
awight updated the task description for T293844: Merge "safe" revid changes to production.
Thu, Nov 25, 2:12 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish, WMDE-GeoInfo-FocusArea
awight added a comment to T291120: Consistent and comprehensive event streams - Decision Statement Overview.

I've "boldly" edited the title to reflect how I understand the consensus above. We aren't trying to shift the source of truth, the point is to make events more useful for external system and service integrations.

Thu, Nov 25, 11:46 AM · Platform Engineering, Data-Engineering, Analytics, Event-Platform, tech-decision-forum
awight renamed T291120: Consistent and comprehensive event streams - Decision Statement Overview from MediaWiki Events as Source of Truth - Decision Statement Overview to Constent and comprehensive event streams - Decision Statement Overview.
Thu, Nov 25, 11:45 AM · Platform Engineering, Data-Engineering, Analytics, Event-Platform, tech-decision-forum

Wed, Nov 24

awight renamed T296386: Measure potential performance regression between the old and new VE template dialog sidebar from Measure potential performance regression compared to the unchanged sidebar to Measure potential performance regression between the old and new VE template dialog sidebar.
Wed, Nov 24, 11:31 PM · WMDE-TechWish-Sprint-2021-11-24, VisualEditor, WMDE-Templates-FocusArea
awight renamed T296386: Measure potential performance regression between the old and new VE template dialog sidebar from Look into the performance regression compared to the unchanged sidebar to Measure potential performance regression compared to the unchanged sidebar.
Wed, Nov 24, 11:31 PM · WMDE-TechWish-Sprint-2021-11-24, VisualEditor, WMDE-Templates-FocusArea
awight moved T296386: Measure potential performance regression between the old and new VE template dialog sidebar from Sprint Backlog to Tech Review on the WMDE-TechWish-Sprint-2021-11-24 board.
Wed, Nov 24, 11:30 PM · WMDE-TechWish-Sprint-2021-11-24, VisualEditor, WMDE-Templates-FocusArea
awight added a comment to T296386: Measure potential performance regression between the old and new VE template dialog sidebar.

I took the extremely scientific approach of opening the dialog several times and recording how long it took. If anything, there's a small improvement rather than a regression. One follow-up detail to look at is that the dialog is never destroyed, so there might be some memory leakage or penalty for a previous dialog instance having lots of parameters.

Wed, Nov 24, 11:30 PM · WMDE-TechWish-Sprint-2021-11-24, VisualEditor, WMDE-Templates-FocusArea
awight added a comment to T294839: Add floating help button.

These are the messages to be customized on dewiki (as a local override, not as a general translation):

Wed, Nov 24, 12:30 PM · WMDE-TechWish-Sprint-2021-11-24, MW-1.38-notes (1.38.0-wmf.9; 2021-11-16), WMDE-TechWish-Sprint-2021-11-10, Unplanned-Sprint-Work, Patch-For-Review, VisualEditor, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish, VisualEditor-MediaWiki-Templates, WMDE-Templates-FocusArea
awight moved T284203: Deploy inline descriptions, extended sidebar and bigger dialog to small set of wikis from Sprint Backlog to Done on the WMDE-TechWish-Sprint-2021-11-10 board.
Wed, Nov 24, 12:12 PM · WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-TechWish, WMDE-Templates-FocusArea
awight moved T286992: Deploy VE template dialog improvements to small set of wikis from Sprint Backlog to Done on the WMDE-TechWish-Sprint-2021-11-10 board.
Wed, Nov 24, 12:12 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish

Tue, Nov 23

awight updated the task description for T293843: Plan detailed migration for our revid / mapdata changes.
Tue, Nov 23, 2:51 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish, WMDE-GeoInfo-FocusArea
awight closed T268576: Convert Translate to AbstractSchema as Resolved.
Tue, Nov 23, 8:49 AM · MW-1.38-notes (1.38.0-wmf.11; 2021-11-30), Technical-Debt, MediaWiki-extensions-Translate, Platform Team Initiatives (Abstract Schema)
awight closed T268576: Convert Translate to AbstractSchema, a subtask of T261912: Convert WMF Deployed Extensions to Abstract Schema, as Resolved.
Tue, Nov 23, 8:48 AM · Goal, Platform Team Initiatives (Abstract Schema)

Mon, Nov 22

awight added a comment to T286992: Deploy VE template dialog improvements to small set of wikis.

@awight For Tech News purposes, it would be good to know today – @Quiddity will deliver the newsletter in a few hours.

Mon, Nov 22, 7:18 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish
awight changed the status of T286992: Deploy VE template dialog improvements to small set of wikis from Stalled to Open.
Mon, Nov 22, 7:17 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish
awight changed the status of T284203: Deploy inline descriptions, extended sidebar and bigger dialog to small set of wikis from Stalled to Open.
Mon, Nov 22, 7:17 PM · WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-TechWish, WMDE-Templates-FocusArea
awight changed the status of T284203: Deploy inline descriptions, extended sidebar and bigger dialog to small set of wikis, a subtask of T286991: DRAFT: Deploy inline descriptions, extended sidebar and bigger dialog to all wikis, from Stalled to Open.
Mon, Nov 22, 7:17 PM · WMDE-TechWish, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea
awight moved T284203: Deploy inline descriptions, extended sidebar and bigger dialog to small set of wikis from Watching (Stalled / Epic) to Sprint Backlog on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 7:17 PM · WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-TechWish, WMDE-Templates-FocusArea
awight moved T286992: Deploy VE template dialog improvements to small set of wikis from Doing to Sprint Backlog on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 7:17 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish
awight moved T286992: Deploy VE template dialog improvements to small set of wikis from UX/PM Review to Doing on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 7:17 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish
awight moved T286992: Deploy VE template dialog improvements to small set of wikis from Watching (Stalled / Epic) to UX/PM Review on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 7:17 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish
awight updated subscribers of T295775: Estimate prevalence of mapframes in articles on each wiki.

@ECohen_WMDE @Sarai-WMDE Please pull the data from here again, there were some significant changes. Most importantly, the total number of maps is now bracketed by an upper and lower estimate. But I found that the upper estimate "upper_limit_mapframes" (direct search for "mapframe" in all pages) was usually lower than the number I had been calculating as the lower bound (now called "checksum_total_transclusions", adding together all hits for each template, meaning that we were double-counting), so you should take the minimum of these two columns. I've decided that proportion_map_pages will just be upper_limit_mapframes / wiki_size, to simplify our ranking.

Mon, Nov 22, 2:52 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight moved T294901: [Epic] Measure Kartographer frequency of use by wiki from Doing to Tech Review on the WMDE-TechWish-Sprint-2021-11-10 board.

Script should be tweaked:

Mon, Nov 22, 2:44 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Epic, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T294901: [Epic] Measure Kartographer frequency of use by wiki.

Script should be tweaked:

  • Search for "mapframe
  • Collect number of activeusers for each wiki
  • Retry each wiki 5 times with a backoff. Failures are preventing script completion.
Mon, Nov 22, 1:38 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Epic, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight moved T295602: Investigation: for how long does varnish keep kartotherian static images? from Tech Review to Doing on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 1:20 PM · WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea, Maps (Kartotherian)
awight changed the status of T284203: Deploy inline descriptions, extended sidebar and bigger dialog to small set of wikis from Open to Stalled.
Mon, Nov 22, 1:19 PM · WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-TechWish, WMDE-Templates-FocusArea
awight changed the status of T284203: Deploy inline descriptions, extended sidebar and bigger dialog to small set of wikis, a subtask of T286991: DRAFT: Deploy inline descriptions, extended sidebar and bigger dialog to all wikis, from Open to Stalled.
Mon, Nov 22, 1:19 PM · WMDE-TechWish, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea
awight moved T293843: Plan detailed migration for our revid / mapdata changes from Sprint Backlog to Tech Review on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 1:18 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish, WMDE-GeoInfo-FocusArea
awight renamed T293843: Plan detailed migration for our revid / mapdata changes from [stub] Plan detailed migration for our revid / mapdata changes to Plan detailed migration for our revid / mapdata changes.
Mon, Nov 22, 1:16 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish-Sprint-2021-10-13 , WMDE-TechWish, WMDE-GeoInfo-FocusArea
awight renamed T294901: [Epic] Measure Kartographer frequency of use by wiki from Measure Kartographer frequency of use by wiki to [Epic] Measure Kartographer frequency of use by wiki.
Mon, Nov 22, 1:16 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Epic, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight moved T294901: [Epic] Measure Kartographer frequency of use by wiki from Sprint Backlog to Watching (Stalled / Epic) on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 1:16 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Epic, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight moved T295602: Investigation: for how long does varnish keep kartotherian static images? from Doing to Tech Review on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 22, 1:16 PM · WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea, Maps (Kartotherian)
awight changed the status of T286992: Deploy VE template dialog improvements to small set of wikis from Open to Stalled.
Mon, Nov 22, 12:25 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish
awight added a comment to T286992: Deploy VE template dialog improvements to small set of wikis.

@JStrodt_WMDE @Lena_WMDE @Quiddity Wednesday's deployment is in jeopardy due to a production bug T296098, which caused the train to be rolled back last week. We can either wait to see whether the bug is fixed and the train released, or we can postpone until next week.

Mon, Nov 22, 12:24 PM · User-notice, WMDE-TechWish-Sprint-2021-11-10, Dagbani-Sites, VisualEditor-MediaWiki-Templates, VisualEditor, WMDE-Templates-FocusArea, WMDE-TechWish
awight set the point value for T295775: Estimate prevalence of mapframes in articles on each wiki to 3.
Mon, Nov 22, 10:06 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight updated the task description for T295775: Estimate prevalence of mapframes in articles on each wiki.
Mon, Nov 22, 10:06 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight updated the task description for T295775: Estimate prevalence of mapframes in articles on each wiki.
Mon, Nov 22, 9:09 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea

Thu, Nov 18

awight added a comment to T295775: Estimate prevalence of mapframes in articles on each wiki.

Starting to look better. I'm slightly supicious that enwikivoyage is only showing 0.09 maps per page, but scientifically clicking "random page" a couple-o-times makes this seem plausible at least.

Thu, Nov 18, 10:08 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295775: Estimate prevalence of mapframes in articles on each wiki.

We can search for mapframe in the rendered page output, at the same time as checking hastemplate:. This should reject the false positives.

Thu, Nov 18, 9:59 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight moved T295775: Estimate prevalence of mapframes in articles on each wiki from Doing to Tech Review on the WMDE-TechWish-Sprint-2021-11-10 board.

Preliminary output: https://gitlab.com/wmde/search-mapframe-insource/-/tree/with-output/out

Thu, Nov 18, 9:45 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295775: Estimate prevalence of mapframes in articles on each wiki.

The mapframe tag is emitted by Lua code in some cases, notably in wikivoyage Module:Map. Matching 'mapframe' as well as <mapframe seemed to catch these. Sample data from en.wikivoyage.org:

usage_count	url
0	https://en.wikivoyage.org/wiki/Module:Map/sandbox
0	https://en.wikivoyage.org/wiki/Module:Map/sandbox2
0	https://en.wikivoyage.org/wiki/Module:Sandbox/Matroc/Inapoly
0	https://en.wikivoyage.org/wiki/Module:Sandbox/Matroc/Inapoly/doc
24973	https://en.wikivoyage.org/wiki/Module:Map
0	https://en.wikivoyage.org/wiki/Module:Mapdraw
0	https://en.wikivoyage.org/wiki/Module:Sandbox/Matroc/Mapdraw
0	https://en.wikivoyage.org/wiki/Module:Sandbox/Matroc
0	https://en.wikivoyage.org/wiki/Module:Mapdraw/doc
0	https://en.wikivoyage.org/wiki/Module:Sandbox/Wrh2
0	https://en.wikivoyage.org/wiki/Module:Sandbox/Matroc/Mapdraw2
Thu, Nov 18, 7:46 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea

Wed, Nov 17

awight placed T295775: Estimate prevalence of mapframes in articles on each wiki up for grabs.
Wed, Nov 17, 4:19 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295775: Estimate prevalence of mapframes in articles on each wiki.

I think output can be a single CSV with total counts from each wiki, then a directory full of JSON files detailing template names and counts, one file for each wiki. Templates should be listed as a title but also as a link for convenient clicking.

Wed, Nov 17, 4:19 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295775: Estimate prevalence of mapframes in articles on each wiki.

Basic queries are ready, the remaining work is to output in a reasonable way and parallelize if the run time is too long. Sample results:

Wed, Nov 17, 4:17 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight updated the task description for T295775: Estimate prevalence of mapframes in articles on each wiki.
Wed, Nov 17, 1:59 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295675: Investigate static map image request log for usable data.

Major gap in what we've done so far: dynamic maps cause a large number of tile loads, which would have been picked up in the above metrics as "static map load with no overlays"

Wed, Nov 17, 1:50 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight claimed T295775: Estimate prevalence of mapframes in articles on each wiki.

Looking at this for half an hour...

Wed, Nov 17, 10:25 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295775: Estimate prevalence of mapframes in articles on each wiki.

@ECohen_WMDE my answer was a bit scattered yesterday, but we might not be able to postpone the template search if we want to understand the number of maps on pages—it seems like this is the only way to count the transcluded maps? I don't expect this to be a huge additional effort, if that's the concern.

Wed, Nov 17, 7:31 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea

Tue, Nov 16

awight added a comment to T295775: Estimate prevalence of mapframes in articles on each wiki.

I feel like this ticket maybe goes a bit beyond that?

Tue, Nov 16, 2:28 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight created T295775: Estimate prevalence of mapframes in articles on each wiki.
Tue, Nov 16, 2:06 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight updated the task description for T295602: Investigation: for how long does varnish keep kartotherian static images?.
Tue, Nov 16, 1:32 PM · WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea, Maps (Kartotherian)
awight placed T295675: Investigate static map image request log for usable data up for grabs.
Tue, Nov 16, 1:02 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight updated the task description for T295675: Investigate static map image request log for usable data.
Tue, Nov 16, 1:02 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295675: Investigate static map image request log for usable data.

Putting together some of the above to get a granular look,

with map_request as (
    select
        coalesce(
            url_extract_parameter(concat('http://bla.org/woo/', uri_query), 'domain'),
            nullif(regexp_replace(url_extract_host(referer), '\.m'), ''),
            'unknown'
        ) as normalized_host,
        regexp_like(url_extract_host(referer), '\.m\.') as is_mobile,
        url_extract_parameter(concat('http://bla.org/woo/', uri_query), 'title') as title,
        url_extract_parameter(concat('http://bla.org/woo/', uri_query), 'title') != '' as has_mapdata
    from webrequest
    where
        uri_host = 'maps.wikimedia.org'
        and regexp_like(uri_path, 'osm.*png$')
        and not regexp_like(http_status, '4..')
        and year = 2021
        and month = 11
        and day = 1
        and hour = 1
),
Tue, Nov 16, 12:03 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295675: Investigate static map image request log for usable data.

While we're here, let's see how many requests come from mobile web vs. desktop web:

select
  count(*) as sample_size,
  regexp_like(url_extract_host(referer), '\.m\.') as is_mobile
from webrequest
WHERE 
  uri_host = 'maps.wikimedia.org'
  and year = 2021
  and month = 11
  and day = 1
  and hour = 1
group BY 
  regexp_like(url_extract_host(referer), '\.m\.')
;
Tue, Nov 16, 10:09 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T291120: Consistent and comprehensive event streams - Decision Statement Overview.

which becomes problematic if a revision is deleted

If it is deleted without a corresponding revision-delete state change event, that is problematic. Otherwise, fine, no?

Tue, Nov 16, 1:13 AM · Platform Engineering, Data-Engineering, Analytics, Event-Platform, tech-decision-forum

Mon, Nov 15

awight added a comment to T295675: Investigate static map image request log for usable data.

While we're here, let's see how many requests come from mobile web vs. desktop web:

select
  count(*) as sample_size,
  regexp_like(url_extract_host(referer), '\.m\.') as is_mobile
from webrequest
WHERE 
  uri_host = 'maps.wikimedia.org'
  and year = 2021
  and month = 11
  and day = 1
  and hour = 1
group BY 
  regexp_like(url_extract_host(referer), '\.m\.')
;
Mon, Nov 15, 11:22 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight removed a project from T294905: Shortcut to add a template conflicts with existing VE RTL shortcut: Patch-For-Review.
Mon, Nov 15, 11:14 PM · WMDE-TechWish-Sprint-2021-11-24, MW-1.38-notes (1.38.0-wmf.11; 2021-11-30), Patch-For-Review, WMDE-TechWish-Sprint-2021-11-10, WMDE-Templates-FocusArea, VisualEditor, WMDE-TechWish-Sprint-2021-10-27
awight added a comment to T291120: Consistent and comprehensive event streams - Decision Statement Overview.

Just following up because I may have been wrong to introduce the idea of "a" source of truth above. I did this to try to show where the confusion in this task is coming from, but it's important to note that "single source of truth" has a very strict definition, if we had a SSOT it would be the MediaWiki primary database and there are no other sources of truth. For example, if you want to make an update it must be to this database, not in an event stream, etc.

Mon, Nov 15, 3:23 PM · Platform Engineering, Data-Engineering, Analytics, Event-Platform, tech-decision-forum
awight added a comment to T295675: Investigate static map image request log for usable data.

Digging into the huge number of requests with no domain parameter (in other words, not map image requests):

select
  count(*) as sample_size,
  regexp_like(uri_path, 'osm.*png$') as is_map
from webrequest
WHERE 
  uri_host = 'maps.wikimedia.org'
  and year = 2021
  and month = 11
  and day = 1
  and hour = 1
  and url_extract_parameter(concat('http://bla.org/woo/', uri_query), 'domain') is null
group BY 
  regexp_like(uri_path, 'osm.*png$')
;
Mon, Nov 15, 12:55 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295675: Investigate static map image request log for usable data.

Unique titles requested for each wiki, over a random 24-hour period:

select
  count(*) as sample_size,
  url_extract_parameter(concat('http://bla.org/woo/', uri_query), 'domain') as domain,
  count(distinct url_extract_parameter(concat('http://bla.org/woo/', uri_query), 'title')) as unique_titles
from webrequest
WHERE 
  uri_host = 'maps.wikimedia.org'
  and year = 2021
  and month = 11
  and day = 1
--  and hour = 1
group BY 
  url_extract_parameter(concat('http://bla.org/woo/', uri_query), 'domain')
order by
  unique_titles desc
;
Mon, Nov 15, 11:28 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295675: Investigate static map image request log for usable data.

Performance stats:

select
  count(*) as sample_size,
  cache_status,
  approx_percentile(time_firstbyte, 0.50) as time_firstbyte_p50,
  approx_percentile(time_firstbyte, 0.70) as time_firstbyte_p70,
  approx_percentile(time_firstbyte, 0.95) as time_firstbyte_p95  
from webrequest
WHERE 
  uri_host = 'maps.wikimedia.org'
  and year = 2021
  and month = 11
  and day = 1
  and hour = 1
group BY 
  cache_status;

-> truncated for clarity:

95751	int-front	0.0001	0.0001	0.0002
1060387	hit-front	0.0002	0.0002	0.0003
542485	hit-local	0.0012	0.0039	1.9999
49256	pass		0.1681	0.2514	3.0624
551351	miss		0.3021	0.4873	3.1874
Mon, Nov 15, 11:09 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T295675: Investigate static map image request log for usable data.

First pass:

select
  count(*) as sample_size,
  histogram(cache_status),
  histogram(http_status),
  histogram(access_method),
  histogram(agent_type)
from webrequest
WHERE 
  uri_host = 'maps.wikimedia.org'
  and year = 2021
  and month = 11
  and day = 1
  and hour = 1;
Mon, Nov 15, 11:03 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T294901: [Epic] Measure Kartographer frequency of use by wiki.

Random note from a discussion about instrumentation: we're interested in how often users click a static map image to launch the dynamic, full-screen mode.

Mon, Nov 15, 10:19 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Epic, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight claimed T295675: Investigate static map image request log for usable data.
Mon, Nov 15, 10:16 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight moved T295363: Explore mapdata API log to estimate prevalence of maps and usage from Sprint Backlog to Tech Review on the WMDE-TechWish-Sprint-2021-11-10 board.
Mon, Nov 15, 10:16 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea
awight added a comment to T295363: Explore mapdata API log to estimate prevalence of maps and usage.

Remaining questions are moved to T295675.

Mon, Nov 15, 10:16 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea
awight updated the task description for T295363: Explore mapdata API log to estimate prevalence of maps and usage.
Mon, Nov 15, 10:15 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea
awight updated the task description for T295363: Explore mapdata API log to estimate prevalence of maps and usage.
Mon, Nov 15, 10:15 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea
awight created T295675: Investigate static map image request log for usable data.
Mon, Nov 15, 10:15 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, Maps (Kartographer), WMDE-GeoInfo-FocusArea
awight added a comment to T265615: Terminating MySQL takes several minutes in (Wikibase?) CI jobs.

This is just a walk-by comment so feel free to ignore, but didn't we have a nearly identical issue last year, and the solution was to put all these little files in a tmpfs which could simply be unmounted when the container is destroyed? If this sounds like something to pursue, I could track down the details...

Mon, Nov 15, 9:59 AM · Patch-For-Review, Release-Engineering-Team (CI & Testing services), Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Continuous-Integration-Infrastructure, Wikidata, Quibble

Sun, Nov 14

awight added a comment to T295363: Explore mapdata API log to estimate prevalence of maps and usage.

Sample of distribution across wikis, from Nov 1, from 1-2am UTC (N=131997): P17738

@awight What is this showing? Is this already enough to point to wikis with frequent Kartographer views? For example ja.wiki seems to really stand out as a high number, though de wikivoyage is really low. So maybe I'm misinterpreting this or shouldn't be looking at this number at all? Sorry if these questions are premature.

Sun, Nov 14, 7:48 AM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea

Fri, Nov 12

awight added a comment to T294839: Add floating help button.

It turns out the position of the close button is always on the left in OOUI. I had to remove the CSS hack that moved it to the right because that caused other style problems.

Fri, Nov 12, 6:54 PM · WMDE-TechWish-Sprint-2021-11-24, MW-1.38-notes (1.38.0-wmf.9; 2021-11-16), WMDE-TechWish-Sprint-2021-11-10, Unplanned-Sprint-Work, Patch-For-Review, VisualEditor, WMDE-TechWish-Sprint-2021-10-27, WMDE-TechWish, VisualEditor-MediaWiki-Templates, WMDE-Templates-FocusArea
awight placed T295363: Explore mapdata API log to estimate prevalence of maps and usage up for grabs.
Fri, Nov 12, 2:48 PM · WMDE-TechWish-Sprint-2021-11-24, WMDE-TechWish-Sprint-2021-11-10, WMDE-GeoInfo-FocusArea