bearND (Bernd Sitzmann)
Reading Infrastructure Services dev

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Nov 19 2014, 8:27 PM (139 w, 3 d)
Availability
Available
IRC Nick
bearND
LDAP User
BearND
MediaWiki User
Unknown

Recent Activity

Fri, Jul 21

bearND added a comment to T170690: Extract a References JSON API.

@Fjalapeno sure, np.

Fri, Jul 21, 9:07 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T170690: Extract a References JSON API.

@Fjalapeno Yes, we can.

Fri, Jul 21, 8:59 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T170690: Extract a References JSON API.

After chatting with @Fjalapeno I agree that the return trip (JSON to HTML) is not necessary since most clients would try to display the reflist content in (native or web) components. There is the option of structuring the reference content further but that is not needed at this time.
So, a separate library for reflist handling is not needed. It can be done directly inside of MCS/PCS.
We don't want to rely on the backlink counter alone, though, since that would increase the burden on clients to piece them back together and the data savings is not significant enough to warrant this complexity.

Fri, Jul 21, 5:50 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T170690: Extract a References JSON API.

What reconstruction? What are clients inserting into the DOM?

Fri, Jul 21, 12:33 AM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)

Thu, Jul 20

bearND added a comment to T170878: Audit users and account expiry dates for stat boxes.

In the past life as an Android app dev I used EL quite regularly. Now in Reading Infrastructure I haven't had the need yet but it could be coming. Either way is fine with me for now. If access gets removed and I need it later, I'll ask for it.

Thu, Jul 20, 9:00 PM · Patch-For-Review, Analytics-Kanban, Analytics-Cluster
bearND added a comment to T162219: Parentheticals: Words incorrectly concatenated due to too simple removing of spaces.

Fixing this is a good step in the right direction. FWIW, in this case I think keeping the parentheses would be preferable since it's to better clarify the following noun. I know that this is hard to determine programmatically. Having said that, editors could also just remove the parentheses from in der (Rechts-)Nachfolge to make it in der Rechtsnachfolge if it is really important enough.

Thu, Jul 20, 8:25 PM · Reading-Web-Backlog, Page-Previews
bearND added a comment to T170690: Extract a References JSON API.

Before gzip it's around 100 bytes per backlink. Assuming that most references only have one backlink, on the Barack_Obama page with almost 500 references it would be roughly 50KB before gzip theoretically. With gzip it's actually only 3KB.
The reconstruction would be part of the library we need for the roundtrip HTML -> JSON -> HTML. Either way the client would get HTML text blocks which it would insert into the DOM using that library.

Thu, Jul 20, 8:12 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND awarded T171065: Expose disambiguation property (ppprop=disambiguation) in mobileview api a Like token.
Thu, Jul 20, 7:28 PM · MobileFrontend, Reading-Web-Backlog
bearND moved T151241: Surface disambiguation page flag in response from To Do to To Deploy on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Thu, Jul 20, 6:21 PM · Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Reading-Web-Backlog (Tracking), MobileFrontend, Mobile-Content-Service
bearND assigned T151241: Surface disambiguation page flag in response to Jdlrobson.
Thu, Jul 20, 6:20 PM · Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Reading-Web-Backlog (Tracking), MobileFrontend, Mobile-Content-Service
bearND moved T151241: Surface disambiguation page flag in response from Backlog to Kanban on the Reading-Infrastructure-Team-Backlog board.
Thu, Jul 20, 6:17 PM · Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Reading-Web-Backlog (Tracking), MobileFrontend, Mobile-Content-Service

Wed, Jul 19

bearND added a comment to T170690: Extract a References JSON API.

Ok, that makes sense to me. You're right, the duplication is probably is not a big deal for the reference lists in infobox or other earlier cases in the article.
How do we distinguish in code between the two cases? Only by where the sections is relative to the end of the article? Or was there anything else we could go by?

Wed, Jul 19, 9:23 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T170581: Determine if the PCS needs to perform HTML transformations in a separate layer.

@Fjalapeno Ah, I see. Yes, that makes sense.

Wed, Jul 19, 8:58 PM · Services (designing), wikimedia-page-library, Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T170690: Extract a References JSON API.

@Fjalapeno

If T152540 is approved, can we switch our sectioning logic to use the HTML 5 sections?

Wed, Jul 19, 8:57 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T114072: <section> tags for MediaWiki sections.

@bearND any other use cases for the MCS/Apps that I missed?

Wed, Jul 19, 8:33 PM · Reading Epics (Platform JS CSS and HTML consolidation), Services (blocked), RfC, Parsing-Team, Accessibility, ArchCom-RfC, RESTBase, Patch-For-Review, Parsoid, MediaWiki-Parser, MediaWiki-Interface
bearND added a comment to T170581: Determine if the PCS needs to perform HTML transformations in a separate layer.

Isn't lazy image loading already in the Page Library?

Wed, Jul 19, 7:54 PM · Services (designing), wikimedia-page-library, Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T170690: Extract a References JSON API.
"anchor": "Notes",
"line": "Notes",

Whats the difference between anchor and line?

Wed, Jul 19, 5:41 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T170690: Extract a References JSON API.

Here's a strawman proposal for the JSON structure build from the following HTML example:

Wed, Jul 19, 4:47 AM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban)

Mon, Jul 17

bearND added a comment to T170294: Question: Do clients prefer to have references as structured data in order to build more useful UIs (rather than just showing a bunch of references at the bottom of the page).

Sounds to me that we should have a page-reference-list library which can got from HTML to JSON and back.

Mon, Jul 17, 8:58 PM · Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service
bearND moved T167921: Support Lazy load reference lists from To Do to Blocked on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jul 17, 8:36 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API
bearND awarded T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore a Pterodactyl token.
Mon, Jul 17, 8:35 PM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND moved T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore from Kanban to Tracking on the Reading-Infrastructure-Team-Backlog board.
Mon, Jul 17, 8:35 PM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND moved T168583: Update mediawiki-title in MCS from To Do to To Deploy on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jul 17, 8:33 PM · Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND moved T168583: Update mediawiki-title in MCS from Backlog to Kanban on the Reading-Infrastructure-Team-Backlog board.
Mon, Jul 17, 8:33 PM · Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND added a comment to T168583: Update mediawiki-title in MCS.

Fixed in https://gerrit.wikimedia.org/r/#/c/365364/ (already merged). I was not aware of this ticket when I created the patch. lol
FYI, not that it makes really a difference in terms of API, I bumped it to 0.6.3.

Mon, Jul 17, 8:33 PM · Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND added a comment to T164098: Enable snake_case linting on eslint.

What about JSON responses?

Mon, Jul 17, 8:28 PM · Mobile-Content-Service, RESTBase, Reading-Infrastructure-Team-Backlog
bearND moved T170225: OnThisDay endpoint skips AD years from Code Review to Deployed on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jul 17, 8:15 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service
bearND moved T158128: Deprecate and delete mobile-text endpoint from To Deploy to Deployed on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jul 17, 8:13 PM · Services (done), Reading-Infrastructure-Team-Backlog (Kanban), User-mobrovac, RESTBase-API, Mobile-Content-Service
bearND moved T169930: MCS requests content from RESTBase using non-normalized titles from To Deploy to Deployed on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jul 17, 8:13 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND added a comment to T114072: <section> tags for MediaWiki sections.

I believe that implementation captures everything we need for the Page Content Service (@bearND can you confirm?)

Mon, Jul 17, 4:47 PM · Reading Epics (Platform JS CSS and HTML consolidation), Services (blocked), RfC, Parsing-Team, Accessibility, ArchCom-RfC, RESTBase, Patch-For-Review, Parsoid, MediaWiki-Parser, MediaWiki-Interface
bearND added a comment to T164033: Test size of "Reading stripped" HTML vs non-stripped HTML.

Yes, sounds like a plan. I was just a bit surprised to see that the savings don't get close to adding up. My explanation for this is that the transforms for stripping the unneeded markup heavily strip the reference list content. There's still one included which I'll have to take out: stripping of ref back links. For the Android app we remove them but for the web case I think we would want to preserve them.

Mon, Jul 17, 4:12 PM · Page Content Service, Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Reading Epics (Platform JS CSS and HTML consolidation), Services (designing), RESTBase-API

Fri, Jul 14

bearND added a comment to T164033: Test size of "Reading stripped" HTML vs non-stripped HTML.

Here's a summary of the payload sizes I measured. The spreadsheet compares the gzipped (-6) payloads: plain Parsoid against various MCS/PCS read-html variants: no stripping, just stripping of unneeded markup, just stripping of reference lists, stripping both.

Fri, Jul 14, 9:38 PM · Page Content Service, Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Reading Epics (Platform JS CSS and HTML consolidation), Services (designing), RESTBase-API
bearND added a comment to T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore.

@Arlolra should we reopen this or create a new subtask?

Fri, Jul 14, 8:22 PM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND added a comment to T164033: Test size of "Reading stripped" HTML vs non-stripped HTML.

Here's a spreadsheet with the results against the top monthly titles in enwiki and zhwiki.

Fri, Jul 14, 6:24 PM · Page Content Service, Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Reading Epics (Platform JS CSS and HTML consolidation), Services (designing), RESTBase-API
bearND updated the task description for T170548: nodejs 6.11.
Fri, Jul 14, 5:46 PM · Services (doing), User-mobrovac, Operations
bearND added a comment to T170548: nodejs 6.11.

All tests pass in mobileapps.

Fri, Jul 14, 5:45 PM · Services (doing), User-mobrovac, Operations
bearND moved T170325: Bring back pronunciation tests from Doing to Blocked on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Fri, Jul 14, 5:30 AM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore.

Thanks. My Frankenstein page get the working audio link now.

Fri, Jul 14, 5:04 AM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND moved T167921: Support Lazy load reference lists from Doing to To Do on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Fri, Jul 14, 4:25 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API
bearND moved T170325: Bring back pronunciation tests from Blocked to Doing on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Fri, Jul 14, 4:24 AM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)

Wed, Jul 12

bearND closed T170225: OnThisDay endpoint skips AD years as Resolved.
Wed, Jul 12, 8:18 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service
bearND closed T169930: MCS requests content from RESTBase using non-normalized titles as Resolved.
Wed, Jul 12, 8:17 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND added a comment to T164033: Test size of "Reading stripped" HTML vs non-stripped HTML.

The bulk of the space-saving transformations comes from https://github.com/wikimedia/mediawiki-services-mobileapps/blob/master/lib/transforms.js#L193-L268.

Wed, Jul 12, 3:50 PM · Page Content Service, Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Reading Epics (Platform JS CSS and HTML consolidation), Services (designing), RESTBase-API
bearND added a comment to T169277: Investigate missing page in specific "On this day" event.

@Mhurd The issue is that isAnchorNotForYear() filters out the anchor ./2008_Karmah_Bombing because it's starting with the same number as the year of the event.

Wed, Jul 12, 2:39 AM · Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Wikipedia-iOS-App-Backlog

Tue, Jul 11

bearND moved T169930: MCS requests content from RESTBase using non-normalized titles from Code Review to To Deploy on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 11:23 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND moved T170325: Bring back pronunciation tests from To Do to Blocked on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 11:23 PM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND claimed T170325: Bring back pronunciation tests.
Tue, Jul 11, 8:26 PM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND created T170325: Bring back pronunciation tests.
Tue, Jul 11, 8:25 PM · Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban)
bearND moved T169299: Mobileapps swagger spec is broken (no pronounciation for `page/mobile-sections-lead` endpoints) from Doing to Deployed on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 8:24 PM · Services (done), Parsoid, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Operations
bearND moved T169930: MCS requests content from RESTBase using non-normalized titles from Doing to Code Review on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 8:11 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND added a comment to T169930: MCS requests content from RESTBase using non-normalized titles.

@Pchelolo Yep. I would have happily concurred with you until I read this:

Tue, Jul 11, 8:04 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND added a comment to T169930: MCS requests content from RESTBase using non-normalized titles.

I believe the issue is really that it uses normalized titles when it should be using db titles (getPrefixedDBKey) instead. (Underscores instead of spaces)

Tue, Jul 11, 7:59 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND moved T169930: MCS requests content from RESTBase using non-normalized titles from To Do to Doing on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 7:50 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND added a project to T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore: Wikipedia-Android-App-Backlog.

@Arlora. Oh, ok. I didn't know you had a different policy in Parsoid land. How do you get SAL to mark this as deployed? Might be good for me to do as well.

Tue, Jul 11, 5:35 PM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND moved T168875: Remove references from HTML payload from Doing to Code Review on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 5:20 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API
bearND moved T170225: OnThisDay endpoint skips AD years from Doing to Code Review on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 5:19 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service
bearND reopened T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore as "Open".

Probably best to keep this open until this is deployed.

Tue, Jul 11, 4:03 PM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND added a comment to T169761: Review Summary 2.0 Spec.

Thanks for explanation of the wikidata case. That makes sense now.

Tue, Jul 11, 4:02 PM · Reading Epics (Page Previews), Reading-Web-Backlog (Tracking), Reading-Infrastructure-Team-Backlog (Kanban)
bearND moved T170225: OnThisDay endpoint skips AD years from To Do to Doing on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Tue, Jul 11, 3:56 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service
bearND moved T169930: MCS requests content from RESTBase using non-normalized titles from Needs triage to Kanban on the Reading-Infrastructure-Team-Backlog board.
Tue, Jul 11, 3:56 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Services (watching), Mobile-Content-Service
bearND moved T170225: OnThisDay endpoint skips AD years from Needs triage to Kanban on the Reading-Infrastructure-Team-Backlog board.
Tue, Jul 11, 3:55 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service
bearND claimed T170225: OnThisDay endpoint skips AD years.
Tue, Jul 11, 3:55 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service
bearND created T170225: OnThisDay endpoint skips AD years.
Tue, Jul 11, 3:54 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service
bearND added a comment to T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore.

@Arlolra I see you have closed this ticket. Has this been deployed yet? https://en.wikipedia.org/api/rest_v1/page/html/User%3ABSitzmann_(WMF)%2FMCS%2FTest%2FFrankenstein still shows the Sound link pointing to the png instead of the ogg file.

Tue, Jul 11, 2:22 AM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid

Mon, Jul 10

bearND added a comment to T169761: Review Summary 2.0 Spec.

The advantage of keeping this separate is that clients can chose which endpoint they want to use: summary vs read-html vs mobile-sections ... , or build a talk page or other namespaced URL.

Mon, Jul 10, 5:53 PM · Reading Epics (Page Previews), Reading-Web-Backlog (Tracking), Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T169761: Review Summary 2.0 Spec.

See the second comment in T164291#3253776. Having just re-read it though, I'm guess we don't want to URL-encode the namespace part. I'll retract the requirement for now until that's clarified.

Mon, Jul 10, 5:19 PM · Reading Epics (Page Previews), Reading-Web-Backlog (Tracking), Reading-Infrastructure-Team-Backlog (Kanban)
bearND added a comment to T169761: Review Summary 2.0 Spec.
  • The title property in most other places is not URL-encoded. I have not seen anything in T164291 to indicate that this should change. Example: https://commons.wikimedia.org/api/rest_v1/page/summary/File%3ACollage_of_Nine_Dogs.jpg should be File:Collage_of_Nine_Dogs.jpg but not File%3ACollage_of_Nine_Dogs.jpg. I think it probably doesn't hurt (need to check with the apps to be sure) but wanted to point out that this is a new thing.
  • plaintext_intro is a new property that the apps don't use yet and an alternative to the HTML version of intro the web is going to use. I'm not sure if this is needed if we don't have any actual users for this property.
  • Isn't wikidata_label usually the same as normalized_title? What is it going to be used for? When would it be different from normalized_title? If this is only set for Wikidata then that's fine. I just haven't seen anything that says that explicitly.
  • The Image type properties (thumbnail and original) are likely going to change in the future to use the new Thumbnail API once that is available (see T66214).
Mon, Jul 10, 4:41 PM · Reading Epics (Page Previews), Reading-Web-Backlog (Tracking), Reading-Infrastructure-Team-Backlog (Kanban)
bearND updated the task description for T169761: Review Summary 2.0 Spec.
Mon, Jul 10, 3:24 PM · Reading Epics (Page Previews), Reading-Web-Backlog (Tracking), Reading-Infrastructure-Team-Backlog (Kanban)

Thu, Jul 6

bearND added a comment to T169274: Expand "On this day" endpoint language support.

Also, audit added langs for missing 'date' pages. (Note: I have script for this somewhere...)

Thu, Jul 6, 5:37 PM · Mobile-Content-Service, Reading-Infrastructure-Team-Backlog, Wikipedia-iOS-App-Backlog

Sat, Jul 1

bearND updated subscribers of T169299: Mobileapps swagger spec is broken (no pronounciation for `page/mobile-sections-lead` endpoints).

I'm going to ask @Mholloway to see if he could merge and deploy https://gerrit.wikimedia.org/r/#/c/362346.

Sat, Jul 1, 4:28 AM · Services (done), Parsoid, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Operations

Fri, Jun 30

bearND added a project to T169299: Mobileapps swagger spec is broken (no pronounciation for `page/mobile-sections-lead` endpoints): Parsoid.

@ArielGlenn thanks for the the links and the patch! I agree this might have to do with it. Not sure why Parsoid doesn't provide the link to the actual media file anymore. Maybe this is related to T169293, too?

Fri, Jun 30, 9:48 PM · Services (done), Parsoid, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Operations
bearND moved T169299: Mobileapps swagger spec is broken (no pronounciation for `page/mobile-sections-lead` endpoints) from To Do to Doing on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Fri, Jun 30, 6:01 PM · Services (done), Parsoid, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Operations
bearND moved T169299: Mobileapps swagger spec is broken (no pronounciation for `page/mobile-sections-lead` endpoints) from Needs triage to Kanban on the Reading-Infrastructure-Team-Backlog board.
Fri, Jun 30, 6:01 PM · Services (done), Parsoid, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Operations
bearND added a comment to T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore.

So, the difference is the --useBatchAPI option. When/where/why is it used?

Fri, Jun 30, 5:46 PM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND created T169293: While using ParsoidBatchAPI, [[Media: ]] does not link to media file anymore.
Fri, Jun 30, 2:58 AM · Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Patch-For-Review, Mobile-Content-Service, Parsoid
bearND updated the task description for T167921: Support Lazy load reference lists.
Fri, Jun 30, 12:26 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API

Thu, Jun 29

bearND updated the task description for T167921: Support Lazy load reference lists.
Thu, Jun 29, 10:20 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API

Wed, Jun 28

bearND added a comment to T168023: [Regression] Top read on enwiki for 6-14-17 has duplicate entries.

@mobrovac The reason is that it seems that PageView API still sees some updates after the first time the aggregated feed entry for a day is stored. I assume that's shortly after 0:00 UTC. If I run the same thing in MCS a day later I shouldn't see significant differences (changed ranks) and duplicated entries from the last stored version.

Wed, Jun 28, 11:00 PM · Services (watching), Regression, iOS-app-feature-TopRead, Wikipedia-iOS-App-Backlog, iOS-app-Bugs

Tue, Jun 27

bearND added a comment to T168404: BUG: Snippets of styling code for certain East-Asian text styles are shown in the app .

Here's a diff of the HTML in DevTools comparing the PHP-parsed version with the Parsoid parsed versions:

Tue, Jun 27, 9:44 PM · Patch-For-Review, Parsoid, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Android-app-Bugs
bearND added a comment to T168404: BUG: Snippets of styling code for certain East-Asian text styles are shown in the app .

In this template https://ja.wikipedia.org/wiki/Template:%E8%AA%AD%E3%81%BF%E4%BB%AE%E5%90%8D somewhere? Hmm, maybe somewhere else. I have a hard time finding any of the substrings there. The PHP-parsed version doesn't seem to have an issue with that, though.

Tue, Jun 27, 9:18 PM · Patch-For-Review, Parsoid, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Android-app-Bugs
bearND added a comment to T114596: [RFC] Page component retrieval & interaction API / null skin.

Create a "null" skin that only returns the content area

Something like useskin=apioutput? Example: https://en.wikipedia.org/wiki/Special:Version?useskin=apioutput

Tue, Jun 27, 9:08 PM · Offline-Working-Group, Services (later), ArchCom-RfC (ArchCom-Approved), RfC, Performance
bearND added a project to T168404: BUG: Snippets of styling code for certain East-Asian text styles are shown in the app : Parsoid.

Seems like an artifact coming from Parsoid: https://ja.wikipedia.org/api/rest_v1/page/html/%E6%B1%9F%E6%88%B8%E5%B7%9D%E3%82%B3%E3%83%8A%E3%83%B3 shows the same:

Tue, Jun 27, 8:41 PM · Patch-For-Review, Parsoid, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, Android-app-Bugs
bearND added a project to T168023: [Regression] Top read on enwiki for 6-14-17 has duplicate entries: Services.

Yes, https://en.wikipedia.org/api/rest_v1/feed/featured/2017/06/15 shows two different results for the same topic: "Grenfell_Tower_fire". (There's also a related "Grenfell_Tower" result there but that's not the issue here.)

Tue, Jun 27, 8:27 PM · Services (watching), Regression, iOS-app-feature-TopRead, Wikipedia-iOS-App-Backlog, iOS-app-Bugs

Mon, Jun 26

bearND added a comment to T164033: Test size of "Reading stripped" HTML vs non-stripped HTML.

Here are some preliminary results (before stripping of references is implemented) with a small sample of test pages (some were taken from the most-read results from 6/22/2017):
If I don't strip any HTML and just add some of the markers and other changes needed MCS read-html adds around 1.9% to the payload.
If stripping of unneeded tags is included MCS read-html reduces the payload from 23% to 47% (avg. around 37%).

Mon, Jun 26, 4:34 PM · Page Content Service, Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Reading Epics (Platform JS CSS and HTML consolidation), Services (designing), RESTBase-API
bearND moved T167921: Support Lazy load reference lists from Doing to To Do on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jun 26, 3:54 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API
bearND moved T168875: Remove references from HTML payload from To Do to Doing on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jun 26, 3:54 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API
bearND created T168875: Remove references from HTML payload.
Mon, Jun 26, 3:19 PM · Page Content Service, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API
bearND moved T167921: Support Lazy load reference lists from To Do to Doing on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jun 26, 3:13 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Platform JS CSS and HTML consolidation), RESTBase-API
bearND moved T164033: Test size of "Reading stripped" HTML vs non-stripped HTML from Doing to Code Review on the Reading-Infrastructure-Team-Backlog (Kanban) board.
Mon, Jun 26, 3:13 PM · Page Content Service, Patch-For-Review, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Reading Epics (Platform JS CSS and HTML consolidation), Services (designing), RESTBase-API

Jun 22 2017

bearND closed T166001: Implement reading list survey in announcement endpoint as Resolved.
Jun 22 2017, 5:48 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Reading Epics (Synchronized Reading Lists)
bearND closed T166001: Implement reading list survey in announcement endpoint , a subtask of T164770: Design survey for reading list usage in Android, as Resolved.
Jun 22 2017, 5:48 PM · Design, Patch-For-Review, Reading Epics (Synchronized Reading Lists)
bearND closed T163256: User tester recruiting should no longer be running as Resolved.
Jun 22 2017, 5:48 PM · Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Wikipedia-iOS-App-Backlog
bearND closed T164522: Videos do not play and do not appear correctly as Resolved.
Jun 22 2017, 5:48 PM · MW-1.30-release-notes (WMF-deploy-2017-05-09_(1.30.0-wmf.1)), Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Mobile-Content-Service, Android-app-Bugs, Wikipedia-Android-App-Backlog
bearND closed T147043: Do not rewrite urls via _rewriteUrlAttribute in new endpoint, a subtask of T146944: Mobile-sections replacement, as Resolved.
Jun 22 2017, 5:48 PM · Reading-Infrastructure-Team-Backlog, Reading Epics (Platform JS CSS and HTML consolidation), User-mobrovac, RESTBase-API, Services (watching), Wikipedia-Android-App-Backlog, Reading-Web-Backlog, Mobile-Content-Service
bearND closed T147043: Do not rewrite urls via _rewriteUrlAttribute in new endpoint as Resolved.
Jun 22 2017, 5:47 PM · Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review
bearND closed T159860: Citation reference links have unexpected anchor format as Resolved.
Jun 22 2017, 5:47 PM · Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Android-app-Bugs, Wikipedia-Android-App-Backlog
bearND closed T163449: Some class of internal links is not being rewritten in the content service as expected as Resolved.
Jun 22 2017, 5:47 PM · Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Android-app-Bugs, Wikipedia-Android-App-Backlog
bearND closed T148680: Investigate FeaturedFeeds as Resolved.
Jun 22 2017, 5:47 PM · Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Spike, MediaWiki-extensions-FeaturedFeeds, Wikipedia-Android-App-Backlog
bearND closed T148680: Investigate FeaturedFeeds, a subtask of T150806: Featured articles should support more languages, as Resolved.
Jun 22 2017, 5:47 PM · Patch-For-Review, Reading Epics (Feed Content Language Expansion), Mobile-Content-Service (Kanban), Wikipedia-Android-App-Backlog
bearND closed T156941: Selecting pronunciation fails when pronunciation filename contains quotes as Resolved.
Jun 22 2017, 5:46 PM · Mobile-Content-Service, Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review