Page MenuHomePhabricator

Usmanmuhd (Muhammad Usman)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Feb 25 2019, 1:41 PM (20 w, 5 d)
Availability
Available
LDAP User
Usmanmuhd
MediaWiki User
Muhdusman [ Global Accounts ]

Recent Activity

Tue, Jul 16

Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

@bmansurov Pushed the patch for getArticlesBySeed.

Tue, Jul 16, 5:22 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

@bmansurov Are the links right? I wrote a script to check if the above queries and the present query is returning any overlapping elements, it does not return even a single item which is same from both.

Tue, Jul 16, 1:57 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API

Mon, Jul 15

Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

@bmansurov Is this query right for getting items by pageviews? https://uz.wikipedia.org/w/api.php?format=json&action=query&prop=pageprops|langlinks&ppprop=wikibase_item|disambiguation&lllang=en&generator=mostviewed

Mon, Jul 15, 8:42 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API

Fri, Jul 12

Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

@bmansurov Oh I confused sitelink_count with index. In our case we don't have sitelink count. Should we fetch it from the API or should we just phase it out?

Fri, Jul 12, 12:37 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

@bmansurov Given a seed, I am retrieving the wikibase_item, title and index. I should sort using index in ascending or descending?

Fri, Jul 12, 6:29 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

How do I pass multiple props and ppprops? When I do this it's always returning 404. Same when I swapped out | for a ,.

const parameters = {
        format: 'json',
        action: 'query',
        prop: 'pageprops|langlinks',
        ppprop: 'wikibase_item|disambiguation',
        lllang: target,
        generator: 'search',
        gsrlimit: 500,
        gsrsearch: `morelike:${seed}`
};
Fri, Jul 12, 5:12 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

Yeah, it works now. Thanks.

Fri, Jul 12, 4:48 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

Even after deleting the node_modules and npm install, the error still persists.

Fri, Jul 12, 4:36 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

@bmansurov When I run npm run test | bunyan I am getting the following error:

Fri, Jul 12, 3:59 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API

Sat, Jun 29

Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

Thanks for the great feedback!

Sat, Jun 29, 12:32 AM · Google-Summer-of-Code (2019)

Fri, Jun 28

Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

I can't use ppprop or lllang along with action='wbgetentities'. It gives "*": "Unrecognized parameters: ppprop, lllang."

Fri, Jun 28, 12:51 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

Oh okay.
So the flow would be:

  1. Get all the entities and corresponding data.
  2. Remove all the items containing enwiki in sitelinks.
  3. Remove all the items having 'disambiguation' in the labels.
Fri, Jun 28, 7:31 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API

Wed, Jun 26

Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

I meant to say that SparQL is excluding the entity.

Wed, Jun 26, 4:22 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

I removed all entities which have 'enwiki', I got ['Q4077077', 'Q4427926', 'Q24287657', 'Q52686724']. The extra entity I am getting is 'Q4077077'. Seems like it's getting excluded in SparQL due to ?article schema:about ?item ..
Which attribute is being checked in this part?

Wed, Jun 26, 1:57 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API

Mon, Jun 24

Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

I don't think there is a way to get only the counts.
For this: https://www.wikidata.org/w/api.php?action=wbgetentities&ids=Q3986754|Q4224|Q4429859|Q306403|Q2498038|Q271534|Q274306|Q205707|Q229651|Q222|Q4077077|Q4427926|Q2983218|Q166502|Q3023357|Q1924847|Q34436|Q19865538|Q24287657|Q42296351|Q52686724|Q47300912|Q64768584&props=sitelinks&format=json
we get the counts correctly but also there are extra items other than the query(https://query.wikidata.org/#SELECT%20%3Fitem%20%28COUNT%28%3Fsitelink%29%20as%20%3Fcount%29%20WHERE%20%7B%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20VALUES%20%3Fitem%20%7B%20wd%3AQ3986754%20wd%3AQ4224%20wd%3AQ4429859%20wd%3AQ306403%20wd%3AQ2498038%20wd%3AQ271534%20wd%3AQ274306%20wd%3AQ205707%20wd%3AQ229651%20wd%3AQ222%20wd%3AQ4077077%20wd%3AQ4427926%20wd%3AQ2983218%20wd%3AQ166502%20wd%3AQ3023357%20wd%3AQ1924847%20wd%3AQ34436%20wd%3AQ19865538%20wd%3AQ24287657%20wd%3AQ42296351%20wd%3AQ52686724%20wd%3AQ47300912%20wd%3AQ64768584%20%7D%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20FILTER%20NOT%20EXISTS%20%7B%20%3Fitem%20wdt%3AP31%20wd%3AQ4167410%20.%20%7D%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20OPTIONAL%20%7B%20%3Fsitelink%20schema%3Aabout%20%3Fitem%20%7D%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20FILTER%20NOT%20EXISTS%20%7B%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%3Farticle%20schema%3Aabout%20%3Fitem%20.%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%3Farticle%20schema%3AisPartOf%20%3Chttps%3A%2F%2Fen.wikipedia.org%2F%3E%20.%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%7D%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%7D%20GROUP%20BY%20%3Fitem). Searching for 'ruwiki' or 'enwiki' in ['sitelinks'] also does not help either.

Mon, Jun 24, 4:35 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd added a comment to T216750: Article recommendation API: replace WDQS with MW API.

@bmansurov Is this API query a right replacement for the SparQL?

Mon, Jun 24, 1:59 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API

Sat, Jun 22

Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Hopefully will get it done by Monday or Tuesday.

Sat, Jun 22, 2:25 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

@bmansurov I think T216750: Article recommendation API: replace WDQS with MW API should solve the issue. If the issue still persists, I'll come back to it.

Sat, Jun 22, 1:37 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research

Jun 20 2019

Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

Evaluation 1 summary:

Jun 20 2019, 2:01 PM · Google-Summer-of-Code (2019)

Jun 18 2019

Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Thanks!
Minor point:

  1. Why is the count:24 even after passing count=5? It works as expected on my local env.
Jun 18 2019, 4:09 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Thanks, shall I move on to the next task or do I have something else to do before moving on to the next one?

Jun 18 2019, 5:27 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research

Jun 17 2019

Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

A few observations:

  1. https://en.wikipedia.org/api/rest_v1/data/recommendation/article/creation/translation/ru?count=5 returns 24 items itself. Works as expected on local machine.
  2. Should we explore the tests for this API?
  3. Using 50 for sparql currently suffices, but we risk running into 429 error due to this. Should we increase the limit?
Jun 17 2019, 1:46 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd committed rMSRA8920fec6d619: Splits the request to WMAPI in batches (authored by Usmanmuhd).
Splits the request to WMAPI in batches
Jun 17 2019, 1:14 PM
Usmanmuhd committed rMSRA4af41a0a240e: Splits the request to WMAPI in batches (authored by Usmanmuhd).
Splits the request to WMAPI in batches
Jun 17 2019, 1:14 PM
Usmanmuhd committed rMSRA9603d4282492: Splits the request to MediaWiki API and Wikidata query service in batches. (authored by Usmanmuhd).
Splits the request to MediaWiki API and Wikidata query service in batches.
Jun 17 2019, 1:14 PM

Jun 15 2019

Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Pushed the changes after making the filter() use batches as well.

Jun 15 2019, 2:09 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd committed rMSRAea3acdf0ca96: Splits the request to WMAPI in batches (authored by Usmanmuhd).
Splits the request to WMAPI in batches
Jun 15 2019, 2:04 PM
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

@bmansurov http://localhost:6927/en.wikipedia.org/v1/article/creation/translation/ru works perfectly.
I checked http://localhost:6927/uz.wikipedia.org/v1/article/creation/translation/ru with both fix-T215222 branch and the master branch. Both give an error.
Further investigation reveals:
This error is being caused in https://query.wikidata.org/sparql.

Jun 15 2019, 5:58 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd updated the task description for T225853: BadMethodCallException for API call on ru.wikipedia: "Call to a member function getPrefixedText() on a non-object (null)".
Jun 15 2019, 3:46 AM · Core Platform Team (Code Health (TEC13)), good first bug, Core Platform Team Workboards (Clinic Duty Team), PageViewInfo, Wikimedia-production-error, MediaWiki-API
Usmanmuhd renamed T225853: BadMethodCallException for API call on ru.wikipedia: "Call to a member function getPrefixedText() on a non-object (null)" from Error with RuWikiAPi to Error with RuWikiAPI.
Jun 15 2019, 2:27 AM · Core Platform Team (Code Health (TEC13)), good first bug, Core Platform Team Workboards (Clinic Duty Team), PageViewInfo, Wikimedia-production-error, MediaWiki-API
Usmanmuhd created T225853: BadMethodCallException for API call on ru.wikipedia: "Call to a member function getPrefixedText() on a non-object (null)".
Jun 15 2019, 2:26 AM · Core Platform Team (Code Health (TEC13)), good first bug, Core Platform Team Workboards (Clinic Duty Team), PageViewInfo, Wikimedia-production-error, MediaWiki-API

Jun 14 2019

Usmanmuhd committed rMSRA02121ecaeec3: Splits the request to WMAPI in batches (authored by Usmanmuhd).
Splits the request to WMAPI in batches
Jun 14 2019, 6:33 PM
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Updated the code as requested. Please take a look.

Jun 14 2019, 6:33 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd committed rMSRAd7c7353b5ed6: Splits the request to WMAPI in batches (authored by Usmanmuhd).
Splits the request to WMAPI in batches
Jun 14 2019, 3:46 PM
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

npm run test | bunyan giving this error:

Jun 14 2019, 2:58 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Pushed the quick fix for the error. Will report the bug in a while.

Jun 14 2019, 2:54 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd committed rMSRA6af2642d4199: Splits the request to WMAPI in batches (authored by Usmanmuhd).
Splits the request to WMAPI in batches
Jun 14 2019, 2:53 PM
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

ru.wikipedia.org API behaves much differently from the others.
Example:

Jun 14 2019, 12:42 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

There is a "continue" attribute in the body of the request when we have more items than the limit. Example:

{"batchcomplete":"","continue":{"gpvimoffset":250,"continue":"gpvimoffset||"},"query":{"pages":{"-4":{"ns":2,"title":"User:Geilamir","missing":"","known":""},"-5":{"ns":2,"title":"User:Logan","missing":"","known":""},"-6":{"ns":2,"title":"User:Courcelles","missing":"","known":""},"-7":{"ns":6,"title":"File:Tanzania in its region.svg","missing":"","known":""},"-1":{"ns":-1,"title":"Special:Contributions/84.198.31.211","special":""},"-2":{"ns":-1,"title":"Special:EmailUser/Troubled asset","special":""},"-3":{"ns":-1,"title":"Special:NewPages","special":""},..........................................."4474":{"pageid":4474,"ns":828,"title":"Module:Citation/CS1/Utilities","pageprops":{"wikibase_item":"Q21993353"}},"4445":{"pageid":4445,"ns":828,"title":"Module:No globals","pageprops":{"wikibase_item":"Q16748603"}}}}}

Should I make use of this attribute to fetch all the items or should we limit it to 500 or the number of items which ever is lesser?

Jun 14 2019, 9:47 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd committed rMSRA05738c5c322d: Throw appropriate error when wmAPI returns internal server error. (authored by Usmanmuhd).
Throw appropriate error when wmAPI returns internal server error.
Jun 14 2019, 9:32 AM

Jun 13 2019

Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Yeah, higher sitelink_count is important. It is being sorted here https://github.com/wikimedia/mediawiki-services-recommendation-api/blob/master/lib/article.creation.translation.js#L182.

Jun 13 2019, 2:09 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

I tested for different number of items. It gives a different output. Basically the elements returned by the API are retrieved from the db along with other data. Example:

Jun 13 2019, 1:18 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Yeah, it works. How do we handle this case?

Jun 13 2019, 12:28 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Sent the same request as the one being sent through sandbox:

Jun 13 2019, 8:24 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Usmanmuhd committed rMSRA55b0a49ad3b7: Throw appropriate error when wmAPI returns internal server error. (authored by Usmanmuhd).
Throw appropriate error when wmAPI returns internal server error.
Jun 13 2019, 4:25 AM

Jun 12 2019

Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

Yeah, just tested with the valid API call and the invalid API call. response.body.error will not be null in case of error and will be null in case of no error. Will send in a patch in sometime.

Jun 12 2019, 1:00 PM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research

Jun 10 2019

Usmanmuhd added a comment to T215222: Recommendation API translation endpoint stopped working.

How do I reproduce this error?

Both above work fine.

Jun 10 2019, 7:35 AM · Patch-For-Review, Google-Summer-of-Code (2019), Article-Recommendation, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research

May 30 2019

Usmanmuhd committed rMSRA6b8ca3e4a2f1: Remove duplicate Wikidata items from article recommendations (authored by Usmanmuhd).
Remove duplicate Wikidata items from article recommendations
May 30 2019, 1:46 PM

May 28 2019

Usmanmuhd added a comment to T216721: Remove duplicate Wikidata items from article recommendations.

Output for http://localhost:6927/uz.wikipedia.org/v1/article/creation/morelike/Kitob

May 28 2019, 6:09 PM · Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd committed rMSRAb292034c51ca: Remove duplicate Wikidata items from article recommendations (authored by Usmanmuhd).
Remove duplicate Wikidata items from article recommendations
May 28 2019, 6:08 PM
Usmanmuhd committed rMSRA140b3af44cac: Remove duplicate Wikidata items from article recommendations (authored by Usmanmuhd).
Remove duplicate Wikidata items from article recommendations
May 28 2019, 4:19 PM

May 6 2019

Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

Thanks a lot for selecting me! Looking forward to working on it.

May 6 2019, 6:09 PM · Google-Summer-of-Code (2019)

Apr 9 2019

Usmanmuhd moved T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant from Proposals in Progress to Proposals Submitted on the Google-Summer-of-Code (2019) board.
Apr 9 2019, 2:07 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 9 2019, 1:59 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 9 2019, 1:40 PM · Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.

@Tgr Added 2 coding tasks. Will go ahead and submit the proposal.

Apr 9 2019, 1:38 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 9 2019, 1:36 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 9 2019, 1:05 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 9 2019, 1:05 PM · Google-Summer-of-Code (2019)
Usmanmuhd moved T216721: Remove duplicate Wikidata items from article recommendations from Proposals Submitted to Microtasks on the Google-Summer-of-Code (2019) board.
Apr 9 2019, 12:37 PM · Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API
Usmanmuhd updated the task description for T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 9 2019, 11:09 AM · Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.

Thanks for the review. I will change those parts accordingly.

Apr 9 2019, 10:30 AM · Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.

@Tgr The final submission is today, so shall I ahead and submit this? or should there by any changes?

Apr 9 2019, 12:44 AM · Google-Summer-of-Code (2019)

Apr 8 2019

Usmanmuhd updated the task description for T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 8 2019, 11:02 AM · Google-Summer-of-Code (2019)
Usmanmuhd moved T218971: GSoC 2019 Proposal: Improve article recommendation pipeline from Proposals in Progress to Proposals Submitted on the Google-Summer-of-Code (2019) board.
Apr 8 2019, 10:55 AM · Google-Summer-of-Code (2019)
Usmanmuhd updated subscribers of T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.

@Tgr @Samat @srishakatux Could you please review it so that I can submit it soon?
As it is a new project, I have added links to my previous open source projects to show my ability to work.

Apr 8 2019, 6:20 AM · Google-Summer-of-Code (2019)
Usmanmuhd moved T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant from Backlog to Proposals in Progress on the Google-Summer-of-Code (2019) board.
Apr 8 2019, 6:18 AM · Google-Summer-of-Code (2019)
Usmanmuhd created T220329: GSoC 2019 Proposal: Build statistics toolset to support WM-HU editor retention grant.
Apr 8 2019, 6:17 AM · Google-Summer-of-Code (2019)

Apr 3 2019

Usmanmuhd updated subscribers of T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

@srishakatux @bmansurov submitted this proposal on the GSoC website.

Apr 3 2019, 1:42 PM · Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T218277: Build statistics toolset to support WM-HU editor retention grant.

@Tgr I would like to take this project up. I am proficient in Python. I would prefer to use either Flask or Django for this project.
As for the coding tasks, I think a prototype of the project might be a good starting point.
I would start with writing the proposal for this along with the quick prototype of this project.

Apr 3 2019, 1:49 AM · Technical-Tool-Request, Google-Summer-of-Code (2019), Outreach-Programs-Projects, User-Tgr

Apr 2 2019

Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Apr 2 2019, 12:56 AM · Google-Summer-of-Code (2019)

Apr 1 2019

Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Apr 1 2019, 5:28 PM · Google-Summer-of-Code (2019)
Usmanmuhd committed rMSRAf7134d1673c2: Morelike: output source language (authored by Usmanmuhd).
Morelike: output source language
Apr 1 2019, 2:38 PM
Usmanmuhd committed rMSRAe8f45645554c: Morelike: output source language (authored by Usmanmuhd).
Morelike: output source language
Apr 1 2019, 2:38 PM
Usmanmuhd added a comment to T216721: Remove duplicate Wikidata items from article recommendations.

@bmansurov When I reproduced this error along with source_language it turns out they are different source languages.
This is the output I got:

[{"wikidata_id":"Q125576","normalized_rank":0.930232,"source_language":"en"},{"wikidata_id":"Q125576","normalized_rank":0.927625,"source_language":"ru"},{"wikidata_id":"Q159964","normalized_rank":0.919053,"source_language":"en"},{"wikidata_id":"Q226697","normalized_rank":0.919053,"source_language":"en"},{"wikidata_id":"Q170124","normalized_rank":0.917277,"source_language":"en"},{"wikidata_id":"Q49848","normalized_rank":0.917277,"source_language":"en"},{"wikidata_id":"Q83357","normalized_rank":0.913319,"source_language":"en"},{"wikidata_id":"Q29334","normalized_rank":0.913319,"source_language":"en"},{"wikidata_id":"Q159964","normalized_rank":0.912596,"source_language":"ru"},{"wikidata_id":"Q178659","normalized_rank":0.906879,"source_language":"en"}]
Apr 1 2019, 3:51 AM · Google-Summer-of-Code (2019), Article-Recommendation, Research, Recommendation-API

Mar 31 2019

Usmanmuhd committed rMSRA07fcd6e37f83: Morelike: output source language (authored by Usmanmuhd).
Morelike: output source language
Mar 31 2019, 3:55 PM
Usmanmuhd committed rMSRA3b0e0779def9: Morelike: output source language (authored by Usmanmuhd).
Morelike: output source language
Mar 31 2019, 3:55 PM
Usmanmuhd committed rMSRAdd889721de39: Morelike: output source language (authored by Usmanmuhd).
Morelike: output source language
Mar 31 2019, 3:55 PM
Usmanmuhd added a comment to T219505: Recommendation API: output source language.

Output:

Mar 31 2019, 3:19 PM · Recommendation-API, Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T219505: Recommendation API: output source language.

Thanks, it works. Documentation changes needed for this?

Mar 31 2019, 5:17 AM · Recommendation-API, Google-Summer-of-Code (2019)

Mar 30 2019

Usmanmuhd added a comment to T219505: Recommendation API: output source language.

When I navigate to http://localhost:6927/en/v1/article/creation/morelike/book I get:

[2019-03-30T03:53:56.675Z] TRACE: recommendation-api/26082 on lenovo: incoming request (request_id=715d7a20-529f-11e9-8f5e-3f15249dbade, levelPath=trace/req)
    request: {
      "url": "/en/v1/article/creation/morelike/book",
      "headers": {
        "user-agent": "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:66.0) Gecko/20100101 Firefox/66.0",
        "cache-control": "max-age=0",
        "x-request-id": "715d7a20-529f-11e9-8f5e-3f15249dbade"
      },
      "method": "GET",
      "params": {
        "0": "/en/v1/article/creation/morelike/book"
      },
      "query": {},
      "remoteAddress": "127.0.0.1",
      "remotePort": 36146
    }
[2019-03-30T03:53:56.676Z] DEBUG: recommendation-api/26082 on lenovo: Getting article's Wikidata ID from MW API. (articleTitle=book, levelPath=debug/article.creation.morelike)
[2019-03-30T03:53:56.682Z] ERROR: recommendation-api/26082 on lenovo: 504: internal_http_error (message="504: internal_http_error", status=504, type=internal_http_error, detail="504: internal_http_error", request_id=715d7a20-529f-11e9-8f5e-3f15249dbade, levelPath=error/504)
    request: {
      "url": "/en/v1/article/creation/morelike/book",
      "headers": {
        "user-agent": "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:66.0) Gecko/20100101 Firefox/66.0",
        "cache-control": "max-age=0",
        "x-request-id": "715d7a20-529f-11e9-8f5e-3f15249dbade"
      },
      "method": "GET",
      "params": {
        "0": "/en/v1/article/creation/morelike/book"
      },
      "query": {},
      "remoteAddress": "127.0.0.1",
      "remotePort": 36146
    }
Mar 30 2019, 3:57 AM · Recommendation-API, Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T219505: Recommendation API: output source language.

I followed all the steps, and when I run npm start server.js | bunyan I get

usman@lenovo:~/recommendation-api$ npm start server.js | bunyan
bunyan: command not found
events.js:174
      throw er; // Unhandled 'error' event
      ^
Mar 30 2019, 3:41 AM · Recommendation-API, Google-Summer-of-Code (2019)

Mar 29 2019

Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 29 2019, 3:17 AM · Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

@bmansurov Thanks for the review!

Mar 29 2019, 1:33 AM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 29 2019, 1:33 AM · Google-Summer-of-Code (2019)

Mar 28 2019

Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 28 2019, 6:02 PM · Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

@bmansurov I have made changes to the proposal as advised. Could you please review it? Thanks.

Mar 28 2019, 5:53 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 28 2019, 5:52 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 28 2019, 5:50 PM · Google-Summer-of-Code (2019)
Usmanmuhd claimed T219505: Recommendation API: output source language.
Mar 28 2019, 2:54 PM · Recommendation-API, Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

@bmansurov Seems like a simple task. Will try to fix it soon.

Mar 28 2019, 2:19 PM · Google-Summer-of-Code (2019)
Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

@bmansurov Basically you could point me to smaller bugs which take hours to fix or could give me some task that will help you gauge if my skills are well suited for the project.

Mar 28 2019, 1:49 AM · Google-Summer-of-Code (2019)

Mar 27 2019

Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

@bmansurov Thanks. Will make the changes and let you know once it's ready for review.
Meanwhile are there any tasks or small issues that can be solved as is the case with other projects?

Mar 27 2019, 4:47 PM · Google-Summer-of-Code (2019)
Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 27 2019, 4:45 PM · Google-Summer-of-Code (2019)

Mar 26 2019

Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 26 2019, 3:19 PM · Google-Summer-of-Code (2019)

Mar 24 2019

Usmanmuhd updated the task description for T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 24 2019, 4:55 PM · Google-Summer-of-Code (2019)

Mar 22 2019

Usmanmuhd added a comment to T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.

Thanks, I'll complete the remaining parts this weekend. It will be ready by Monday. How should I divide the timeline? Not very clear on how I would divide the timeline.

Mar 22 2019, 11:25 AM · Google-Summer-of-Code (2019)
Usmanmuhd moved T218971: GSoC 2019 Proposal: Improve article recommendation pipeline from Backlog to Proposals in Progress on the Google-Summer-of-Code (2019) board.
Mar 22 2019, 4:04 AM · Google-Summer-of-Code (2019)
Usmanmuhd created T218971: GSoC 2019 Proposal: Improve article recommendation pipeline.
Mar 22 2019, 4:03 AM · Google-Summer-of-Code (2019)

Mar 19 2019

Usmanmuhd added a comment to T217655: Improve article recommendation pipeline.

@srishakatux Thanks. Will go through that.

Mar 19 2019, 1:29 AM · Article-Recommendation, Google-Summer-of-Code (2019)