GoranSMilovanovic (GoranSM)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Mar 20 2017, 3:58 PM (35 w, 1 d)
Availability
Available
LDAP User
GoranSMilovanovic
MediaWiki User
GoranSMilovanovic

Recent Activity

Yesterday

GoranSMilovanovic removed a project from T171990: Knowledge Base for Campaign Tracking and Analytics: User-GoranSMilovanovic.
Tue, Nov 21, 11:30 PM · WMDE-New-Editors-Banner-Campaigns
GoranSMilovanovic placed T171990: Knowledge Base for Campaign Tracking and Analytics up for grabs.
  • I have concisely documented the critical steps in relation to Campaign Analytics (Data Sources, Contacts, Reporting and Analytics sections)
  • There are a few points where I can't help; someone needs to pick up the ticket from here.
Tue, Nov 21, 11:29 PM · WMDE-New-Editors-Banner-Campaigns
GoranSMilovanovic added a comment to T181094: A statbox to update the WDCM system.

We can install R and stuff on stat1004, but I doubt you'll get the exact same versions.

Tue, Nov 21, 10:30 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic triaged T181094: A statbox to update the WDCM system as High priority.
Tue, Nov 21, 9:44 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic moved T181094: A statbox to update the WDCM system from Technical Wishlist to WDCM on the User-GoranSMilovanovic board.
Tue, Nov 21, 9:43 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic renamed T181094: A statbox to update the WDCM system from Please install R on stat1004 to A statbox to update the WDCM system.
Tue, Nov 21, 9:40 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic updated the task description for T181094: A statbox to update the WDCM system.
Tue, Nov 21, 9:33 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic updated subscribers of T181094: A statbox to update the WDCM system.
Tue, Nov 21, 9:32 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic added a comment to T181035: Run WDCM (non-productionized) updates.

Believe it or not, but with the new setup of the stat1004, stat1005, and stat10006 statboxes, we cannot update the WDCM even manually!

Tue, Nov 21, 9:21 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T181094: A statbox to update the WDCM system.

BTW can we do access MariaDB replicas from stat1004?

Tue, Nov 21, 9:09 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic updated the task description for T181094: A statbox to update the WDCM system.
Tue, Nov 21, 9:05 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic updated subscribers of T181094: A statbox to update the WDCM system.
Tue, Nov 21, 8:54 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic created T181094: A statbox to update the WDCM system.
Tue, Nov 21, 8:53 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic closed T178507: English translation of banner content and user tasks as Resolved.
Tue, Nov 21, 6:35 PM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic updated subscribers of T171420: Migrate New Editors Analytics to Production.

Please let me know whether the new New Users Report as we have it now presents what you need, so that I can try to

Tue, Nov 21, 11:45 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

@Verena @Stefan_Schneider_WMDE Please: do you need any additional analytics for the Autumn Banner Campaign 2017, or shall we close this task?

Tue, Nov 21, 11:42 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic added a comment to T179545: WDCM: User feedback.

@Jan_Dittrich Please organize and perform any kind of WDCM testing that you find appropriate or simply feasible enough; I really liked the above mentioned heuristics.

Tue, Nov 21, 11:38 AM · WMDE-Design, Design, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic lowered the priority of T171258: WDCM: Process Module Scaling/migrate to Production from High to Normal.
Tue, Nov 21, 11:28 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.
  • it seems we can cannot have WDCM in production on the statboxes completely before Q1 2018
  • reason: we must orchestrate the same user analytics-wmde across stat1004 (regular Sqoop job) and stat1005 (everything else)
  • that orchestration is rather complicated to deploy and impossible at this point because of the standards that are currently maintained by the Analytics and Operations (see: T171258, T174110, T174465, T180902); this will change, but not before Q1 2018
  • we will proceed to puppetize the labs component of the WDCM (Shiny Dashboards that are being run from the wikidataconcepts labs instance).
Tue, Nov 21, 11:26 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T181035: Run WDCM (non-productionized) updates.
Tue, Nov 21, 11:23 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T180571: Grafana board for usage of the AdvancedSearch extension.

@Addshore Ok, it will be either a Shiny app or an interactive Rmarkdown hosted on labs then, which opens the following question: how frequently does the keywords section need to be updated?

Tue, Nov 21, 11:05 AM · User-Addshore, User-GoranSMilovanovic, Advanced-Search, TCB-Team

Mon, Nov 20

GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore Should we proceed to puppetize WDCM on labs until T180904 and other related tasks can be resolved?

Mon, Nov 20, 6:57 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T180904: Hive database for analytics-wmde user.

@Ottomata Please take your time if you are about to claim this task at all.

Mon, Nov 20, 6:43 PM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T180902: Create analytics-wmde on stat1004.

@Addshore I was assuming that having the same user on two statboxes is not independent of the permissions the user has on them.

Mon, Nov 20, 11:11 AM · User-Addshore, WMDE-Analytics-Engineering
GoranSMilovanovic added a comment to T179545: WDCM: User feedback.

There's another layer of user feedback collection, but it's not ready yet.

Mon, Nov 20, 10:58 AM · WMDE-Design, Design, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T180902: Create analytics-wmde on stat1004.

Let's make sure we have a precise description here:

Mon, Nov 20, 10:47 AM · User-Addshore, WMDE-Analytics-Engineering
GoranSMilovanovic added a comment to T180904: Hive database for analytics-wmde user.

Do we have any examples, anywhere, on what goes into the manifest for a Hadoop user? Must be the case.

Mon, Nov 20, 10:20 AM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic

Sun, Nov 19

GoranSMilovanovic added a comment to T179286: WDCM Regular Updates.

This is stalled until T180902 is resolved and T171258 is fully resolved. In itself, putting the WDCM split across stat1004 and stat1005 on cron and sync with labs should not present a problem at all. Well hopefully not.

Sun, Nov 19, 11:04 PM · User-Addshore, Wikidata, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T179545: WDCM: User feedback.

The draft is here.

Sun, Nov 19, 6:16 PM · WMDE-Design, Design, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T167290: Sqoop wbc_entity_usage from all wikis into hadoop (HDFS).

@Halfak I think this can be closed.

Sun, Nov 19, 3:09 PM · Analytics
GoranSMilovanovic claimed T179316: UI issue on WDCM:Overcrowding in screen.
Sun, Nov 19, 1:22 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering
GoranSMilovanovic moved T180904: Hive database for analytics-wmde user from Technical Wishlist to WDCM on the User-GoranSMilovanovic board.
Sun, Nov 19, 1:22 PM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic placed T180904: Hive database for analytics-wmde user up for grabs.
Sun, Nov 19, 12:55 PM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic renamed T180904: Hive database for analytics-wmde user from Hive table for analytics-wmde user to Hive database for analytics-wmde user.
Sun, Nov 19, 12:54 PM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T180904: Hive database for analytics-wmde user.
Sun, Nov 19, 12:54 PM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

Tested mySQL access for analytics-wmde via /etc/mysql/conf.d/research-wmde-client.cnf - all fine.

Sun, Nov 19, 12:47 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore No user analytics-wmde on stat1004, of course. This is what I will do: I will run the Sqoop step now from stat1004 as goransm just in order to prepare everything for what needs to be done on stat1005, and then we can take care of stat1004 later on.

Sun, Nov 19, 11:51 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore Sorry for the typos... I had a few really bad days (complicated dental intervention + more planned in the forthcoming week), first coffee still incomplete, already on this ticket for which you can just imagine how much I'm in love with it.

Sun, Nov 19, 11:36 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore analytics-wmde can do beelinee, but it does not have its own database. Two ways to go:

Sun, Nov 19, 11:26 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

@Stefan_Schneider_WMDE No usage of [[Datei:Name.jpg|...|...]] can be detected in the wmde_abc2017_bt1 user revisions.

Sun, Nov 19, 1:49 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic created T180891: WDCM: Optimize WDCM Shiny Dashboards.
Sun, Nov 19, 1:09 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T174896: WDCM Taxonomy: Refine.

Fix for (1) Work of Art MINUS Book and (2) Organization MINUS Geographical Object applied (note: that would not be the SPARQL MINUS, but an internal WDCM, R operation).

Sun, Nov 19, 12:33 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

(1) Could we please have the user analytics-wmde added to the analytics-research-client mySQL group?

Sun, Nov 19, 12:29 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic

Sat, Nov 18

GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore Currently running one, hopefully last, manual WDCM run, unifying the WDCM Engine scripts into one WDCM_Engine.R R script along the way.

Sat, Nov 18, 7:27 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic committed rAWCM292423530527: WDCM_Engine.R (authored by GoranSMilovanovic).
WDCM_Engine.R
Sat, Nov 18, 6:13 PM
GoranSMilovanovic committed rAWCM924370a88a36: minor nov 18 2017 (authored by GoranSMilovanovic).
minor nov 18 2017
Sat, Nov 18, 6:13 PM
GoranSMilovanovic committed rAWCM642737b89c54: Production - stat1005 structure (authored by GoranSMilovanovic).
Production - stat1005 structure
Sat, Nov 18, 6:13 PM

Fri, Nov 17

GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

@Stefan_Schneider_WMDE Well, my "immediately" had obviously acquired some general relativistic property of time dilation here. It is due to a complicated dental intervention that I had to undergo. Reporting back as soon as I can.

Fri, Nov 17, 11:42 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)

Thu, Nov 16

GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

Hi @Stefan_Schneider_WMDE thank you for a hint, I will check it out immediately and let you know.

Thu, Nov 16, 12:47 PM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic added a comment to T180570: Grafana board for adaptation of AdvancedSearch beta feature.

@Lea_WMDE This dashboard is already created, but the extension is not available yet.

Thu, Nov 16, 1:19 AM · Patch-For-Review, User-GoranSMilovanovic, WMDE-QWERTY-Team-Board, Advanced-Search, TCB-Team
GoranSMilovanovic triaged T174896: WDCM Taxonomy: Refine as High priority.
Thu, Nov 16, 1:14 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic triaged T171420: Migrate New Editors Analytics to Production as Low priority.
Thu, Nov 16, 1:09 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171420: Migrate New Editors Analytics to Production.

@Verena Section 0. included, explaining the definition of a New User used in this Report.

Thu, Nov 16, 1:09 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic lowered the priority of T178507: English translation of banner content and user tasks from High to Low.
Thu, Nov 16, 12:51 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

@Verena And finally, as of:

Thu, Nov 16, 12:48 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

@Addshore Thanks.

Thu, Nov 16, 12:01 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)

Wed, Nov 15

GoranSMilovanovic added a comment to T179286: WDCM Regular Updates.
  • during the weekend, another (final) manual WDCM update before officially putting the WDCM Engine in production; puppetization in itself is almost done (see T171258#3761115)
  • standardizing the update reporting code;
  • putting the thing in cron stat1005 in production should not be problematic.
Wed, Nov 15, 5:50 PM · User-Addshore, Wikidata, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T179543: WDCM: Use cases/Project Sub-page on Wikidata wiki as Resolved.
Wed, Nov 15, 5:46 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T179543: WDCM: Use cases/Project Sub-page on Wikidata wiki.

Ok. That page now has its working version and it will evolve together with the WDCM in the future.

Wed, Nov 15, 5:45 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T174896: WDCM Taxonomy: Refine.

@Lydia_Pintscher To start, I will try to clean up what we already have, just to remove the most pressing issues (for example, removing books from Work of Art, removing Geographical Objects from Organization). I will do that before running the first productionized update which is almost ready to run.

Wed, Nov 15, 1:12 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T174896: WDCM Taxonomy: Refine.

@Lydia_Pintscher Anytime, just let me know when it is best for you.

Wed, Nov 15, 12:51 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T174896: WDCM Taxonomy: Refine.

@Lydia_Pintscher I have had enough time to work with the WDCM now and inspect many empirical findings on Wikidata usage.

Wed, Nov 15, 2:39 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T179543: WDCM: Use cases/Project Sub-page on Wikidata wiki.

@Lydia_Pintscher

Wed, Nov 15, 2:35 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Tue, Nov 14

GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore Confirming that all necessary R packages in /srv/analytics-wmde/wdcm/src/r-library are in place.

Tue, Nov 14, 11:40 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171420: Migrate New Editors Analytics to Production.

Suddenly the situation is much better.

Tue, Nov 14, 11:34 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Mon, Nov 13

GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore I think that's it. It will not take me to much time to unify the scripts.

Mon, Nov 13, 9:32 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic committed rAWCM3e0fb1618de0: Installation script mkdirs r-library (authored by GoranSMilovanovic).
Installation script mkdirs r-library
Mon, Nov 13, 9:09 PM
GoranSMilovanovic committed rAWCMc245b2cad46f: minor (authored by GoranSMilovanovic).
minor
Mon, Nov 13, 8:58 PM
GoranSMilovanovic committed rAWCM292bfbb96f6c: install script knows where it lives (authored by GoranSMilovanovic).
install script knows where it lives
Mon, Nov 13, 8:54 PM
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Ottomata I would say yes, that's what we're at.

Mon, Nov 13, 8:05 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

The script installs all necessary WDCM R packages to: /srv/analytics-wmde/r-library

Mon, Nov 13, 7:55 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic committed rAWCMc9236c74006a: _installProduction_analytics-wmde.R puppetization (authored by GoranSMilovanovic).
_installProduction_analytics-wmde.R puppetization
Mon, Nov 13, 7:51 PM
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore A clear case of telepathy, I'm meditating the very same dilemma at the moment...

Mon, Nov 13, 7:47 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic committed rAWWSf10bfed77876: Init (authored by GoranSMilovanovic).
Init
Mon, Nov 13, 3:09 PM
GoranSMilovanovic committed rAWWHdb9159d73e50: Init (authored by GoranSMilovanovic).
Init
Mon, Nov 13, 2:54 PM
GoranSMilovanovic closed T180340: Split WDCM repo, a subtask of T171258: WDCM: Process Module Scaling/migrate to Production, as Resolved.
Mon, Nov 13, 2:48 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T180340: Split WDCM repo as Resolved.
Mon, Nov 13, 2:48 PM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic committed rAWWU0004e88776ca: Init (authored by GoranSMilovanovic).
Init
Mon, Nov 13, 2:48 PM
GoranSMilovanovic committed rAWWO9ea9c611d548: Initial (authored by GoranSMilovanovic).
Initial
Mon, Nov 13, 2:37 PM
GoranSMilovanovic committed rAWCM841ab3853556: Structure change for production 13 Nov 2017 (authored by GoranSMilovanovic).
Structure change for production 13 Nov 2017
Mon, Nov 13, 2:16 PM
GoranSMilovanovic added a comment to T171420: Migrate New Editors Analytics to Production.

apparently, the Analytics are already very aware of the missing historical field in wmf.mediawiki_history, see T161146.

Mon, Nov 13, 1:44 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T161146: Provide historical redirect flag in Data Lake edit data.

@JAllemandou Thanks!

Mon, Nov 13, 1:43 PM · Analytics
GoranSMilovanovic claimed T180340: Split WDCM repo.
Mon, Nov 13, 1:16 PM · User-Addshore, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

@Addshore The motivation behind the task: @Verena and the team would like to learn whether the ABC2017 registered users really did what the respective banners were suggesting to them (upload an image or use an image on Wikipedia, learn how to use citations, edit a page in a particular category).

Mon, Nov 13, 11:53 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic updated subscribers of T180310: wmf.mediawiki_history: page_is_redirect/page_is_redirect_latest.
Mon, Nov 13, 12:31 AM · Analytics-Data-Quality, Analytics
GoranSMilovanovic added a comment to T171420: Migrate New Editors Analytics to Production.

@Verena Here's a new version of the (now) monthly de.wikipedia.org New Editors Report, based on the wmf.mediawiki_history Hadoop table.

Mon, Nov 13, 12:26 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Sun, Nov 12

GoranSMilovanovic created T180310: wmf.mediawiki_history: page_is_redirect/page_is_redirect_latest.
Sun, Nov 12, 9:56 PM · Analytics-Data-Quality, Analytics

Sat, Nov 11

GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

As of the WDCM scaling (at this point, basically running away from [[ https://cran.r-project.org/web/packages/maptpx/index.html | {maptpx} ]] which is not maintained anymore, and switching to LDA from MLlib), I've tested SparkR on our fresh Spark 2.1.2 installation from stat1005 (see T139487#3752443) and everything seems to work fine. I would highly appreciate any hints that would enable me to work with {sparklyr} (see T139487#3558525), however, if that takes too much time or is simply to complicated to fix, I will probably go for the SparkR.

Sat, Nov 11, 11:22 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T158334: Make Spark 2.1 easily available on new CDH5.10 cluster.
Sat, Nov 11, 11:16 AM · Patch-For-Review, Analytics-Cluster, Analytics-Kanban
GoranSMilovanovic added a comment to T139487: Get 'sparklyr' working on stats1005.
  • tested SparkR with Spark 2.1.2:
Sat, Nov 11, 11:15 AM · Analytics, Discovery-Analysis
GoranSMilovanovic added a comment to T171258: WDCM: Process Module Scaling/migrate to Production.

@Addshore The current situation in production (stat1005):

Sat, Nov 11, 10:02 AM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

Of course, tables like templatelinks and imagelinks are not what we are looking for: from there we could learn whether a particular user edited a page that uses a template or/and multimedia, not whether that user has made an edit that encompassed template or multimedia usage. So, parsing the text of user revisions is a must. I've checked some Hadoop tables also and of course they also keep only the SHA1 of the revision.

Sat, Nov 11, 9:47 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)

Fri, Nov 10

GoranSMilovanovic added a comment to T173572: Add code for tracking the usage of keywords and the overall usage of the extension.

@Tobi from Grafana, defining a query similar to the one that tracks the number of global users for the TwoColConflict extension:

Fri, Nov 10, 9:53 PM · WMDE-QWERTY-Sprint-2017-11-14, WMDE-QWERTY-Team-Board, Patch-For-Review, WMDE-Fundraising-Funban-2, WMDE-Fundraising-Sprint-13, Advanced-Search, TCB-Team
GoranSMilovanovic added a project to T173572: Add code for tracking the usage of keywords and the overall usage of the extension: User-GoranSMilovanovic.
Fri, Nov 10, 1:50 PM · WMDE-QWERTY-Sprint-2017-11-14, WMDE-QWERTY-Team-Board, Patch-For-Review, WMDE-Fundraising-Funban-2, WMDE-Fundraising-Sprint-13, Advanced-Search, TCB-Team
GoranSMilovanovic claimed T173572: Add code for tracking the usage of keywords and the overall usage of the extension.
Fri, Nov 10, 1:49 PM · WMDE-QWERTY-Sprint-2017-11-14, WMDE-QWERTY-Team-Board, Patch-For-Review, WMDE-Fundraising-Funban-2, WMDE-Fundraising-Sprint-13, Advanced-Search, TCB-Team
GoranSMilovanovic updated subscribers of T178507: English translation of banner content and user tasks.

Here's the situation:

Fri, Nov 10, 1:37 PM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)

Thu, Nov 9

GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

Please find attached the following update:

Thu, Nov 9, 6:51 PM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)
GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

**"If I understood the code correctly the query includes also post-campaign activity?"

Well, no, since: AND (rev_timestamp >= 20171004220000) AND (rev_timestamp <= 20171014220000) in the WHERE clause should cover exactly the CEST scope of the campaign on the UTC server time.

Thu, Nov 9, 3:46 PM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)

Wed, Nov 8

GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

As of the BT2 specific task: 9.68% of edits made by BT2 registered users were made on the pages in the Wikipedia:Überarbeiten category.

Wed, Nov 8, 11:14 AM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)

Mon, Nov 6

GoranSMilovanovic added a comment to T178507: English translation of banner content and user tasks.

A new version of the ABC 2017 Report is here:

Mon, Nov 6, 9:36 PM · User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Autumn)