Page MenuHomePhabricator

GoranSMilovanovic (GoranSM)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Mar 20 2017, 3:58 PM (157 w, 5 d)
Availability
Available
LDAP User
GoranSMilovanovic
MediaWiki User
GoranSMilovanovic [ Global Accounts ]

Recent Activity

Fri, Mar 27

GoranSMilovanovic added a comment to T248308: Analyse a small sample of the most often used query patterns on WDQS.

Fri 27 Mar 2020 11:16:16 AM UTC

Fri, Mar 27, 11:44 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata

Thu, Mar 26

GoranSMilovanovic added a comment to T248308: Analyse a small sample of the most often used query patterns on WDQS.

Thu 26 Mar 2020 11:35:59 PM UTC

Thu, Mar 26, 11:39 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic moved T248301: Pageviews for WMDE Communications from Prioritized to Current/Deprioritized on the User-GoranSMilovanovic board.
Thu, Mar 26, 10:44 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering
GoranSMilovanovic moved T248308: Analyse a small sample of the most often used query patterns on WDQS from Technical Wishlist to Prioritized on the User-GoranSMilovanovic board.
Thu, Mar 26, 10:44 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata

Tue, Mar 24

GoranSMilovanovic added a comment to T248301: Pageviews for WMDE Communications.

Here go your pageviews, data collection from 2020-03-10 - 2020-03-23 (two weeks):

Tue, Mar 24, 10:49 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering
GoranSMilovanovic added a comment to T248301: Pageviews for WMDE Communications.
  • Data collection 2020-03-10 - 2020-03-23 started from stat1005, HiveQL.
Tue, Mar 24, 8:44 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering

Mon, Mar 23

GoranSMilovanovic added a comment to T139487: Get 'sparklyr' working on stats1005.

@Ottomata No as far as I am concerned (switched to Pyspark, while SparkR would do - if I ever need it).

Mon, Mar 23, 9:12 PM · Analytics-SWAP, Product-Analytics, Analytics, Discovery-Analysis
GoranSMilovanovic added a project to T248308: Analyse a small sample of the most often used query patterns on WDQS: User-GoranSMilovanovic.
  • fetch a random sample of SPARQL queries from /sparql and /bigdata/namespace/wdq/sparql paths in the wmf.webrequest;
  • provide exploratory data analysis to sort out the most frequently used exactly identical queries;
  • perform simple feature engineering to characterize the queries;
  • perform query clustering, characterize large clusters, and then study the distribution of query frequency across the clusters;
  • report.
Mon, Mar 23, 11:33 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic added a comment to T239203: Migrate all WDCM R ETL procedures to Pyspark/Analytics Cluster.
  • WDCM (S)itelinks and (T)itles still use a Hive based ETL procedure;
  • it shouldn't take too much time to switch to Pyspark.
Mon, Mar 23, 9:14 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T239199: Switch all WDCM/Wikidata Analytics ETL to new Kerberos Auth on stat100**, a subtask of T239198: WDCM General, as Resolved.
Mon, Mar 23, 9:13 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T239199: Switch all WDCM/Wikidata Analytics ETL to new Kerberos Auth on stat100** as Resolved.
  • WDCM (T)itles and WDCM (S)itelinks - HiveQL: DONE.
  • WDCM Biases: DONE.
Mon, Mar 23, 9:13 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T248301: Pageviews for WMDE Communications from Technical Wishlist to Prioritized on the User-GoranSMilovanovic board.
Mon, Mar 23, 9:11 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering
GoranSMilovanovic created T248301: Pageviews for WMDE Communications.
Mon, Mar 23, 9:10 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering

Tue, Mar 10

GoranSMilovanovic added a comment to T247266: Installing package graph-tool on one stat-machine.

@elukey :) Edited T247266#5955801. It now states:

Tue, Mar 10, 12:01 PM · Analytics
GoranSMilovanovic added a comment to T247266: Installing package graph-tool on one stat-machine.

Just to confirm as a Data Scientist for Wikidata, WMDE: we absolutely want to have this available from our stat100* machines.

Tue, Mar 10, 11:56 AM · Analytics

Mon, Mar 9

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Christine_Domgoergen_WMDE Found it, there were two pageviews marked by the following tags:

Mon, Mar 9, 10:03 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Thu, Mar 5

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Christine_Domgoergen_WMDE You are welcome!

Thu, Mar 5, 12:36 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

What do you mean by that? Is there documentation about the standards, do you know?

Thu, Mar 5, 12:09 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Wed, Mar 4

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

As of T240351#5937402:

Wed, Mar 4, 7:29 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

As of T240351#5936973:

Wed, Mar 4, 7:10 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Mon, Mar 2

GoranSMilovanovic moved T240351: Daily Reporting: New Editors Thank You campaign 2019/2020 from Prioritized to Current/Deprioritized on the User-GoranSMilovanovic board.
Mon, Mar 2, 11:56 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

The reporting spreadsheets are now made tidier and are certainly fully consistent with the data in the Report.

Mon, Mar 2, 6:42 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

In the updated version of the report (shared here), the banner actions rates are included in section 1. 1. 4. immediately following the full data set for banner actions.

Mon, Mar 2, 6:30 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Sun, Mar 1

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Christine_Domgoergen_WMDE Also, I have noticed that some charts are not properly sorted on the horizontal axis representing date.

Sun, Mar 1, 10:51 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

I need to calculate the closing and extension rate of the banner from the banner actions table - do you have the data from 1.14 in a spreadsheet?

Sun, Mar 1, 10:46 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Christine_Domgoergen_WMDE In respect to T240351#5919056:

Sun, Mar 1, 10:27 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

in respect to T240351#5911537:

Sun, Mar 1, 10:23 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T237728: Featured Page Revision History: Support Phd Researcher in Residence WMDE .

2020/03/01 - data sets on editors interactions delivered to @Dydimusz and @WMDE-leszek via email.

Sun, Mar 1, 8:56 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Feb 26 2020

GoranSMilovanovic updated the task description for T246224: Upgrade to R version >= 3.6.0 on stat1005.
Feb 26 2020, 2:52 PM · WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic created T246224: Upgrade to R version >= 3.6.0 on stat1005.
Feb 26 2020, 2:49 PM · WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

I am currently working on T239200, T239199, and there are things that have a set deadline for tomorrow (e.g. updating the Wikidata Languages Landscape system). As soon as I can switch focus to this campaign I will get back to you.

Feb 26 2020, 11:59 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Feb 15 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Christine_Domgoergen_WMDE The end of February is fine, thank you for getting back to me on this one.

Feb 15 2020, 12:39 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Feb 12 2020

GoranSMilovanovic updated subscribers of T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

As the time passes by I am getting more and more focused on other projects and some day it might be difficult (and more time consuming) for me to get back into this campaign and provide additional analysis.
@Janina_Ottma_WMDE - what are the chances to meet and discuss what else needs to be done in the near future?

Feb 12 2020, 10:52 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Feb 4 2020

GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE Report with updated data from our recent work is here:

Feb 4 2020, 11:46 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)

Feb 3 2020

GoranSMilovanovic closed T239393: Public data set review for T237728, a subtask of T237728: Featured Page Revision History: Support Phd Researcher in Residence WMDE , as Invalid.
Feb 3 2020, 9:53 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T239393: Public data set review for T237728 as Invalid.

@Nuria Thank you very much for your assessment and your suggestions. Closing the ticket.

Feb 3 2020, 9:53 AM · Privacy, Analytics, WMDE-Analytics-Engineering, User-GoranSMilovanovic

Feb 2 2020

GoranSMilovanovic closed T244038: goransm.wdcm_clients_wb_entity_usage in hdfs is empty, a subtask of T239198: WDCM General, as Resolved.
Feb 2 2020, 2:55 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T244038: goransm.wdcm_clients_wb_entity_usage in hdfs is empty as Resolved.
  • Resolved;
  • however, the reason why goransm.wdcm_clients_wb_entity_usage when it should not have been is still unclear;
  • closing the ticket, monitoring continues.
Feb 2 2020, 2:55 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Feb 1 2020

GoranSMilovanovic added a comment to T244038: goransm.wdcm_clients_wb_entity_usage in hdfs is empty.
  • WDCM_Sqoop_Clients.R seems to be running smoothly from stat1004
  • first check: enwiki data set produced successfully.
Feb 1 2020, 12:53 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Jan 31 2020

GoranSMilovanovic triaged T244038: goransm.wdcm_clients_wb_entity_usage in hdfs is empty as High priority.
Jan 31 2020, 11:06 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T244038: goransm.wdcm_clients_wb_entity_usage in hdfs is empty from Technical Wishlist to Prioritized on the User-GoranSMilovanovic board.
Jan 31 2020, 11:06 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T244038: goransm.wdcm_clients_wb_entity_usage in hdfs is empty.
Jan 31 2020, 11:06 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Jan 30 2020

GoranSMilovanovic added a comment to T239393: Public data set review for T237728.

@Nuria Thank you for a prompt reply.

Jan 30 2020, 2:29 PM · Privacy, Analytics, WMDE-Analytics-Engineering, User-GoranSMilovanovic

Jan 29 2020

GoranSMilovanovic added a comment to T239393: Public data set review for T237728.

@Dydimusz and I would really like to proceed with his research project.
Could anyone take a look at these data sets and let us know if they comply with the WMF policy?
Thank you very much.

Jan 29 2020, 1:58 PM · Privacy, Analytics, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T240466: Measure the impact of Tainted References Wikidata feature from Prioritized to Radar on the User-GoranSMilovanovic board.
Jan 29 2020, 1:30 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata Tainted References, Wikidata

Jan 27 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE: sorry - I forgot to submit the report file here ^^ T240351#5833762.
It is an R Markdown Notebook - essentially and html file - with all the data, cross-tabulations and visualizations included. Just download it and open in your browser.
We use the Google Spreadsheets only for daily reporting during the campaign.
When you read the Report, please get back in touch with any questions that you might have. The A/B tests are not included (thus: Interim Report), for example, because many are possible so we need to discuss exactly what tests do we want to run (i.e. what tests make sense).
It would be the best to have a 1:1 Google Hangouts session to discuss the Report, especially if this is your first WMDE Banner Campaign. Thanks!

Jan 27 2020, 11:12 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE Here is the Interim Campaign Report for the WMDE Thank You 2020 Campaign.

Jan 27 2020, 11:09 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE Just to stay in touch on this, I have just completed the report for the WMDE Thank You 2019/2020 campaign (T240351) and I will now focus on the re-do of this (WMDE Autumn Banner 2019 Campaign 2019) campaign. As soon as the report is ready it will be shared here.

Jan 27 2020, 10:57 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)

Jan 23 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

Because of the WMDE_ vs. WPDE_ thing, I will have to re-run all data collection procedures.
Reporting back ASAP. @Janina_Ottma_WMDE The Campaign Report will be delivered tomorrow - re-running data collection will take some time.

Jan 23 2020, 8:33 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE from what I see in the data I can confirm what @kai.nissen is saying in the following way: the only registrations that we have from desktop have occurred on the first day of the campaign. I will re-check the data sets but I am pretty sure that this is the case. I should also be able to deliver the Campaign Report tonight, and then we can discuss it whenever you are ready.

Jan 23 2020, 2:49 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 22 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@kai.nissen So it's a Hive table. Ok. Thank you.

Jan 22 2020, 11:36 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE
Received training modules data from @Ragesoss - thank you!

Jan 22 2020, 7:00 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic closed T242631: Get user/editcount data to determine count at percentiles as Resolved.
Jan 22 2020, 6:59 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata

Jan 21 2020

GoranSMilovanovic added a comment to T242631: Get user/editcount data to determine count at percentiles.

@Jan_Dittrich Great! Would like to have the ETL procedure put on a crontab and run a regular monthly update, or shall we say just ask me when you need the data again?

Jan 21 2020, 12:06 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

As of the banner expansion clicks and banner closing quotes, I've checked out the WMDEBannerEvents Schema as suggested in T240361#5744403; both available tables are empty, from stat1004:

Jan 21 2020, 10:46 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic updated subscribers of T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

We have used the Training Modules for the WMDE Thank You 2019/2020 campaign and would need the data set.
Tha campaign was run between 1 and 20 January, 2020.

Jan 21 2020, 10:31 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 20 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

From T240361: the campaign got disabled yesterday 18:00 -> On to the Final Report now.

Jan 20 2020, 10:09 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE The 2020/01/18 and 2020/01/19 updates are ready; no new user registrations.

Jan 20 2020, 10:06 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

Could you include the new data in the final report so we have a final version with all the available data? This would be great and has no priority, just for documentation this is important.

Jan 20 2020, 9:16 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)

Jan 18 2020

GoranSMilovanovic moved T242631: Get user/editcount data to determine count at percentiles from Prioritized to Current/Deprioritized on the User-GoranSMilovanovic board.
Jan 18 2020, 11:00 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic added a comment to T242631: Get user/editcount data to determine count at percentiles.
  • results with anonymized user_ids shared with @Jan_Dittrich via e-mail (cc: @WMDE-leszek);
  • awaiting feedback;
  • no public results before we ask for a public data set review from the Analytics if this is to go on crontab and produce regular updates.
Jan 18 2020, 11:00 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic moved T236772: Document Wikibase Usage Aspects from Current/Deprioritized to Incoming on the User-GoranSMilovanovic board.
Jan 18 2020, 8:53 PM · User-Addshore, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), Wikidata, User-Ladsgroup, User-GoranSMilovanovic, WMDE-Analytics-Engineering
GoranSMilovanovic removed projects from T241416: WikiDaheim 2019 banner data for academic use: User-GoranSMilovanovic, WMDE-Analytics-Engineering.
Jan 18 2020, 8:53 PM · Analytics
GoranSMilovanovic moved T242631: Get user/editcount data to determine count at percentiles from Incoming to Prioritized on the User-GoranSMilovanovic board.
Jan 18 2020, 8:52 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic added a comment to T234161: WD Data Quality: compare quality vs usage on commons vs everything else.

@Lydia_Pintscher Is any additional work needed here or the ticket can be resolved?

Jan 18 2020, 8:50 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE The 2020/01/17 update is complete; no new user registrations.

Jan 18 2020, 8:46 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

So one other information I still need (or did I miss it somewhere?) is the page views via the tag WMDE_neweditors_autumn_2019_flyer from October 7th to November 1st

Jan 18 2020, 8:30 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE What I can tell you right now is that we will be able to process the pageviews from flyer from 2019/10/20 onwards (that would be 90 days in the past indeed).
Reporting back as soon as the query is done.

Jan 18 2020, 5:38 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE Sorry for not being able to respond any sooner than this.

Jan 18 2020, 4:43 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T243092: Find a better way for WMDE to get impression counts for their banners.

@Pcoombe @Addshore Perhaps I could help, but you need to let me know precisely what solution on WMDE banners you are looking for.

Jan 18 2020, 12:03 AM · Analytics, WMDE-Analytics-Engineering, WMDE-Fundraising-Tech, WMDE-FUN-Team, Fundraising-Backlog

Jan 17 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE The 2020/01/16 update is complete; two new user registrations.

Jan 17 2020, 12:30 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE Running the 2020/01/16 update now.

Jan 17 2020, 10:53 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

How are these edits split by edit class (as in final report 3.1.)? Could you add this information?

Jan 17 2020, 10:48 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

Also if you say the numbers in the spreadsheet are the ones to trust, we would need the timeframe from October 28th onwards because the newsletter was send out on October 28. Could you add them to the table?

Jan 17 2020, 10:47 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

So just to be sure: these are all page views of Wikipedia_vor_Ort in November from the tag WMDE_neweditors_autumn_2019_nl_lp1?

Jan 17 2020, 10:42 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)

Jan 16 2020

GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

In reference to: T235839#5809630

Jan 16 2020, 8:36 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

In reference to: T235839#5809565

Jan 16 2020, 8:04 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE I will try to respond to T235839#5809565 and T235839#5809630 tonight, but I can do it only later tonight.
I will email you if I make it just to make sure you get the data in the morning at least.

Jan 16 2020, 6:29 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE And here's the November 2019 pageviews data for the WMDE_neweditors_autumn_2019_nl_lp1 newsletter banner:

Jan 16 2020, 6:11 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE We have the October 2019 data (or what is left of them because of the wmf.webrequest purge after 90 days):

Jan 16 2020, 4:16 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE I think I will be able to deliver the pageviews until this evening, and probably even earlier, say around 18:00 CET.

Jan 16 2020, 2:34 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE The pageviews thing will take a while, sorry - it's just that the code needs to search through a lot of data and was hitting heavy against the cluster resources, so I had to switch it to search day by day through October and November 2019. I will be reporting back as soon as I have something.

Jan 16 2020, 2:05 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE In order to compare the results, we will pick up everything on:

Jan 16 2020, 12:18 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

Page Views Wikipedia_vor_Ort and LerneWikipedia: in the page view tool of wikipages we have quite some different numbers (see links), which of course differ a bit but on some days are far higher than the page views you found in the database. Can you check again, if the numbers in the report are correct?

Jan 16 2020, 12:01 PM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE As of the following:

Jan 16 2020, 11:26 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

In an early comment in the phab ticket you mentioned some user registrations happening before the start of the banner campaign (28. - 31.10.19) via the newsletter tags (WMDE_neweditors_autumn_2019_nl_lp2 and WMDE_neweditors_autumn_2019_nl_lp1). In the final report those registrations do not show up again, maybe because the time span of the report starts at the 1st of November? Could you have a look at it again and if you can confirm those registrations update the final report and the spreadsheet if necessary? The campaign time frame starts not only with the banner on Nov 1st but with the Flyers on October 7th (see dates in the graphic in the tracking doc). Could you double check again, that we have all the figures from this whole time span included in the report? This is also relevant for the page views coming from flyers for example. Thank you!

Jan 16 2020, 11:03 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T235839: Create daily tracking reports for campaign.

@Christine_Domgoergen_WMDE The ticket is re-opened in respect to the following requests:

Jan 16 2020, 9:50 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic reopened T235839: Create daily tracking reports for campaign as "Open".
Jan 16 2020, 9:49 AM · Core Platform Team Workboards (Clinic Duty Team), WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE The 2020/01/14 and 2020/01/15 updates are ready, no new user registrations.

Jan 16 2020, 9:48 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 14 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE The 2020/01/13 update is ready, no new user registrations.

Jan 14 2020, 12:42 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic added a comment to T242631: Get user/editcount data to determine count at percentiles.

The only thing that I do not understand here is the following planned column:

Jan 14 2020, 11:26 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic moved T240351: Daily Reporting: New Editors Thank You campaign 2019/2020 from Incoming to Prioritized on the User-GoranSMilovanovic board.
Jan 14 2020, 11:10 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)
GoranSMilovanovic moved T242631: Get user/editcount data to determine count at percentiles from Technical Wishlist to Incoming on the User-GoranSMilovanovic board.
Jan 14 2020, 11:10 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic added a project to T242631: Get user/editcount data to determine count at percentiles: User-GoranSMilovanovic.
Jan 14 2020, 11:10 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata

Jan 13 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE @tmletzko Thank you!

Jan 13 2020, 10:39 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 12 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

@Janina_Ottma_WMDE 2020/01/11 update is ready.

Jan 12 2020, 10:36 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 11 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

Update for 2020/01/10 is in the Spreadsheet, one fresh user registration on January 10.
@Janina_Ottma_WMDE Please let me know until when do we run this campaign. Thank you!

Jan 11 2020, 5:28 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 10 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

Updates for 2020/01/07 and 2020/01/08 included, no new user registrations since January 5.
@Janina_Ottma_WMDE When does this campaign end?

Jan 10 2020, 2:07 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 8 2020

GoranSMilovanovic added a comment to T240351: Daily Reporting: New Editors Thank You campaign 2019/2020.

Updates for 2020/01/05, 2020/01/06, and 2020/01/07 are now included.

Jan 8 2020, 11:43 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, WMDE-New-Editors-Banner-Campaigns (WMDE New Editor Thanks Campaign 2019)

Jan 6 2020

GoranSMilovanovic moved T241416: WikiDaheim 2019 banner data for academic use from Radar to Incoming on the User-GoranSMilovanovic board.
Jan 6 2020, 1:03 PM · Analytics