GoranSMilovanovic (GoranSM)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Mar 20 2017, 3:58 PM (90 w, 3 d)
Availability
Available
LDAP User
GoranSMilovanovic
MediaWiki User
GoranSMilovanovic [ Global Accounts ]

Recent Activity

Tue, Dec 11

GoranSMilovanovic updated subscribers of T211690: Daily Reports for the Thank You 2019 Campaign.
Tue, Dec 11, 1:55 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T211690: Daily Reports for the Thank You 2019 Campaign.
Tue, Dec 11, 1:55 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Fri, Dec 7

GoranSMilovanovic closed T203368: Blog on the Wiktionary Cognate Dashboard as Invalid.
Fri, Dec 7, 12:06 AM · User-GoranSMilovanovic
GoranSMilovanovic closed T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis as Resolved.
Fri, Dec 7, 12:06 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Thu, Dec 6

GoranSMilovanovic added a comment to T209055: WMDE Banner Campaigns Dashboard .

@Stefan_Schneider_WMDE Thank you for your feedback. I would like to collect all feedback on this dashboard before introducing any changes. Thus I will be able to plan the dashboard re-design appropriately. Thanks.

Thu, Dec 6, 11:21 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Wed, Dec 5

GoranSMilovanovic committed rAWTAe39494395f04: pre-processing in production (authored by GoranSMilovanovic).
pre-processing in production
Wed, Dec 5, 6:52 PM
GoranSMilovanovic added a comment to T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis.
  • The dashboard now loads fast as lightning;
  • all data pre-processing happens in production.
Wed, Dec 5, 3:45 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Mon, Dec 3

GoranSMilovanovic closed T208302: Final Report: Autumn Banner Campaign 2018 as Resolved.
  • Since this Campaign is now archived and all standardized analytics served from the WMDE New Editors Dashboard,
  • I am closing this ticket and kindly asking to re-direct all further discussion to T209055.
Mon, Dec 3, 1:12 PM · WMDE-New-Editors-Banner-Campaigns (Reportings), WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T209055: WMDE Banner Campaigns Dashboard from Prioritized to New Editors/Campaigns on the User-GoranSMilovanovic board.
Mon, Dec 3, 1:10 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic updated subscribers of T209055: WMDE Banner Campaigns Dashboard .
  • The dashboard is now operational and ready for testing: http://wdcm.wmflabs.org/WMDE_NewEditorsDashboard/
  • All comments, criticisms, suggestions for new features and analytical outputs, should be made here;
  • The dashboard integrates the once upon a time regularly updated New Editors Monthly Report with the WMDE Banner Campaign analytics;
  • All updates that could have been made daily, will be run daily indeed, as soon as we are finished with testing;
  • The update engine runs from stat1007 while the Dashboard itself is served from a CloudVPS instance wikidataconcepts;
  • The current, test version relies on the 2018 Banner Campaigns only; everything else will be added to the dashboard's back-end soon.
Mon, Dec 3, 12:24 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T189298: Additional Information: Monthly New Editors Report as Resolved.
  • Since the WMDE New Editors Dashboard is now operational,
  • and since all standardized analytics for this team will be served there from now on,
  • comments and suggestions on any new features or analytical outputs should be placed on T209055;
  • closing this task.
Mon, Dec 3, 12:18 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Thanks-2018)
GoranSMilovanovic closed T189298: Additional Information: Monthly New Editors Report, a subtask of T209055: WMDE Banner Campaigns Dashboard , as Resolved.
Mon, Dec 3, 12:18 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Sun, Dec 2

GoranSMilovanovic added a comment to T189298: Additional Information: Monthly New Editors Report.
  • All necessary data for the analytics as demanded in the doc are in place;
  • Outputs will be served from the WMDE Banner Campaign dashboard (#T209055);
  • The dashboard will be available for testing as of Monday, 3rd December.
Sun, Dec 2, 1:21 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Thanks-2018)
GoranSMilovanovic closed T210463: Public Data for the WMDE Banner Campaigns Dashboard as Invalid.
  • I will close this as invalid: a different schema is being applied and no user Id fields, hashed or not, will be used: merely aggregates will.
Sun, Dec 2, 1:19 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic closed T210463: Public Data for the WMDE Banner Campaigns Dashboard, a subtask of T209055: WMDE Banner Campaigns Dashboard , as Invalid.
Sun, Dec 2, 1:19 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T171420: Migrate New Editors Analytics to Production as Resolved.
  • the update engine is now fully migrated into production;
  • the outputs will be available from the WMDE Banner Campaigns Dashboard (see: #T209055)
Sun, Dec 2, 1:18 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T171420: Migrate New Editors Analytics to Production, a subtask of T209055: WMDE Banner Campaigns Dashboard , as Resolved.
Sun, Dec 2, 1:18 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Thu, Nov 29

GoranSMilovanovic moved T210664: List of most used Wikidata entities from Technical Wishlist to WDCM on the User-GoranSMilovanovic board.
Thu, Nov 29, 6:03 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, Wikidata
GoranSMilovanovic claimed T210664: List of most used Wikidata entities.
Thu, Nov 29, 6:02 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, Wikidata
GoranSMilovanovic added a comment to T209055: WMDE Banner Campaigns Dashboard .

@Stefan_Schneider_WMDE Always. In the meantime, I had to get back to the dashboard engine and introduce additional optimizations and checks to ensure the maximal possible consistency of our data. However... once done properly, it should serve as well in the future, I guess.

Thu, Nov 29, 1:41 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis.
  • The Advanced Search Extension usage is now spiking on the dashboard's Special:Search graph :)
Thu, Nov 29, 11:11 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Wed, Nov 28

GoranSMilovanovic updated subscribers of T210664: List of most used Wikidata entities.

@Lydia_Pintscher Should we pick up this one? Please let me know.

Wed, Nov 28, 9:11 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, Wikidata
GoranSMilovanovic added a comment to T209055: WMDE Banner Campaigns Dashboard .

Dashboard update engine was completed recently:

Wed, Nov 28, 7:16 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T210463: Public Data for the WMDE Banner Campaigns Dashboard from Technical Wishlist to New Editors/Campaigns on the User-GoranSMilovanovic board.
Wed, Nov 28, 7:12 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic closed T206018: WMDE Campaign Archive as Resolved.
Wed, Nov 28, 7:12 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T206018: WMDE Campaign Archive.

This is completed a while ago:

Wed, Nov 28, 7:12 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T193969: track percentage of articles making use of data from Wikidata.

Please expand in the report what's meant by "Wikidata usage", it's ambiguous and could be interpreted as items linked vs statement-level data reused via templates.

Wed, Nov 28, 7:06 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic moved T208569: Get Wikidata clickstream from Prioritized to Current/Deprioritized on the User-GoranSMilovanovic board.
Wed, Nov 28, 6:48 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata, Wikidata-Termbox-Hike
GoranSMilovanovic added a comment to T208569: Get Wikidata clickstream.

@Lea_WMDE Just to clarify, I will put no further efforts here until you let me know what you think in respect to my insights in T208569#4767950.

Wed, Nov 28, 6:48 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata, Wikidata-Termbox-Hike
GoranSMilovanovic added a comment to T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis.
  • Missing data recollected, dashboard operating as usual.
Wed, Nov 28, 1:34 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis.
  • One missing update run detected; missing data are being recollected now;
  • critical tests will be conducted tomorrow, first allowing for one attempt at the standard dashboard update (i.e. as it is now) and after the extension becomes default everywhere.
Wed, Nov 28, 12:33 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Mon, Nov 26

GoranSMilovanovic triaged T210463: Public Data for the WMDE Banner Campaigns Dashboard as High priority.
Mon, Nov 26, 10:40 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Analytics
GoranSMilovanovic committed rAWCM3426bd147137: Sitelinks and Titles (authored by GoranSMilovanovic).
Sitelinks and Titles
Mon, Nov 26, 6:14 PM
GoranSMilovanovic added a comment to T209891: Analyze results of sameAs A/B test.

@Tbayer what @Niedzielski has just suggested (tested) is probably the most straightforward way to obtain the dataset.

Mon, Nov 26, 3:51 PM · Product-Analytics, SEO
GoranSMilovanovic added a comment to T209055: WMDE Banner Campaigns Dashboard .

All 2018 Banner Campaigns are now archived:

Mon, Nov 26, 2:49 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T209891: Analyze results of sameAs A/B test.

@Tbayer In general, when you need Wikidata usage datasets:

Mon, Nov 26, 12:24 PM · Product-Analytics, SEO
GoranSMilovanovic added a comment to T209891: Analyze results of sameAs A/B test.
(i.e. appear in the sitelinks of said item)
Mon, Nov 26, 12:08 PM · Product-Analytics, SEO

Fri, Nov 23

GoranSMilovanovic added a comment to T208569: Get Wikidata clickstream.

@JAllemandou So kind of you, thanks!

Fri, Nov 23, 2:37 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata, Wikidata-Termbox-Hike

Thu, Nov 22

GoranSMilovanovic updated subscribers of T208569: Get Wikidata clickstream.

@JAllemandou Hey, I need an insight into the production code for the Clickstream dataset, but I can't find the code repository anywhere. May you could help? Thanks. N.B. I am not looking for Python use cases (I've found them) neither for the SQL extraction of the monthly updates (I've seen that too) but rather for the code that feeds the tables in the clickstream database in Hadoop.

Thu, Nov 22, 3:26 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata, Wikidata-Termbox-Hike
GoranSMilovanovic added a parent task for T171258: WDCM: Process Module Scaling/migrate to Production: T210147: Optimize WDCM update engines.
Thu, Nov 22, 2:30 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added subtasks for T210147: Optimize WDCM update engines: T171258: WDCM: Process Module Scaling/migrate to Production, T200609: Can't write from Spark to local FS, T203366: Replace {maptpx} for Topic Modeling in WDCM, T179286: WDCM Regular Updates.
Thu, Nov 22, 2:30 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a parent task for T179286: WDCM Regular Updates: T210147: Optimize WDCM update engines.
Thu, Nov 22, 2:30 PM · User-Addshore, Wikidata, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T210147: Optimize WDCM update engines from WDCM to Prioritized on the User-GoranSMilovanovic board.
Thu, Nov 22, 2:29 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T210147: Optimize WDCM update engines.
Thu, Nov 22, 2:29 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added subtasks for T210146: Re-design WDCM Dashboards: T180891: WDCM: Optimize WDCM Shiny Dashboards, T179316: UI issue on WDCM:Overcrowding in screen.
Thu, Nov 22, 2:26 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a parent task for T179316: UI issue on WDCM:Overcrowding in screen: T210146: Re-design WDCM Dashboards.
Thu, Nov 22, 2:26 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering
GoranSMilovanovic added a parent task for T180891: WDCM: Optimize WDCM Shiny Dashboards: T210146: Re-design WDCM Dashboards.
Thu, Nov 22, 2:26 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T210146: Re-design WDCM Dashboards from WDCM to Prioritized on the User-GoranSMilovanovic board.
Thu, Nov 22, 2:25 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T210146: Re-design WDCM Dashboards.
Thu, Nov 22, 2:25 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T171258: WDCM: Process Module Scaling/migrate to Production from Prioritized to WDCM on the User-GoranSMilovanovic board.
Thu, Nov 22, 2:22 PM · User-Addshore, Patch-For-Review, WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T180891: WDCM: Optimize WDCM Shiny Dashboards from Prioritized to WDCM on the User-GoranSMilovanovic board.
Thu, Nov 22, 2:22 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T200609: Can't write from Spark to local FS from Prioritized to WDCM on the User-GoranSMilovanovic board.
Thu, Nov 22, 2:22 PM · Analytics-Cluster, WMDE-Analytics-Engineering, User-GoranSMilovanovic, Analytics
GoranSMilovanovic added a comment to T209891: Analyze results of sameAs A/B test.

@Tbayer Assuming that we are focusing on the main namespace only: a part of the answer is found on the Percentage of articles making use of data from Wikidata page, however, the (S)itelink usage aspect (see: wbc entity_usage in the wikibase schema) is not accounted for. I can run a check for you if want, including all WD item usage aspects.

Thu, Nov 22, 11:00 AM · Product-Analytics, SEO

Wed, Nov 21

GoranSMilovanovic added a comment to T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis.
  • Also, to improve the dashboard responsiveness, some of the local processing in Shiny server.R will be migrated to the dashboard's update engine.
Wed, Nov 21, 10:31 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis from Technical Wishlist to Prioritized on the User-GoranSMilovanovic board.
Wed, Nov 21, 10:18 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T210063: Monitor: Nov 28 Advanced Search as a default feature to all wikis.
Wed, Nov 21, 10:18 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Tue, Nov 20

GoranSMilovanovic moved T209055: WMDE Banner Campaigns Dashboard from New Editors/Campaigns to Prioritized on the User-GoranSMilovanovic board.
Tue, Nov 20, 2:44 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Mon, Nov 19

GoranSMilovanovic added a comment to T206214: Basic data on Wikidata use: Edit counts, frequency.

@Jan_Dittrich Jan, please: do we need this ticket anymore? Thanks!

Mon, Nov 19, 1:38 AM · Wikidata-Campsite, User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata
GoranSMilovanovic moved T208569: Get Wikidata clickstream from Technical Wishlist to Prioritized on the User-GoranSMilovanovic board.
Mon, Nov 19, 1:35 AM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, Wikidata, Wikidata-Termbox-Hike
GoranSMilovanovic added a comment to T203368: Blog on the Wiktionary Cognate Dashboard.

@Lea_Lacroix_WMDE @johl I guess we should close this one?

Mon, Nov 19, 1:34 AM · User-GoranSMilovanovic
GoranSMilovanovic committed rAWWD2d9d0f147b90: info (authored by GoranSMilovanovic).
info
Mon, Nov 19, 1:34 AM
GoranSMilovanovic closed T187396: WDCM for (S)itelinks only as Resolved.
Mon, Nov 19, 1:33 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T187396: WDCM for (S)itelinks only.
  • Documentation completed.
Mon, Nov 19, 1:00 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T209339: WDCM (S)itelinks documentation, a subtask of T187396: WDCM for (S)itelinks only, as Resolved.
Mon, Nov 19, 1:00 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T209339: WDCM (S)itelinks documentation as Resolved.
Mon, Nov 19, 1:00 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Sun, Nov 18

GoranSMilovanovic committed rAWWDeae2e7efe105: init (authored by GoranSMilovanovic).
init
Sun, Nov 18, 1:23 AM
GoranSMilovanovic added a comment to T187396: WDCM for (S)itelinks only.
  • Gerrit repo obtained; init. commit merged.
Sun, Nov 18, 1:18 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 13 2018

GoranSMilovanovic added a comment to T187396: WDCM for (S)itelinks only.
  • WDCM Wikipedia Semantics updates scheduled: 2, 8, 15, 21, 28 every month; crontab from stat1007.
Nov 13 2018, 12:31 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T187396: WDCM for (S)itelinks only.
  • CloudVPS/Production sync completed;
  • Gerrit repo requested.
Nov 13 2018, 12:21 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T187396: WDCM for (S)itelinks only from Prioritized to Current/Deprioritized on the User-GoranSMilovanovic board.
Nov 13 2018, 8:30 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T209339: WDCM (S)itelinks documentation from Technical Wishlist to WDCM on the User-GoranSMilovanovic board.
Nov 13 2018, 8:30 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic triaged T209339: WDCM (S)itelinks documentation as High priority.
Nov 13 2018, 8:30 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T187396: WDCM for (S)itelinks only.
  • Placing in production now: weekly schedule.
Nov 13 2018, 8:25 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T203234: Optimize WDCM (S)itelinks engine runs as Resolved.
  • One engine update run takes approx. 8h;
  • putting on a weekly update update schedule now;
  • even if the ETL phase can be further optimized, the ML phase is still critical w. {maptpx};
  • it is questionable whether Spark MLlib, MALLET, or anything else, can help in that respect.
Nov 13 2018, 8:24 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T203234: Optimize WDCM (S)itelinks engine runs, a subtask of T187396: WDCM for (S)itelinks only, as Resolved.
Nov 13 2018, 8:24 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 8 2018

GoranSMilovanovic added a subtask for T209055: WMDE Banner Campaigns Dashboard : T189298: Additional Information: Monthly New Editors Report.
Nov 8 2018, 1:25 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a parent task for T189298: Additional Information: Monthly New Editors Report: T209055: WMDE Banner Campaigns Dashboard .
Nov 8 2018, 1:25 PM · User-GoranSMilovanovic, WMDE-Analytics-Engineering, WMDE-New-Editors-Banner-Campaigns (Banner-Campaign-Thanks-2018)
GoranSMilovanovic added a parent task for T171420: Migrate New Editors Analytics to Production: T209055: WMDE Banner Campaigns Dashboard .
Nov 8 2018, 1:24 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a subtask for T209055: WMDE Banner Campaigns Dashboard : T171420: Migrate New Editors Analytics to Production.
Nov 8 2018, 1:24 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic created T209055: WMDE Banner Campaigns Dashboard .
Nov 8 2018, 1:24 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 7 2018

GoranSMilovanovic moved T187396: WDCM for (S)itelinks only from Current/Deprioritized to Prioritized on the User-GoranSMilovanovic board.
Nov 7 2018, 10:48 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic moved T206018: WMDE Campaign Archive from Prioritized to Current/Deprioritized on the User-GoranSMilovanovic board.
Nov 7 2018, 10:48 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 6 2018

GoranSMilovanovic added a comment to T208302: Final Report: Autumn Banner Campaign 2018.

@Stefan_Schneider_WMDE Could you please let me know if the following section of the Report: 1.2.3 Pageviews Overview: totals per Tag/Page contain the pageviews data that you were looking for?

Nov 6 2018, 11:31 AM · WMDE-New-Editors-Banner-Campaigns (Reportings), WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 5 2018

GoranSMilovanovic moved T187396: WDCM for (S)itelinks only from Prioritized to Current/Deprioritized on the User-GoranSMilovanovic board.
Nov 5 2018, 1:47 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T203235: The WDCM (S)itelinks Dashboard prototype as Resolved.
  • The dashboard is fully operational now and will be placed on a regular weekly update schedule;
  • It is possible that some additional functionality will be added in the future.
Nov 5 2018, 1:44 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T203235: The WDCM (S)itelinks Dashboard prototype, a subtask of T187396: WDCM for (S)itelinks only, as Resolved.
Nov 5 2018, 1:44 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 4 2018

GoranSMilovanovic added a comment to T203234: Optimize WDCM (S)itelinks engine runs.
  • selection criteria adjusted;
  • ML phase now.
Nov 4 2018, 9:53 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T203234: Optimize WDCM (S)itelinks engine runs.
  • Final adjustments in the projects selection criteria under way;
  • the engine will run from stat1007 crontab.
Nov 4 2018, 6:05 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 2 2018

GoranSMilovanovic closed T208486: Migrate all regular WMDE Analytics updates to stat1007 as Resolved.
  • migration from stat1005 to stat1007 complete;
  • all R WMDE analytics jobs that we have there will remain there for some time at least (at least until the GPU installation/testing on stat1005 is done);
  • all engines and dashboards tested and updated; engines running on cron jobs from stat1007.
Nov 2 2018, 2:19 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a comment to T208486: Migrate all regular WMDE Analytics updates to stat1007 .

Status as of Nov 2, 2018, ~ 10:50 CET:

Nov 2 2018, 9:52 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic added a project to T208567: Count Wikidata page views per page type: WMDE-Analytics-Engineering.
Nov 2 2018, 8:59 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic, Wikidata-Termbox-Hike, Wikidata
GoranSMilovanovic added a comment to T208486: Migrate all regular WMDE Analytics updates to stat1007 .

Status as of Nov 2, 2018, ~ 09:38 CET:

Nov 2 2018, 8:36 AM · WMDE-Analytics-Engineering, User-GoranSMilovanovic

Nov 1 2018

GoranSMilovanovic added a comment to T208486: Migrate all regular WMDE Analytics updates to stat1007 .
  • Directory structure is now fixed;
  • crontab from stat1007 to replace stat1005 updates soon.
Nov 1 2018, 10:09 PM · WMDE-Analytics-Engineering, User-GoranSMilovanovic
GoranSMilovanovic closed T208490: Please copy the wmde* and wdcm directories to stat1007 /srv/published-datasets as Resolved.

@elukey Luca, thank you for your help here: everything seems superfine, including the directory structure in srv/published-datasets.

Nov 1 2018, 10:08 PM · Analytics-Kanban, WMDE-Analytics-Engineering, User-GoranSMilovanovic, Analytics
GoranSMilovanovic closed T208490: Please copy the wmde* and wdcm directories to stat1007 /srv/published-datasets, a subtask of T205846: Move users from stat1005 to stat1007, as Resolved.
Nov 1 2018, 10:08 PM · Analytics-Kanban, Patch-For-Review, Analytics
GoranSMilovanovic added a comment to T208490: Please copy the wmde* and wdcm directories to stat1007 /srv/published-datasets.

@elukey Hi Luca, I guess you wanted to say that you have synced wmde* and wdcm to stat1007.

Nov 1 2018, 2:08 PM · Analytics-Kanban, WMDE-Analytics-Engineering, User-GoranSMilovanovic, Analytics
GoranSMilovanovic moved T208490: Please copy the wmde* and wdcm directories to stat1007 /srv/published-datasets from Technical Wishlist to Prioritized on the User-GoranSMilovanovic board.
Nov 1 2018, 11:56 AM · Analytics-Kanban, WMDE-Analytics-Engineering, User-GoranSMilovanovic, Analytics
GoranSMilovanovic added projects to T208490: Please copy the wmde* and wdcm directories to stat1007 /srv/published-datasets: User-GoranSMilovanovic, WMDE-Analytics-Engineering.
Nov 1 2018, 11:56 AM · Analytics-Kanban, WMDE-Analytics-Engineering, User-GoranSMilovanovic, Analytics
GoranSMilovanovic triaged T208490: Please copy the wmde* and wdcm directories to stat1007 /srv/published-datasets as High priority.
Nov 1 2018, 11:55 AM · Analytics-Kanban, WMDE-Analytics-Engineering, User-GoranSMilovanovic, Analytics
GoranSMilovanovic created T208490: Please copy the wmde* and wdcm directories to stat1007 /srv/published-datasets.
Nov 1 2018, 11:55 AM · Analytics-Kanban, WMDE-Analytics-Engineering, User-GoranSMilovanovic, Analytics