Page MenuHomePhabricator
Feed Advanced Search

Nov 19 2015

kevinator closed T117247: Understand the Perl code for "Visiting Country per Wiki" report {lama} as Resolved.
Nov 19 2015, 5:09 PM · Analytics-Kanban
kevinator closed T117247: Understand the Perl code for "Visiting Country per Wiki" report {lama}, a subtask of T115607: Traffic Breakdown Report - Visiting Country per Wiki {lama}, as Resolved.
Nov 19 2015, 5:09 PM · Analytics
kevinator closed T118863: Deploy eventlogging from new repository [5 pts] as Resolved.
Nov 19 2015, 5:08 PM · Patch-For-Review, Analytics-EventLogging, Event-Platform, Analytics-Kanban
kevinator closed T118863: Deploy eventlogging from new repository [5 pts], a subtask of T114443: EventBus MVP, as Resolved.
Nov 19 2015, 5:08 PM · Analytics-Radar, TechCom-RFC (TechCom-RFC-Closed), Proposal, Operations, Wikidata-Query-Service, Service-Architecture, Services, MediaWiki-General, Wikidata, Epic, Discovery, Event-Platform
kevinator renamed T118863: Deploy eventlogging from new repository [5 pts] from Deploy eventlogging from new repository. [5 pts] to Deploy eventlogging from new repository [5 pts].
Nov 19 2015, 5:08 PM · Patch-For-Review, Analytics-EventLogging, Event-Platform, Analytics-Kanban
kevinator closed T118574: Troubleshoot Hebrew characters in Wikimetrics {dove} [2 pts] as Resolved.
Nov 19 2015, 5:08 PM · Analytics-Kanban
kevinator closed T117226: Pageview API documentation for end users {slug} [8 pts] as Resolved.
Nov 19 2015, 5:08 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator updated the task description for T117226: Pageview API documentation for end users {slug} [8 pts].
Nov 19 2015, 5:07 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T118450: Backfill cassandra pageview data - September [5 pts] {slug} as Resolved.
Nov 19 2015, 5:04 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T118785: Missing Pageview API data for one article {slug} [3 pts] as Resolved.
Nov 19 2015, 5:04 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T117244: Understand the Perl code for this report - Visiting Country per Wikipedia Language {lama}, a subtask of T115608: Traffic Breakdown Report - Visiting Country per Wikipedia Language {lama}, as Resolved.
Nov 19 2015, 5:04 PM · Analytics
kevinator closed T117244: Understand the Perl code for this report - Visiting Country per Wikipedia Language {lama} as Resolved.
Nov 19 2015, 5:04 PM · Analytics-Kanban
kevinator closed T117243: Understand the Perl code for this report - visiting country {lama} as Resolved.
Nov 19 2015, 5:03 PM · Analytics-Kanban
kevinator closed T117243: Understand the Perl code for this report - visiting country {lama}, a subtask of T115605: Traffic Breakdown Report - Visiting Country {lama}, as Resolved.
Nov 19 2015, 5:03 PM · Analytics
kevinator closed T117225: Pageview API Press release {slug} [2 pts] as Resolved.
Nov 19 2015, 5:03 PM · Analytics-Kanban
kevinator closed T114379: Feed Wikistats traffic reports with aggregated hive data {lama} [21 pts] as Resolved.
Nov 19 2015, 5:03 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats
kevinator closed T114830: configure RESTBase pageview proxy to Analytics' cluster {slug} [34 pts] as Resolved.
Nov 19 2015, 5:02 PM · Datasets-General-or-Unknown, RESTBase-API, Services, Analytics-Kanban, RESTBase

Nov 16 2015

kevinator placed T117473: Requesting access to rest base and cassandra nodes up for grabs.
Nov 16 2015, 8:59 PM · Patch-For-Review, Operations, SRE-Access-Requests
kevinator updated subscribers of T117473: Requesting access to rest base and cassandra nodes .

approved: you can add @Nuria, @mforns and @madhuvishy to aqs-user

Nov 16 2015, 8:59 PM · Patch-For-Review, Operations, SRE-Access-Requests

Nov 13 2015

kevinator edited projects for T116678: Country mapping routine for proxied requests, added: Analytics-Backlog; removed Analytics.
Nov 13 2015, 6:35 AM · Analytics-Radar, Reading-Admin, Zero

Nov 12 2015

kevinator edited projects for T117945: Add alarms for high volume of views to pages with replacement characters, added: Analytics-Backlog; removed Analytics.
Nov 12 2015, 8:10 PM · Analytics, Analytics-Data-Quality, Datasets-Webstatscollector, Language-Team
kevinator added a comment to T117345: Exclude MobileMenu from Pageviews.

Thanks @Ironholds

Nov 12 2015, 5:07 PM · Analytics-Kanban, Patch-For-Review

Nov 11 2015

kevinator added a comment to T117345: Exclude MobileMenu from Pageviews.

Please update the wiki changelog as well:
https://meta.wikimedia.org/wiki/Research:Page_view#Change_log

Nov 11 2015, 5:15 PM · Analytics-Kanban, Patch-For-Review

Nov 6 2015

kevinator added a comment to T117224: Pageview API showcase App {slug}.

I showed it to Dario and he had a suggestion: underneath the chart, add links to the to the RESTFul API call being made. That way users can see how the API is being used and can follow the link to see the data being returned.

Nov 6 2015, 6:50 PM · Analytics-Kanban

Nov 4 2015

kevinator edited projects for T117615: Provide weekly app session metrics separately for Android and iOS, and move to 7 day counts [13 pts], added: Analytics-Backlog; removed Analytics.
Nov 4 2015, 12:10 AM · Patch-For-Review, Analytics-Kanban

Nov 2 2015

kevinator updated the task description for T117502: fix 'day' description in RESTBase Pageview API.
Nov 2 2015, 10:49 PM · Analytics-Backlog
kevinator created T117502: fix 'day' description in RESTBase Pageview API.
Nov 2 2015, 10:48 PM · Analytics-Backlog
kevinator renamed T117496: Community has a Stats landing page with links from Lading page to show what information is where to Community has a Stats lading page with links.
Nov 2 2015, 10:39 PM · Analytics

Oct 30 2015

kevinator updated subscribers of T114379: Feed Wikistats traffic reports with aggregated hive data {lama} [21 pts].

@Milimetric, I spoke to @DFoy and there aren't any issues writing Wikipedia Zero pageviews numbers per project and page as long as there is no data on the country the requests come from.

Oct 30 2015, 11:59 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats
kevinator updated the task description for T117141: {loon} Refactor Data Dumps.
Oct 30 2015, 5:28 PM · Analytics-Kanban
kevinator renamed T117141: {loon} Refactor Data Dumps from {loon} to {loon} Refactor Data Dumps.
Oct 30 2015, 12:22 AM · Analytics-Kanban
kevinator created T117141: {loon} Refactor Data Dumps.
Oct 30 2015, 12:22 AM · Analytics-Kanban

Oct 29 2015

kevinator updated the task description for T99952: {mule} Hadoop Cluster Expansion.
Oct 29 2015, 9:12 PM · Analytics-Clusters, Analytics-Kanban
kevinator closed T101120: {musk} Pageviews in Vital Signs as Resolved.
Oct 29 2015, 9:11 PM · Analytics-Kanban, Analytics-Clusters
kevinator closed T96314: {wren} PV Aggregates as Resolved.
Oct 29 2015, 9:11 PM · Analytics-Kanban, Analytics-Clusters
kevinator updated the task description for T102225: {stag} EventLogging on Kafka.
Oct 29 2015, 9:10 PM · Analytics-EventLogging, Analytics-Kanban
kevinator added a subtask for T88647: {bear} Last Access Counts: T115350: Research whether no cookie header numbers improve Last access uniques {bear} [13 pts].
Oct 29 2015, 9:00 PM · Epic, Analytics-Clusters, Analytics-Kanban
kevinator added a parent task for T115350: Research whether no cookie header numbers improve Last access uniques {bear} [13 pts]: T88647: {bear} Last Access Counts.
Oct 29 2015, 9:00 PM · Analytics-Kanban, Analytics-Clusters
kevinator renamed T116209: Improve record size on cassandra storage for pageview API data (RESTBase changes) {slug} [8 pts] from Improve record size on cassandra storage for pageview API data to Improve record size on cassandra storage for pageview API data {slug}.
Oct 29 2015, 8:47 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T116763: Test Elastic search pageview data loading/retrieval on labs {slug} [8 pts], a subtask of T117008: Data Store hardware procurement - 2015, as Resolved.
Oct 29 2015, 8:47 PM · Analytics
kevinator closed T116763: Test Elastic search pageview data loading/retrieval on labs {slug} [8 pts] as Resolved.
Oct 29 2015, 8:47 PM · Datasets-General-or-Unknown, Analytics-Kanban, Analytics-Backlog
kevinator closed T113252: camus offset fails/continues Load job {hawk} [13 pts], a subtask of T109192: Implement better Webrequest load monitoring {hawk}, as Resolved.
Oct 29 2015, 8:40 PM · Analytics-Backlog, Analytics-Clusters
kevinator closed T113252: camus offset fails/continues Load job {hawk} [13 pts] as Resolved.
Oct 29 2015, 8:40 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters
kevinator closed T115669: Use Burrow for Kafka Consumer offset lag monitoring {hawk} [8 pts] as Resolved.
Oct 29 2015, 8:39 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters
kevinator closed T88504: PM sees reports on browsers (Weekly or Daily) {lama} [8 pts] as Resolved.
Oct 29 2015, 8:39 PM · Reading-Admin, Patch-For-Review, Analytics-Kanban, good first task, Analytics-Clusters
kevinator updated the task description for T88504: PM sees reports on browsers (Weekly or Daily) {lama} [8 pts].
Oct 29 2015, 8:39 PM · Reading-Admin, Patch-For-Review, Analytics-Kanban, good first task, Analytics-Clusters
kevinator closed T116084: Create deb package for Burrow {hawk} [5 pts], a subtask of T115669: Use Burrow for Kafka Consumer offset lag monitoring {hawk} [8 pts], as Resolved.
Oct 29 2015, 8:34 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters
kevinator closed T116084: Create deb package for Burrow {hawk} [5 pts] as Resolved.
Oct 29 2015, 8:34 PM · Patch-For-Review, Analytics-Kanban
kevinator renamed T116931: Browser Report. Small bugfixes {lama} [5 pts] from Browser Report. Small bugfixes to Browser Report. Small bugfixes {lama}.
Oct 29 2015, 8:33 PM · Patch-For-Review, Analytics-Clusters, Analytics-Kanban
kevinator renamed T88504: PM sees reports on browsers (Weekly or Daily) {lama} [8 pts] from PM sees reports on browsers (Weekly or Daily) [8 pts] to PM sees reports on browsers (Weekly or Daily) {lama} [8 pts].
Oct 29 2015, 8:33 PM · Reading-Admin, Patch-For-Review, Analytics-Kanban, good first task, Analytics-Clusters
kevinator renamed T116763: Test Elastic search pageview data loading/retrieval on labs {slug} [8 pts] from Test Elastic search pageview data loading/retrieval on labs {slug} to Test Elastic search pageview data loading/retrieval on labs {slug} [8 pts].
Oct 29 2015, 4:13 PM · Datasets-General-or-Unknown, Analytics-Kanban, Analytics-Backlog
kevinator renamed T114379: Feed Wikistats traffic reports with aggregated hive data {lama} [21 pts] from Feed Wikistats traffic reports with aggregated hive data {lama} [8 pts] to Feed Wikistats traffic reports with aggregated hive data {lama} [21 pts].
Oct 29 2015, 4:09 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats
kevinator renamed T115669: Use Burrow for Kafka Consumer offset lag monitoring {hawk} [8 pts] from Use Burrow for Kafka Consumer offset lag monitoring {hawk} to Use Burrow for Kafka Consumer offset lag monitoring {hawk} [8 pts].
Oct 29 2015, 4:04 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters
kevinator added subtasks for T117008: Data Store hardware procurement - 2015: T116409: Druid testing on labs to asses whether is a suitable Cassandra replacement. {slug} [8 pts], T116763: Test Elastic search pageview data loading/retrieval on labs {slug} [8 pts].
Oct 29 2015, 12:46 AM · Analytics
kevinator added a parent task for T116409: Druid testing on labs to asses whether is a suitable Cassandra replacement. {slug} [8 pts]: T117008: Data Store hardware procurement - 2015.
Oct 29 2015, 12:46 AM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator added a parent task for T116763: Test Elastic search pageview data loading/retrieval on labs {slug} [8 pts]: T117008: Data Store hardware procurement - 2015.
Oct 29 2015, 12:46 AM · Datasets-General-or-Unknown, Analytics-Kanban, Analytics-Backlog
kevinator created T117008: Data Store hardware procurement - 2015.
Oct 29 2015, 12:44 AM · Analytics
kevinator closed T99952: {mule} Hadoop Cluster Expansion as Resolved.

This project is done, so I am going to close it :-)

Oct 29 2015, 12:29 AM · Analytics-Clusters, Analytics-Kanban
kevinator removed a subtask for T99952: {mule} Hadoop Cluster Expansion: T110090: Create new Hive / Oozie server from old analytics Dell {hawk}.
Oct 29 2015, 12:28 AM · Analytics-Clusters, Analytics-Kanban
kevinator removed a parent task for T110090: Create new Hive / Oozie server from old analytics Dell {hawk}: T99952: {mule} Hadoop Cluster Expansion.
Oct 29 2015, 12:28 AM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters

Oct 28 2015

kevinator updated the task description for T116609: View counts in squid logs, webstatscollector 2.0 and hive are very dissimilar for several projects. [5 pts].
Oct 28 2015, 8:36 PM · Technical-Debt, Patch-For-Review, Analytics-Kanban, Analytics
kevinator renamed T116084: Create deb package for Burrow {hawk} [5 pts] from Create deb package for Burrow to Create deb package for Burrow {hawk} [5 pts].
Oct 28 2015, 4:13 PM · Patch-For-Review, Analytics-Kanban

Oct 27 2015

kevinator closed T115993: Update oozie diagram [3 pts] {hawk} as Resolved.
Oct 27 2015, 3:43 PM · Analytics-Kanban
kevinator closed T115355: run job using oozie <mapreduce> {slug} [13 pts], a subtask of T115351: Improve loading Analytics Query Service with data {slug} [5 pts], as Resolved.
Oct 27 2015, 3:30 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T115355: run job using oozie <mapreduce> {slug} [13 pts] as Resolved.
Oct 27 2015, 3:30 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T115356: special character stripping on cassandra loading (tabs) {slug} [5 pts], a subtask of T115351: Improve loading Analytics Query Service with data {slug} [5 pts], as Resolved.
Oct 27 2015, 3:29 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T115356: special character stripping on cassandra loading (tabs) {slug} [5 pts] as Resolved.
Oct 27 2015, 3:29 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T115353: improve timeuuid writing {slug} [5 pts] as Resolved.
Oct 27 2015, 3:29 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T115353: improve timeuuid writing {slug} [5 pts] , a subtask of T115351: Improve loading Analytics Query Service with data {slug} [5 pts], as Resolved.
Oct 27 2015, 3:29 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator closed T116283: Backfill mobile and upload for oct 20th [3 pts] {hawk} as Resolved.
Oct 27 2015, 3:28 PM · Analytics-Kanban

Oct 26 2015

kevinator moved T116599: Eventlogging tables not replicating from master to slave from Incoming to Radar on the Analytics-Backlog board.
Oct 26 2015, 6:10 PM · DBA, Analytics-EventLogging, Analytics-Backlog

Oct 22 2015

kevinator added a comment to T116293: Procure hardware for future druid cluster .

This will be similar to T100442

Oct 22 2015, 5:09 PM · Analytics-Kanban, Analytics-Clusters

Oct 21 2015

kevinator added a comment to T116097: Projections of cost and scaling for pageview API. {hawk} [8 pts].

I think we should look at a 5 year horizon. How much will we need to spend when the hardware goes out of warranty and needs to be replaced? Keep in mind that the Cassandra DBs are running on old hardware, so they may need to be replaced sooner.

Oct 21 2015, 1:33 AM · Analytics-Kanban

Oct 20 2015

kevinator closed T114406: Investigate and fix inconsistent data in mobile_apps_uniques_daily {hawk} [5 pts] as Resolved.
Oct 20 2015, 4:04 PM · Patch-For-Review, Analytics-Kanban, Mobile-Apps

Oct 15 2015

kevinator closed T108174: Create Hadoop Job to load data into cassandra [34 pts] {slug} as Resolved.
Oct 15 2015, 4:04 PM · Datasets-General-or-Unknown, Patch-For-Review, Analytics-Kanban
kevinator closed T108925: Investigate sample cube pageview_count vs unsampled log pageview count [13 pts] {hawk} as Resolved.
Oct 15 2015, 4:03 PM · Analytics-Kanban
kevinator closed T108857: Delete obsolete schemas {tick} [5 pts] as Resolved.
Oct 15 2015, 4:02 PM · Analytics-Kanban, DBA
kevinator closed T108857: Delete obsolete schemas {tick} [5 pts], a subtask of T104877: Enforce policy for each schema: Sanitize {tick} [8 pts], as Resolved.
Oct 15 2015, 4:02 PM · Analytics-Kanban
kevinator closed T113521: Setup pipeline for search logs to travel through kafka and camus into hadoop {hawk} [55 pts], a subtask of T103505: Create analytics-centric Cirrus logs and have them import into HDFS, as Resolved.
Oct 15 2015, 4:02 PM · MW-1.27-release (WMF-deploy-2015-10-27_(1.27.0-wmf.4)), Patch-For-Review, WorkType-Maintenance, Discovery-Search (Current work), Discovery
kevinator closed T113521: Setup pipeline for search logs to travel through kafka and camus into hadoop {hawk} [55 pts] as Resolved.
Oct 15 2015, 4:02 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters

Oct 13 2015

kevinator renamed T114370: Flag in x-analytics in varnish any request that comes with no cookies whatsoever {bear} [5 pts] from Flag in x-analytics in varnish any request that comes with no cookies whatsoever [5 pts] to Flag in x-analytics in varnish any request that comes with no cookies whatsoever {bear} [5 pts].
Oct 13 2015, 5:13 PM · Operations, Patch-For-Review, Traffic, Analytics-Kanban
kevinator lowered the priority of T115361: optimize Analytics Query Service {slug} from High to Medium.
Oct 13 2015, 5:12 PM · Datasets-General-or-Unknown, Analytics
kevinator created T115361: optimize Analytics Query Service {slug}.
Oct 13 2015, 5:11 PM · Datasets-General-or-Unknown, Analytics
kevinator created T115360: cassandra backfill monitoring {slug}.
Oct 13 2015, 5:09 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator moved T115355: run job using oozie <mapreduce> {slug} [13 pts] from Incoming to Tasked on the Analytics-Backlog board.
Oct 13 2015, 5:03 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator renamed T115355: run job using oozie <mapreduce> {slug} [13 pts] from run job using oozie <mapreduce> rather than <java> action {slug} [13 pts] to run job using oozie <mapreduce> {slug} [13 pts].
Oct 13 2015, 5:03 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator moved T115356: special character stripping on cassandra loading (tabs) {slug} [5 pts] from Incoming to Tasked on the Analytics-Backlog board.
Oct 13 2015, 5:01 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator renamed T115356: special character stripping on cassandra loading (tabs) {slug} [5 pts] from special character stripping on cassandra loading (tabs) to special character stripping on cassandra loading (tabs) {slug} [5 pts].
Oct 13 2015, 5:01 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator moved T115353: improve timeuuid writing {slug} [5 pts] from Incoming to Tasked on the Analytics-Backlog board.
Oct 13 2015, 4:58 PM · Datasets-General-or-Unknown, Analytics-Kanban
kevinator renamed T115353: improve timeuuid writing {slug} [5 pts] from improve timeuuid writing to improve timeuuid writing {slug} [5 pts] .
Oct 13 2015, 4:57 PM · Datasets-General-or-Unknown, Analytics-Kanban

Oct 9 2015

kevinator closed T102225: {stag} EventLogging on Kafka as Resolved.

This project & 2015-16 Fiscal Q1 goal is DONE as of Sept 30 2015!
Goals page updated: https://www.mediawiki.org/wiki/Wikimedia_Engineering/2015-16_Q1_Goals

Oct 9 2015, 4:25 PM · Analytics-EventLogging, Analytics-Kanban
kevinator closed T90642: Replace uses of monitoring::ganglia with monitoring::graphite_* [5 pts] as Resolved.
Oct 9 2015, 4:21 PM · Operations, Patch-For-Review, Analytics-Kanban, observability, Analytics-Clusters
kevinator closed T114657: Update camus-wmf to be deployed by maven (missing jars otherwise) {hawk} [8 pts] as Resolved.
Oct 9 2015, 4:20 PM · Analytics-Kanban
kevinator closed T113627: Make Logstash consume from Kafka:eventlogging_EventError {Oryx} [8 pts] as Resolved.
Oct 9 2015, 4:18 PM · observability, Wikimedia-Logstash, Patch-For-Review, Analytics-Kanban
kevinator closed T114672: Gain permission to delete articles on wikitech and mediawiki (needed for doc cleanup) [3 pts] as Resolved.
Oct 9 2015, 4:16 PM · Analytics-Kanban
kevinator closed T89463: Fix active namenode monitoring so that ANY active namenode is an OK state. [8 pts] as Resolved.
Oct 9 2015, 4:12 PM · Operations, Patch-For-Review, Analytics-Kanban, Analytics-Clusters
kevinator closed T115114: Move camus properties out of refinery and into puppet [5 pts] as Resolved.
Oct 9 2015, 4:11 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters
kevinator closed T110598: logrotate camus logs on analytics1027 [3 pts] as Resolved.
Oct 9 2015, 4:10 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters, Analytics-Backlog
kevinator closed T114660: Spike: understand wikistats enough to estimate replacing pageview data source {lama} [8 pts] as Resolved.
Oct 9 2015, 4:09 PM · Analytics-Kanban
kevinator closed T114660: Spike: understand wikistats enough to estimate replacing pageview data source {lama} [8 pts], a subtask of T114379: Feed Wikistats traffic reports with aggregated hive data {lama} [21 pts], as Resolved.
Oct 9 2015, 4:09 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats