Page MenuHomePhabricator

Nuria (Nuria)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Nov 26 2014, 3:04 AM (258 w, 6 d)
Availability
Available
LDAP User
Nuria
MediaWiki User
NRuiz (WMF) [ Global Accounts ]

Recent Activity

Yesterday

Nuria added a project to T237124: Growth: implement wider data purge window: Analytics.
Tue, Nov 12, 11:08 PM · Analytics, Product-Analytics, Growth-Team
Nuria added a comment to T237124: Growth: implement wider data purge window.

Let's leave analytics tag cause we need to know where that data is at should we have a data request.

Tue, Nov 12, 11:08 PM · Analytics, Product-Analytics, Growth-Team
Nuria added a comment to T238138: Vertical: Virtualpageview datastream on MEP .

Helpful notes on etherpad: https://etherpad.wikimedia.org/p/event-platform

Tue, Nov 12, 8:07 PM · Analytics, Event-Platform, Epic, Better Use Of Data, Product-Infrastructure-Team-Backlog
Nuria created T238138: Vertical: Virtualpageview datastream on MEP .
Tue, Nov 12, 8:07 PM · Analytics, Event-Platform, Epic, Better Use Of Data, Product-Infrastructure-Team-Backlog
Nuria added a comment to T237579: Wikistats data discrepancy for India page views from hive data pull .

Wikistats is a limited UI over a more capable API (AQS the analytics query service) so what wikistats offers and AQS can do are different things. Data sources are the same so I would really focus on data exploration in hive/jupyter where you have capabilities to filter by country which are not present in AQS or wikistats.

Tue, Nov 12, 6:45 PM · Analytics-Wikistats, Analytics
Nuria added a comment to T225538: Request for a large request data set for caching research and tuning.

The only difference would be the save column, which is 1 if uri_query %like% "action=submit" and 0 otherwise.

If you do not identify pages per title you would not know what objects are expiring. A page can be accessed by mobile url and seconds later be edited on a desktop url, the object it represents in the cache will expire but the urls by which those two actions happen are not similar. Does this make sense?

Tue, Nov 12, 4:46 PM · Analytics
Nuria added a comment to T238106: "Wikidata Query Service Updater" should have 'bot' in the user agent to indicate is a tool .

See some code changes related to this request: https://gerrit.wikimedia.org/r/#/c/analytics/refinery/source/+/549859

Tue, Nov 12, 4:39 PM · Discovery-Search (Current work), Analytics
Nuria created T238106: "Wikidata Query Service Updater" should have 'bot' in the user agent to indicate is a tool .
Tue, Nov 12, 4:39 PM · Discovery-Search (Current work), Analytics

Mon, Nov 11

Nuria added a comment to T228175: Event Platform Client Libraries.

Nice, this is a good start.

Mon, Nov 11, 10:37 PM · Analytics, Event-Platform, Epic, Better Use Of Data, Product-Infrastructure-Team-Backlog
Nuria added a comment to T233634: Modern Event Platform: Stream Configuration: Implementation.

@jlinehan we should start reviewing and testing this stuff together in MW vagrant with your client side code (in EventLogging extension?).

The client code on prototype needs quite a few changes to be added to EL .
Maybe is better to retrofit into EL the part that would deal with stream configs, making sure that
that we do not couple eventlogging working to the config existing? That would make for a smaller code change that we can CR and send.

Mon, Nov 11, 9:15 PM · MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Patch-For-Review, Performance-Team (Radar), Better Use Of Data, CPT Initiatives (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, Event-Platform, Analytics
Nuria added a comment to T225538: Request for a large request data set for caching research and tuning.

Let's first narrow down the upload dataset. from your request the text dataset is quite a different one.

Mon, Nov 11, 9:07 PM · Analytics
Nuria updated subscribers of T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .

@Bencemac not for known, @JAllemandou and myself are thinking this quarter how to best deploy our bot spike detection algorithms, when we have more news we will send an update

Mon, Nov 11, 4:16 PM · Analytics-Kanban, Analytics, Tool-Pageviews

Fri, Nov 8

Nuria added a comment to T237774: Address refinery security vulnerabilities with jackson and netty.

The netty issue seems quite easy to deal with. For the jackson one we probably want to build locally and try out some jobs before updating globally.

Fri, Nov 8, 10:01 PM · Analytics
Nuria updated the task description for T237774: Address refinery security vulnerabilities with jackson and netty.
Fri, Nov 8, 10:00 PM · Analytics
Nuria created T237774: Address refinery security vulnerabilities with jackson and netty.
Fri, Nov 8, 10:00 PM · Analytics
Nuria added a comment to T234484: Add data quality metric: traffic variations per country.

So, maybe, when counting pageviews per country, we can leave the top N% most visited articles out of the calculation.

Nice! I think this is an excellent idea, we, of course, need to verify empirically that it works but it very likely will.

Fri, Nov 8, 9:57 PM · Patch-For-Review, Research, Analytics-Kanban, Analytics
Nuria added a comment to T225538: Request for a large request data set for caching research and tuning.

we'll need the save flag.

If i understood your requirement you need a unique identifier that links the page with the "save" so as to know when cache has expired for a given item. Example:

Fri, Nov 8, 8:01 PM · Analytics
Nuria assigned T234589: Add mediarequests metrics to wikistats UI to fdans.
Fri, Nov 8, 7:30 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria created T237752: Make stats.wikimedia.org point to wikistats2 by default .
Fri, Nov 8, 6:20 PM · Analytics-Kanban, Analytics
Nuria moved T156934: Functionality to share & view SWAP notebooks from Backlog (Later) to Jupyter on the Analytics board.
Fri, Nov 8, 6:18 PM · Analytics-SWAP, Analytics
Nuria created T237743: Update ua parser on analytics stack.
Fri, Nov 8, 4:15 PM · Analytics-Kanban, Inuka-Team (Kanban), Analytics
Nuria edited projects for T234589: Add mediarequests metrics to wikistats UI , added: Analytics-Kanban; removed Multimedia.
Fri, Nov 8, 4:39 AM · Analytics-Kanban, Analytics, Tool-Pageviews

Thu, Nov 7

Nuria added a comment to T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .

Pinging here Product-Analytics so they are aware that effects of bots in "small" sites like these can be dramatic

Thu, Nov 7, 11:53 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria added a comment to T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .

After running the data for hu.wikipedia through bot spikes detection the top list for 2019/10/16 looks like the following. Most rogue pages (marked in red) disappear, note that for a few pages about 80% of traffic is bot in nature. This are results for 2019/10/16

Thu, Nov 7, 11:50 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria added a project to T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam : Analytics-Kanban.
Thu, Nov 7, 11:22 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria moved T214093: Modern Event Platform: Schema Guidelines and Conventions from In Progress to Parent Tasks on the Analytics-Kanban board.
Thu, Nov 7, 11:20 PM · Analytics-Kanban, CPT Initiatives (Modern Event Platform (TEC2)), Analytics, Better Use Of Data, Patch-For-Review, Product-Analytics, Goal, Services (watching), Analytics-EventLogging, Event-Platform
Nuria added a comment to T229674: Set up automatic deletion for netflow datasource in Druid.

We can merge this next week. ping @mforns

Thu, Nov 7, 11:20 PM · Patch-For-Review, Analytics-Kanban, Analytics
Nuria moved T231858: Archive data on eventlogging MySQL to analytics replica before decomisioning from Next Up to In Progress on the Analytics-Kanban board.
Thu, Nov 7, 11:18 PM · Analytics-Kanban, Analytics, Analytics-EventLogging
Nuria closed T236403: Remove references in doc to mysql storage for EL data , a subtask of T159170: Sunset MySQL data store for eventlogging, as Resolved.
Thu, Nov 7, 11:18 PM · Analytics-Kanban, Analytics-EventLogging
Nuria closed T236403: Remove references in doc to mysql storage for EL data as Resolved.
Thu, Nov 7, 11:18 PM · Analytics-Kanban, Analytics-EventLogging
Nuria closed T233231: Upgrade eventlogging to Python 3, a subtask of T204734: Deprecate Python 2 software from the Analytics infrastructure, as Resolved.
Thu, Nov 7, 11:17 PM · Analytics-Kanban
Nuria closed T233231: Upgrade eventlogging to Python 3 as Resolved.
Thu, Nov 7, 11:17 PM · User-Elukey, Analytics-Kanban, Patch-For-Review, Analytics
Nuria closed T235668: Optimize archiva git-fat symlink script as Resolved.
Thu, Nov 7, 11:17 PM · Analytics-Kanban, Analytics-Cluster, Analytics
Nuria closed T232349: Disable production EventLogging analytics MySQL consumers, a subtask of T159170: Sunset MySQL data store for eventlogging, as Resolved.
Thu, Nov 7, 11:15 PM · Analytics-Kanban, Analytics-EventLogging
Nuria closed T232349: Disable production EventLogging analytics MySQL consumers as Resolved.
Thu, Nov 7, 11:15 PM · Analytics-Kanban, Analytics, Analytics-EventLogging
Nuria closed T235494: Create a reports directory under analytics.wikimedia.org as Resolved.
Thu, Nov 7, 11:15 PM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T234333: Import siteinfo dumps onto HDFS.

Did we documented this data is available?

Thu, Nov 7, 11:15 PM · Analytics-Kanban, Analytics
Nuria closed T236985: Understand why SQL string pattern matching differ from Hive to Spark as Resolved.
Thu, Nov 7, 11:14 PM · Analytics-Kanban, Analytics
Nuria closed T236687: Check Avro as potential better file format for wikitext-history as Resolved.
Thu, Nov 7, 11:13 PM · Analytics-Kanban, Analytics
Nuria closed T236995: Enable TLS encryption for the MapReduce Shufflers in the Hadoop Analytics cluster, a subtask of T211836: Enable Security (stronger authentication and data encryption) for the Analytics Hadoop cluster and its dependent services, as Resolved.
Thu, Nov 7, 11:13 PM · Analytics
Nuria closed T236995: Enable TLS encryption for the MapReduce Shufflers in the Hadoop Analytics cluster as Resolved.
Thu, Nov 7, 11:13 PM · Analytics-Kanban, Analytics
Nuria closed T233891: Drop Navigationtiming data entirely from mysql storage? , a subtask of T231858: Archive data on eventlogging MySQL to analytics replica before decomisioning , as Resolved.
Thu, Nov 7, 11:08 PM · Analytics-Kanban, Analytics, Analytics-EventLogging
Nuria closed T233891: Drop Navigationtiming data entirely from mysql storage? as Resolved.
Thu, Nov 7, 11:08 PM · Performance-Team (Radar), Analytics-Kanban, Analytics, Analytics-EventLogging
Nuria closed T222253: Upgrade Spark to 2.4.x as Resolved.
Thu, Nov 7, 11:07 PM · Patch-For-Review, Analytics-Kanban, Analytics, Analytics-Cluster
Nuria set the point value for T237117: Update webrequest_128 dataset in turnilo to include TLS fields once available to 2.
Thu, Nov 7, 11:06 PM · Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria closed T237117: Update webrequest_128 dataset in turnilo to include TLS fields once available, a subtask of T233661: Publish tls related info to webrequest via varnish, as Resolved.
Thu, Nov 7, 11:06 PM · Patch-For-Review, Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria closed T237117: Update webrequest_128 dataset in turnilo to include TLS fields once available as Resolved.
Thu, Nov 7, 11:06 PM · Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria closed T233661: Publish tls related info to webrequest via varnish as Resolved.
Thu, Nov 7, 11:06 PM · Patch-For-Review, Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria closed T204736: Move Analytics Report Updater to Python 3, a subtask of T204734: Deprecate Python 2 software from the Analytics infrastructure, as Resolved.
Thu, Nov 7, 11:05 PM · Analytics-Kanban
Nuria closed T204736: Move Analytics Report Updater to Python 3 as Resolved.
Thu, Nov 7, 11:05 PM · Analytics-Kanban, Analytics
Nuria closed T232857: Add mediarequests per referer endpoint to AQS , a subtask of T207208: Add mediacounts data to AQS and, from there, Restbase, as Resolved.
Thu, Nov 7, 11:05 PM · Patch-For-Review, Services (watching), Analytics
Nuria closed T232857: Add mediarequests per referer endpoint to AQS as Resolved.
Thu, Nov 7, 11:05 PM · Patch-For-Review, Analytics-Kanban, Services (watching), Analytics
Nuria closed T235747: Add Mon Wikipedia to analytics setup, a subtask of T235739: Create Mon Wikipedia, as Resolved.
Thu, Nov 7, 9:13 PM · User-Ladsgroup, Wiki-Setup (Create), User-Urbanecm
Nuria closed T235747: Add Mon Wikipedia to analytics setup as Resolved.
Thu, Nov 7, 9:13 PM · Analytics-Kanban, Analytics
Nuria added a comment to T235486: Hive data quality alarms pipeline.

So nice! Let's show metrics from the beginning of time if we can as this series is very small.

Thu, Nov 7, 8:23 PM · Patch-For-Review, Analytics, Analytics-Kanban
Nuria closed T219542: Make data access guidelines public, a subtask of T193296: Consolidate data access documentation, as Resolved.
Thu, Nov 7, 8:21 PM · Product-Analytics, Wikimania-Hackathon-2018, Documentation
Nuria closed T219542: Make data access guidelines public as Resolved.
Thu, Nov 7, 8:21 PM · Product-Analytics, Documentation
Nuria added a comment to T219542: Make data access guidelines public.

And public they are: https://wikitech.wikimedia.org/wiki/Analytics/Data_Access_Guidelines

Thu, Nov 7, 8:21 PM · Product-Analytics, Documentation

Wed, Nov 6

Nuria added a comment to T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .

Also if you look at teh pageviews from this IP from 1 day these are the titles requested.

Wed, Nov 6, 7:23 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria added a comment to T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .

Numbers above are just for 1 hour.

Wed, Nov 6, 7:21 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria added a parent task for T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam : T138207: [Open question] Improve bot identification at scale.
Wed, Nov 6, 7:08 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria added a subtask for T138207: [Open question] Improve bot identification at scale: T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .
Wed, Nov 6, 7:08 PM · Research-Backlog, Analytics
Nuria added a comment to T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .

This is a bot, see patterns that are symmetric per UA (just looked at Orális_szex page)

Wed, Nov 6, 7:07 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria added a comment to T237282: Topviews Analysis of the Hungarian Wikipedia is flooded with spam .

This is a bot, see patterns that are symmetric per UA (just looked at Orális_szex page)

Wed, Nov 6, 7:06 PM · Analytics-Kanban, Analytics, Tool-Pageviews
Nuria added a comment to T237549: Publish Superset dashboard.

A related question, is it possible to share this dashboard with GLOW team members that are not on Superset?

Well, to see a dashboard on superset you need access to superset unless you are sharing your screen. Getting access to superset is quite easy, it just involves filing a ticket with your LDAP user which is the user you use in wikitech.wikimedia.org

Wed, Nov 6, 5:47 PM · GLOW, Analytics
Nuria added a comment to T237549: Publish Superset dashboard.

All superset users have access to the dashboard as is. I see it on the dashboard list.

Wed, Nov 6, 5:26 PM · GLOW, Analytics
Nuria added a comment to T231998: Add KaiOS to the list of OS query options for pageviews in Turnilo.

Once we have a release we can update packages on our end.

Wed, Nov 6, 3:49 PM · Inuka-Team (Kanban), Analytics

Tue, Nov 5

Nuria added a comment to T226663: Develop a tool or integrate feature in existing one to visualize WMCS edits data.

NIce @srishakatux We can also compute this data daily so you have more fine grained data should that be of interest

Tue, Nov 5, 11:20 PM · Analytics, Developer-Advocacy (Oct-Dec 2019), Cloud-Services
Nuria added a comment to T220627: QuickSurveys EventLogging missing ~10% of interactions.

@Isaac Something else to consider (once loading issues have been solved) is that for any users (on desktop) with adblock installed (or privacy badger or similar) you might not get data either. Adblock is installed in 5 to 10% of desktop browsers so if your survey is happening all in desktop (as I imagine it is) and surveys display regardless of whether users have addblock installed (not sure on this last point but it is easy to test) then you are likely to have some data loss in desktop.

Tue, Nov 5, 9:35 PM · MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Patch-For-Review, Readers-Web-Backlog (Kanbanana-2019-20-Q2), Analytics, Analytics-EventLogging, QuickSurveys
Nuria added a comment to T233891: Drop Navigationtiming data entirely from mysql storage? .

+1 to @elukey I think we are good

Tue, Nov 5, 7:15 PM · Performance-Team (Radar), Analytics-Kanban, Analytics, Analytics-EventLogging
Nuria moved T236698: logging level of cassandra should be warning or error but not debug from In Progress to Paused on the Analytics-Kanban board.
Tue, Nov 5, 5:13 PM · Analytics-Kanban, Analytics
Nuria added a comment to T237119: Create script that returns oozie time intervals every time a coordinator is started from a cron job.

https://gerrit.wikimedia.org/r/#/c/analytics/refinery/+/547750/

Tue, Nov 5, 3:49 PM · Analytics-Kanban, Multimedia, Analytics, Tool-Pageviews

Mon, Nov 4

Nuria added a comment to T233661: Publish tls related info to webrequest via varnish.

@BBlack: once we deploy the VCL/varnish-kafka chnages we need to change our refine pipeline to read these values, when we deploy those changes values will be available in webrequest table, after that we ill re-do the indexing of the webrequest dataset into turnilo

Mon, Nov 4, 9:58 PM · Patch-For-Review, Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria added a comment to T234865: Spike: Does our current pageview data identify whether browsers are non-JS?.

folks who turn off JS intentionally,

If you are interested on users with browsers turned off that are editing using wikitext editor you need to record that information when an edit happens, wikitext records edits from php: https://github.com/wikimedia/mediawiki-extensions-WikiEditor/blob/master/includes/WikiEditorHooks.php#L28

Mon, Nov 4, 5:51 PM · Product-Analytics (Kanban)
Nuria added a comment to T235747: Add Mon Wikipedia to analytics setup.

codechange is done: https://gerrit.wikimedia.org/r/#/c/analytics/refinery/+/548300/ but record needs to be inserted on table still, I think.

Mon, Nov 4, 5:33 PM · Analytics-Kanban, Analytics
Nuria updated subscribers of T235747: Add Mon Wikipedia to analytics setup.

ping @Milimetric that will be adding this to pageview whitelist table.

Mon, Nov 4, 5:26 PM · Analytics-Kanban, Analytics
Nuria added a comment to T237124: Growth: implement wider data purge window.

Is Analytics Engineering able to apply a different timeline to some schemas and not others?
Can parts of the schema be purged at 90 days, and the rest at 270 days?

Mon, Nov 4, 5:19 PM · Analytics, Product-Analytics, Growth-Team
Nuria added a comment to T234865: Spike: Does our current pageview data identify whether browsers are non-JS?.

Also at last check modern Opera Mini and of course other Opera browsers have actual client JS support,

Have in mind that having JS support and mediawiki serving JS to those browsers are different things, mediawiki does not support Opera Mini in its JS enabled list, which means that Opera mini always gets a no-JS runtime: (regardless of support) https://github.com/wikimedia/mediawiki/blob/2aed14b686/resources/src/startup/startup.js#L39

Mon, Nov 4, 4:31 PM · Product-Analytics (Kanban)
Nuria added a comment to T233661: Publish tls related info to webrequest via varnish.

@BBlack: we can take a stab at modifying code on VCL if you can CR since that needs to happen before the varnishkafka changes

Mon, Nov 4, 3:55 PM · Patch-For-Review, Analytics-Kanban, observability, Operations, Analytics, Traffic

Fri, Nov 1

Nuria added a comment to T235494: Create a reports directory under analytics.wikimedia.org.

@CCicalese_WMF The reports on 1007 were correctly updated on the 27th, next update will have the newly merged changes

Fri, Nov 1, 11:28 PM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T235494: Create a reports directory under analytics.wikimedia.org.

I left the old report files in stat1006 for safety

I see. Given that all that data is in hive on pingback EL table I do not think we need them on stat1006.

Fri, Nov 1, 11:26 PM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T234865: Spike: Does our current pageview data identify whether browsers are non-JS?.

The major caveat is that we will not get information for grade A browsers where users have turned off JS.

Correct.

Fri, Nov 1, 11:07 PM · Product-Analytics (Kanban)
Nuria added a comment to T236223: Setup Config:Dashiki:WMCSEdits on meta wiki .

(wikis in columns and not in rows)? Is that right, or is there any workaround for this?

That's correct, expectation is <time>, <label>, <value> so each value is in 1 row so for a tab layout the format of the file needs to change.

Fri, Nov 1, 9:21 PM · Analytics, Developer-Advocacy (Oct-Dec 2019), Cloud-Services
Nuria added a comment to T235494: Create a reports directory under analytics.wikimedia.org.

@CCicalese_WMF mmm, looking at report times i think last time these were updated was October 6th, pinging @mforns to make sure we have setup crons for the new jobs pullind data from hive

Fri, Nov 1, 9:09 PM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T237072: Correct namespace zero editor counts on geoeditors_monthly table on hive and druid.

We do not need to delete the druid datasource, re-indexing should be sufficient. Let's amend plan accordingly.

Fri, Nov 1, 8:15 PM · Product-Analytics, Analytics, Patch-For-Review, Analytics-Kanban
Nuria added a project to T237072: Correct namespace zero editor counts on geoeditors_monthly table on hive and druid: Product-Analytics.
Fri, Nov 1, 7:42 PM · Product-Analytics, Analytics, Patch-For-Review, Analytics-Kanban
Nuria added a comment to T237072: Correct namespace zero editor counts on geoeditors_monthly table on hive and druid.

Correcting what we need to do, we need to empty column for zero_namespace_editors but only for the 1-4 bucket, the other two buckets are correct.

Fri, Nov 1, 7:31 PM · Product-Analytics, Analytics, Patch-For-Review, Analytics-Kanban
Nuria added a comment to T230072: Newcomer tasks: specify purging strategy.

FYI that is simply not possible for us to implement any "custom" purging strategies. Please include us on those discussions.

Fri, Nov 1, 7:28 PM · Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
Nuria added a comment to T235494: Create a reports directory under analytics.wikimedia.org.

Is there anything that needs to happen past merging that patch that will enable it for the dashboard?

Yes, the reports need to run, they have not yet.

Fri, Nov 1, 4:24 PM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T235494: Create a reports directory under analytics.wikimedia.org.

Looks like dashboards are fixed: https://pingback.wmflabs.org/#unique-wiki-count

Fri, Nov 1, 4:16 PM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria created T237117: Update webrequest_128 dataset in turnilo to include TLS fields once available.
Fri, Nov 1, 4:11 PM · Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria added a comment to T233661: Publish tls related info to webrequest via varnish.

Also I'm assuming from how X-Analytics is set up that the format is k1=v1;k2=v2;.... (equal sign rather than colon).

yes, correct.

Fri, Nov 1, 4:08 PM · Patch-For-Review, Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria added a comment to T233661: Publish tls related info to webrequest via varnish.

@BBlack Varnish would send items to varnishkafka similar to how it is done for x-nalytics: https://github.com/wikimedia/puppet/blob/production/modules/varnish/templates/analytics.inc.vcl.erb#L221

Fri, Nov 1, 3:43 PM · Patch-For-Review, Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria added a comment to T233661: Publish tls related info to webrequest via varnish.

Hmm maybe it could make sense to store some TLS data like the ciphersuite, version or elliptic curve as integers assuming that all of them have constants assigned in OpenSSL..

I think the size of the strings is not such a big problem and unless @JAllemandou disagrees I think we should aim to use a map as this data logically belongs together, similar to data in X-analytics.

Fri, Nov 1, 3:17 PM · Patch-For-Review, Analytics-Kanban, observability, Operations, Analytics, Traffic
Nuria updated subscribers of T237072: Correct namespace zero editor counts on geoeditors_monthly table on hive and druid.
Fri, Nov 1, 3:06 PM · Product-Analytics, Analytics, Patch-For-Review, Analytics-Kanban
Nuria added a comment to T237072: Correct namespace zero editor counts on geoeditors_monthly table on hive and druid.
Fri, Nov 1, 3:01 PM · Product-Analytics, Analytics, Patch-For-Review, Analytics-Kanban
Nuria updated subscribers of T235494: Create a reports directory under analytics.wikimedia.org.

Moving this to "in progress" until we can verify fix cc @CCicalese_WMF

Fri, Nov 1, 6:10 AM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria moved T235494: Create a reports directory under analytics.wikimedia.org from Done to In Progress on the Analytics-Kanban board.
Fri, Nov 1, 6:09 AM · Patch-For-Review, Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T237072: Correct namespace zero editor counts on geoeditors_monthly table on hive and druid.

I think @ljon original request never included disclosing ns0 editors separately. Can we consider just releasing overall tally of editors without split per namespace?

Fri, Nov 1, 6:07 AM · Product-Analytics, Analytics, Patch-For-Review, Analytics-Kanban
Nuria added a project to T237072: Correct namespace zero editor counts on geoeditors_monthly table on hive and druid: Analytics.
Fri, Nov 1, 12:16 AM · Product-Analytics, Analytics, Patch-For-Review, Analytics-Kanban