Page MenuHomePhabricator

Nuria (Nuria)
Bot

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Nov 26 2014, 3:04 AM (309 w, 1 d)
Availability
Available
LDAP User
Nuria
MediaWiki User
NRuiz (WMF) [ Global Accounts ]

Recent Activity

Yesterday

Nuria moved T257692: Add data quality alarm for mobile-app data from In Code Review to Ready to Deploy on the Analytics-Kanban board.
Wed, Oct 28, 6:36 PM · Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T257692: Add data quality alarm for mobile-app data .

Code merged now, when the entropy counts are re run alarms for may18th will be resend.

Wed, Oct 28, 6:36 PM · Analytics-Kanban, Analytics, Product-Analytics

Tue, Oct 27

Nuria moved T257692: Add data quality alarm for mobile-app data from In Progress to In Code Review on the Analytics-Kanban board.
Tue, Oct 27, 11:52 PM · Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T266467: Check home/HDFS leftovers of rodolfovalentim.

@Dzahn : i do not think so, he should be removed from LDAP

Tue, Oct 27, 11:30 PM · Analytics

Fri, Oct 23

Nuria added a comment to T266086: Nuria's volunteer account.

done!

Fri, Oct 23, 10:52 PM · Analytics-Radar, Operations, SRE-Access-Requests
Nuria added a comment to T266086: Nuria's volunteer account.

NDA signed now but I do not have access to https://phabricator.wikimedia.org/L2?

Fri, Oct 23, 10:43 PM · Analytics-Radar, Operations, SRE-Access-Requests
Nuria added a project to T266086: Nuria's volunteer account: Analytics.
Fri, Oct 23, 10:42 PM · Analytics-Radar, Operations, SRE-Access-Requests
Nuria added a comment to T266250: Requesting access to Production Shell Access (analytics-privatedata-users) for Rmaung.

Also, @Rmaung please take a look at https://wikitech.wikimedia.org/wiki/Analytics/Data_Access_Guidelines and ask any questions you might have about it on task

Fri, Oct 23, 10:38 PM · Analytics, Operations, SRE-Access-Requests
Nuria updated subscribers of T266250: Requesting access to Production Shell Access (analytics-privatedata-users) for Rmaung.

@Rmaung: can you describe what data are looking to access? This is so we can see what is the appropriate level of access (cc @Ottomata) .

Fri, Oct 23, 10:36 PM · Analytics, Operations, SRE-Access-Requests

Thu, Oct 22

Nuria added a comment to T263041: OperationError: The operation failed for an operation-specific reason in generateRandomSessionId .

if this is not super urgent i can work on it on my volunteer capacity.

Thu, Oct 22, 11:00 PM · Analytics-Radar, Product-Infrastructure-Data, Event-Platform, JavaScript, Analytics-EventLogging, Wikimedia-production-error

Wed, Oct 21

Nuria added a comment to T207171: Have a way to show the most popular pages per country.

I would implement the daily "top" 1st and once that is in place I would add the monthly job, given the very different amounts of data for both a different strategy might be needed for the second one.

Wed, Oct 21, 11:38 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T207171: Have a way to show the most popular pages per country.

A daily release to provide quick information for editors interested in very targeted editing. I suspect that this could even be just a ranking of most popular articles that meet the privacy thresholds without including any raw count data

Nice, +1 to this idea

Wed, Oct 21, 11:36 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T264945: Update Wikidata usage metric.

I found differences of <0.1% for recent months and <0.3% for older months. I think that's acceptable.

Wed, Oct 21, 7:38 PM · Analytics-Kanban, Analytics
Nuria updated the task description for T266086: Nuria's volunteer account.
Wed, Oct 21, 4:56 AM · Analytics-Radar, Operations, SRE-Access-Requests
Nuria created T266086: Nuria's volunteer account.
Wed, Oct 21, 4:55 AM · Analytics-Radar, Operations, SRE-Access-Requests
Nuria updated Nuria.
Wed, Oct 21, 4:36 AM

Tue, Oct 20

Nuria added a comment to T265167: Request a Kerberos identity for sbisson.

For faster resolution of permits issues add SRE-Access-Requests to ticket, that way the persosn on clinic duty will get to work on it soon after ticket is filed. I understand that process is a bit confusing but permits to access the prod infra (including analytics clusters) are handled by the SRE team at large.

Tue, Oct 20, 5:21 PM · Analytics
Nuria added a comment to T262626: Remove http.client_ip from EventGate default schema (again).

If the intent is to decide whether all errors are from same user you can send the number of errors for that session of that type and that would tell you the piece of info you want to know.

Flushing this a bit more. The number of errors for a device does not need to be per session but rather can be a tally:

Tue, Oct 20, 3:20 PM · Analytics-Kanban, Product-Analytics, Patch-For-Review, Product-Infrastructure-Data, observability, Privacy Engineering, Analytics, Event-Platform
Nuria added a comment to T265952: Retain nonsensitive mediawiki_api_request logging data.

We can keep data for longer than 90 days that has no identifying fields. Just need to submit a changeset that lists those fields. Please take a look at docs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging/Data_retention

Tue, Oct 20, 2:48 PM · Analytics
Nuria updated the task description for T236740: Remove postal code and longitude / latitude from geocoded data object on webrequest data.
Tue, Oct 20, 4:14 AM · Analytics-Kanban, Product-Analytics, Analytics

Mon, Oct 19

Nuria added a comment to T262626: Remove http.client_ip from EventGate default schema (again).

A hashed IP would still tell you how many IPs are involved, without revealing any individual IP

For it to be truly not revealing on an 2^32 space it will probably needs to be salted.

Mon, Oct 19, 9:13 PM · Analytics-Kanban, Product-Analytics, Patch-For-Review, Product-Infrastructure-Data, observability, Privacy Engineering, Analytics, Event-Platform
Nuria updated subscribers of T265167: Request a Kerberos identity for sbisson.

@elukey to create kerberos credentials

Mon, Oct 19, 3:38 PM · Analytics

Fri, Oct 16

Nuria added a comment to T207171: Have a way to show the most popular pages per country.

So, if you just say "this number is too low to be displayed" , I don't think that anyone will complain

This is actually very useful info, thank you.

Fri, Oct 16, 3:05 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics

Thu, Oct 15

Nuria added a comment to T207171: Have a way to show the most popular pages per country.

Have in mind that per population data is not necessarily needed (it will be great to have at some point but it feels like scope creep in this task).

Thu, Oct 15, 11:13 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T188859: Wikistats 2.0: Add statistics for the geographical origin of the contributors.

I think that CKoerner_WMF.'s works fine with editors as well: "When Bethany started editing Malagasy Wikipedia in 2014, there were no Wikipedia editors in her home country of Madagascar" so I do not really see a strong use case for edits versus editors in this case

Thu, Oct 15, 8:17 PM · Analytics, Analytics-Wikistats
Nuria updated subscribers of T207171: Have a way to show the most popular pages per country.

Adding @Isaac cause I think he can probably be a good person to help to explore more than a simple bucketization solution might be needed.

Thu, Oct 15, 5:36 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T207171: Have a way to show the most popular pages per country.

Wei talked about doing some data analysis to quantify the issues with privacy and country splits. As we spoke we need to quantify the identification risk, an article with 1 pageview in "Greenlandic-language Wikipedia" might carry an identification risk of 1/55,000 (55,000 being the population of Greenland) and article in Malasyan in San marino might have an identification risk of 1/5 (5 citizens with malsyan names in San Marino) so it is not the "number of pageviews" that defines the identification risk but rather "possible population from which this pageviews are drawn"

Thu, Oct 15, 3:13 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a project to T236740: Remove postal code and longitude / latitude from geocoded data object on webrequest data: Analytics-Kanban.
Thu, Oct 15, 2:56 PM · Analytics-Kanban, Product-Analytics, Analytics
Nuria added a comment to T236740: Remove postal code and longitude / latitude from geocoded data object on webrequest data.

Moving to kanban and @razzi to work on this.

Thu, Oct 15, 2:55 PM · Analytics-Kanban, Product-Analytics, Analytics
nshahquinn-wmf awarded T248884: Documentation of client side error logging capabilities on mediawiki a Cookie token.
Thu, Oct 15, 9:09 AM · Patch-For-Review, Product-Infrastructure-Data, Analytics-Radar, Documentation, Performance-Team (Radar), Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data

Wed, Oct 14

Nuria assigned T236740: Remove postal code and longitude / latitude from geocoded data object on webrequest data to razzi.
Wed, Oct 14, 9:17 PM · Analytics-Kanban, Product-Analytics, Analytics
Nuria updated the task description for T236740: Remove postal code and longitude / latitude from geocoded data object on webrequest data.
Wed, Oct 14, 9:16 PM · Analytics-Kanban, Product-Analytics, Analytics
Nuria updated subscribers of T236740: Remove postal code and longitude / latitude from geocoded data object on webrequest data.

Pinging @JAllemandou in case he can think of any reason why we should leave these fields, giving precision.

Wed, Oct 14, 9:16 PM · Analytics-Kanban, Product-Analytics, Analytics
Nuria updated the task description for T236740: Remove postal code and longitude / latitude from geocoded data object on webrequest data.
Wed, Oct 14, 9:14 PM · Analytics-Kanban, Product-Analytics, Analytics
Nuria closed T173604: Reportupdater: do not write execution control files in source directories as Resolved.
Wed, Oct 14, 9:11 PM · Analytics-Kanban, good first task, Analytics
Nuria closed T173604: Reportupdater: do not write execution control files in source directories, a subtask of T193167: reportupdater TLC, as Resolved.
Wed, Oct 14, 9:11 PM · Analytics
Nuria closed T255685: Renaming "analytics-cluster" tag to "analytics-systems" and make into a subproject of analytics as Declined.
Wed, Oct 14, 9:09 PM · Analytics
Nuria placed T251788: Add folder creation for sqoop initial installation in puppet up for grabs.
Wed, Oct 14, 9:07 PM · Analytics
Nuria added a comment to T188859: Wikistats 2.0: Add statistics for the geographical origin of the contributors.

@CKoerner_WMF just so you know this data has been publicy available for now about a year, the task in question is to visualize it via Wikistats.

Wed, Oct 14, 2:38 PM · Analytics, Analytics-Wikistats
akosiaris awarded T219544: Make hadoop cluster able to push to swift a Love token.
Wed, Oct 14, 11:09 AM · Patch-For-Review, Analytics-Kanban, Research, Operations, Discovery, Analytics

Tue, Oct 13

Nuria assigned T188859: Wikistats 2.0: Add statistics for the geographical origin of the contributors to fdans.
Tue, Oct 13, 10:21 PM · Analytics, Analytics-Wikistats
Nuria added a comment to T188859: Wikistats 2.0: Add statistics for the geographical origin of the contributors.

This is scheduled to be added to wikistats Q2 2020 (Sep to Dec)

Tue, Oct 13, 10:20 PM · Analytics, Analytics-Wikistats
Nuria updated subscribers of T261461: Capture special mute events in Prefupdate table [4 hour spike].

@jwang I think @Mholloway might be able to help given that this seems to bean instrumentation issue.

Tue, Oct 13, 9:47 PM · Anti-Harassment (The Letter Song), Product-Analytics, Analytics-Radar

Mon, Oct 12

Nuria added a comment to T257692: Add data quality alarm for mobile-app data .

Sum up: The timeseries of entropy of os_family per access_method works well to as a data quality timeseries for 'mobile web' (see green line in plot above) and 'mobile app' (orange line). For desktop, the timeseries is a lot better from April onwards when filtering of automated agents is deployed (see https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/BotDetection#Why_do_we_need_more_sophisticated_bot_detection). The blue line in above graph starts to clearly oscillate with a weekly cadence from April onwards. Now, as it can also be appreciated on above graph, there are still spikes due to undetected bots. Those are bots that elude our detection for a number of reasons (they are real well spread geographically or their effect on pageviews is not as high as our thresholds).

Mon, Oct 12, 6:53 PM · Analytics-Kanban, Analytics, Product-Analytics
Nuria removed a project from T257692: Add data quality alarm for mobile-app data : Epic.
Mon, Oct 12, 6:52 PM · Analytics-Kanban, Analytics, Product-Analytics
Nuria closed T234826: Repurpose db1108 as generic Analytics db replica, a subtask of T159170: Sunset MySQL data store for eventlogging, as Resolved.
Mon, Oct 12, 5:30 PM · Analytics-Kanban, Analytics-EventLogging
Nuria closed T234826: Repurpose db1108 as generic Analytics db replica as Resolved.
Mon, Oct 12, 5:30 PM · Analytics-Clusters, User-Elukey, Analytics-Kanban
Nuria closed T234826: Repurpose db1108 as generic Analytics db replica, a subtask of T240437: Analytics Ops Technical Debt, as Resolved.
Mon, Oct 12, 5:30 PM · Analytics-Kanban, Analytics
Nuria added a comment to T249758: Combine filters and splits on wikistats UI.

ping on announcement e-mail to wikitech-l (cc @fdans )

Mon, Oct 12, 5:30 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats, Analytics

Thu, Oct 8

Nuria added a comment to T257412: Review an-coord1001's usage and failover plans.

+1 to the active/active plan

Thu, Oct 8, 9:54 PM · Patch-For-Review, Analytics-Clusters
Nuria updated subscribers of T265071: Renable SSH access for Lex Nasser, analytics intern.

Expiry contact will be @Ottomata end data is April 1 2021

Thu, Oct 8, 9:51 PM · Operations, SRE-Access-Requests, Analytics
Nuria added a comment to T207171: Have a way to show the most popular pages per country.

The raw data is available for per-language project broadly on the API or on dumps.

You are right. i forgot these files are available per project. My reasoning above breaks down where project (more or less) == country (per @lexnasser) example as that data is already public. The example of users in Kyrgyzstan taht "speak french and have access to internet" still stands.

Thu, Oct 8, 3:55 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T264945: Update Wikidata usage metric.

Do not disagree, just mentioning this as something to think about.

Thu, Oct 8, 3:50 PM · Analytics-Kanban, Analytics
Nuria added a comment to T207171: Have a way to show the most popular pages per country.

@lexnasser Nice, yes, same considerations apply to your example. That such a low count is available speaks of a bug here: https://github.com/wikimedia/analytics-refinery/blob/master/oozie/cassandra/monthly/pageview_top_articles.hql

Thu, Oct 8, 3:41 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T207171: Have a way to show the most popular pages per country.

Is it possible for Nigeria, Mali, Kenya, India, Philippines, Romania, Kyrgyzstan?

Thu, Oct 8, 3:13 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics

Wed, Oct 7

Nuria updated subscribers of T264945: Update Wikidata usage metric.

cc @Milimetric

Wed, Oct 7, 8:23 PM · Analytics-Kanban, Analytics
Nuria updated subscribers of T264945: Update Wikidata usage metric.

@JAllemandou this is a good example to be able to keep as many mediawiki history dumps as possible, correcting this metric can only go as far back as the snapshots we keep

Wed, Oct 7, 8:22 PM · Analytics-Kanban, Analytics
Nuria added a comment to T207171: Have a way to show the most popular pages per country.

Top 100 in each language.

Wed, Oct 7, 8:19 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T207171: Have a way to show the most popular pages per country.

@AMuigai @Amire80 @lexnasser is going to start working on this project this quarter. I propose we use a top 100 of articles per country where these articles can be in *any* language. Thus you could request "the most popular articles in french in spain" in the month of 2020-01 and that list might have say 5 articles because the top 100 includes 95 articles in Spanish and 5 in french, makes sense?

Wed, Oct 7, 5:54 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T263697: Add more popular articles per country data to AQS .

@lexnasser As a remainder here is the design document for the prior AQS endpoint: https://drive.google.com/drive/u/0/folders/1bcy6Iyb_bLwD1jcfjhL4vtKZvD-CN22L

Wed, Oct 7, 5:45 PM · Analytics-Wikistats, Privacy Engineering, Inuka-Team, Language-strategy, Tool-Pageviews, Analytics
Nuria added a comment to T260409: Establish what data must be backed up before the HDFS upgrade.

After talking with the, we chose to backup all data except for logs, raw data (unprocessed webrequest, events, and dumps), 2 month of webrequest, and processed wikitext (heavy).

You mean "unprocessed events" ? cause we need to backup the sanitized and unsanitized versions

Wed, Oct 7, 4:05 PM · Analytics-Kanban, Analytics
Nuria added a comment to T254332: Add more dimensions in the netflow/pmacct/Druid pipeline.

Maybe leaning towards using a transform function, because code would be shorter and less moving pieces?

I think having very specific code on refine to apply to just one job is an anti-pattern, albeit (you are right) shorter but on my opinion, much more brittle.

Wed, Oct 7, 2:58 PM · Patch-For-Review, Analytics-Kanban, Analytics, netops, Operations

Tue, Oct 6

Nuria added a comment to T254332: Add more dimensions in the netflow/pmacct/Druid pipeline.

@mforns: it could also be a second job run after the refined one (similar to how we do virtual-pageviews) as we probably do not want to create special refine functions for just one dataset

Tue, Oct 6, 8:40 PM · Patch-For-Review, Analytics-Kanban, Analytics, netops, Operations
Nuria added a comment to T264660: Wikistats - Add avk.wikipedia.or to scoop list .

Thanks for reporting, new wikis data is not scooped automatically, we will add this one to our list.

Tue, Oct 6, 1:29 AM · Analytics-Kanban, Analytics, Analytics-Wikistats
Nuria renamed T264660: Wikistats - Add avk.wikipedia.or to scoop list from Wikistats Bug to Wikistats - Add avk.wikipedia.or to scoop list .
Tue, Oct 6, 1:29 AM · Analytics-Kanban, Analytics, Analytics-Wikistats

Mon, Oct 5

Nuria added a comment to T263799: Story idea for Blog: bot or not .

Looks good!

Mon, Oct 5, 9:10 PM · Technical-blog-posts

Sat, Oct 3

Nuria added a comment to T263495: Improve discovery of paths to delete in refinery-drop-older-than.

mmm, no scratch that , it is not fixed but will fail undeterministically

Sat, Oct 3, 4:53 AM · Patch-For-Review, Analytics-Kanban, Analytics

Fri, Oct 2

Nuria added a comment to T245833: Enable layered data-access and sharing for a new form of collaboration.

My opinion on this request is that having non throughly supervised contributors accessing data introduces too big of a risk of a data leak, I think we should strive to make this data available publicly with a differentially private strategy.

Fri, Oct 2, 11:33 PM · Research-Backlog, User-Elukey, Operations, WMF-Legal, Analytics
Nuria added a comment to T263495: Improve discovery of paths to delete in refinery-drop-older-than.

FYI, that i reruned this timer as it is now deployed on an-launcher1002 (with only the 'order' fix but not the subsequent fix) and it worked. More comments on patch.

Fri, Oct 2, 10:30 PM · Patch-For-Review, Analytics-Kanban, Analytics
Nuria updated subscribers of T263495: Improve discovery of paths to delete in refinery-drop-older-than.
Fri, Oct 2, 10:23 PM · Patch-For-Review, Analytics-Kanban, Analytics
Nuria added a comment to T263799: Story idea for Blog: bot or not .

this one looks good: https://commons.wikimedia.org/wiki/File:Unknown_Chinese_Maker_Tin_Wind_Up_Radar_Robot_Front.jpg

Fri, Oct 2, 8:02 PM · Technical-blog-posts
Nuria added a comment to T258047: Import page_props table to Hive.

@MMiller_WMF we missed this month deploy of this change, will it be oK to wait for the run of November 1st or you needed it sooner?

Fri, Oct 2, 4:11 AM · Patch-For-Review, Analytics-Kanban, Analytics

Thu, Oct 1

Nuria added a comment to T173604: Reportupdater: do not write execution control files in source directories.

@paulkernfeld thanks for your work, woudl you be interested in doing more wikistats work (javascript) or you prefer these type of python projects?

Thu, Oct 1, 6:27 PM · Analytics-Kanban, good first task, Analytics
Nuria added a comment to T264255: Review request for data export.

I think these should fine to export, agreed.

Thu, Oct 1, 6:16 PM · Analytics-Kanban, Security, Analytics
Nuria added a comment to T264327: Wikistats New Feature.

ping @nurdinjaelani want to add some info here as to your request?

Thu, Oct 1, 4:18 PM · Analytics, Analytics-Wikistats
Nuria added a comment to T257692: Add data quality alarm for mobile-app data .

Entropy of os-family per method of access, orange line shows the big oscillations in mobile apps, oscillation is not present in desktop or mobile app interface

Thu, Oct 1, 3:31 PM · Analytics-Kanban, Analytics, Product-Analytics
Nuria added a comment to T264152: Fix Maxmind geoip database archive.

Thanks and agreed on solution 3) . I have assigned to @razzi and we can take this up as part of regular development

Thu, Oct 1, 3:05 PM · Patch-For-Review, Analytics-Kanban, Analytics

Wed, Sep 30

Nuria added a comment to T256050: Add dimensions to editors_daily dataset.

Next quarter as in Q2

Wed, Sep 30, 11:31 PM · Analytics-Kanban, Patch-For-Review, Product-Analytics, Analytics
Nuria moved T256050: Add dimensions to editors_daily dataset from Paused to Next Up on the Analytics-Kanban board.
Wed, Sep 30, 11:30 PM · Analytics-Kanban, Patch-For-Review, Product-Analytics, Analytics
Nuria added a comment to T249758: Combine filters and splits on wikistats UI.

Let's close when @fdans sends announcement e-mail

Wed, Sep 30, 11:30 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats, Analytics
Nuria moved T249758: Combine filters and splits on wikistats UI from In Code Review to Done on the Analytics-Kanban board.
Wed, Sep 30, 11:29 PM · Patch-For-Review, Analytics-Kanban, Analytics-Wikistats, Analytics
Nuria closed T244499: Upgrade the Hadoop test cluster to BigTop, a subtask of T203693: Update to CDH 6 or other up-to-date Hadoop distribution, as Resolved.
Wed, Sep 30, 11:29 PM · User-Elukey, Analytics-Clusters
Nuria closed T244499: Upgrade the Hadoop test cluster to BigTop as Resolved.
Wed, Sep 30, 11:29 PM · Patch-For-Review, Analytics-Kanban, User-Elukey, Analytics-Clusters
Nuria moved T234629: Move the Analytics infrastructure to Debian Buster from Done to Parent Tasks on the Analytics-Kanban board.
Wed, Sep 30, 11:28 PM · Analytics-Kanban, Analytics
Nuria closed T262162: Upgrade to Superset 0.37.x, a subtask of T211706: Superset Updates , as Resolved.
Wed, Sep 30, 11:28 PM · Better Use Of Data, Analytics-Kanban, Product-Analytics
Nuria closed T262162: Upgrade to Superset 0.37.x as Resolved.
Wed, Sep 30, 11:28 PM · Analytics-Kanban, Analytics-Clusters
Nuria added a comment to T264152: Fix Maxmind geoip database archive.

I think it will be fine to archive to hdfs alone. We use those files but sparingly so I do not think there is an issue with them being available just in hdfs.

Wed, Sep 30, 11:04 PM · Patch-For-Review, Analytics-Kanban, Analytics
Nuria closed T262189: Create a cookbook to automate the bootstrap of new Hadoop workers, a subtask of T243521: Hadoop Hardware Orders FY2019-2020, as Resolved.
Wed, Sep 30, 8:38 PM · Analytics-Kanban, Analytics
Nuria closed T262189: Create a cookbook to automate the bootstrap of new Hadoop workers as Resolved.
Wed, Sep 30, 8:38 PM · Patch-For-Review, Analytics-Kanban, Analytics-Clusters
Nuria closed T261502: Add link to translatewiki.net in wikistats footer as Resolved.
Wed, Sep 30, 8:36 PM · Analytics-Kanban, good first task, I18n, Analytics-Wikistats, Analytics
Nuria reassigned T173604: Reportupdater: do not write execution control files in source directories from paulkernfeld to mforns.
Wed, Sep 30, 8:34 PM · Analytics-Kanban, good first task, Analytics
Nuria moved T173604: Reportupdater: do not write execution control files in source directories from Next Up to In Progress on the Analytics-Kanban board.
Wed, Sep 30, 8:34 PM · Analytics-Kanban, good first task, Analytics
Nuria added a comment to T173604: Reportupdater: do not write execution control files in source directories.

Assigning to @mforns for final CR.

Wed, Sep 30, 8:34 PM · Analytics-Kanban, good first task, Analytics
Nuria added a comment to T173604: Reportupdater: do not write execution control files in source directories.

given that the missing pid package is now debianized let's deploy this code?

Wed, Sep 30, 8:34 PM · Analytics-Kanban, good first task, Analytics
Nuria added a comment to T262574: Debianize Python's pid library to be able to use it from reportupdater.

Can @mforns confirm that reportupdater can use this package as its?

Wed, Sep 30, 8:33 PM · Analytics-Kanban, Analytics
Nuria closed T262574: Debianize Python's pid library to be able to use it from reportupdater, a subtask of T173604: Reportupdater: do not write execution control files in source directories, as Resolved.
Wed, Sep 30, 8:32 PM · Analytics-Kanban, good first task, Analytics
Nuria closed T262574: Debianize Python's pid library to be able to use it from reportupdater as Resolved.
Wed, Sep 30, 8:32 PM · Analytics-Kanban, Analytics
Nuria assigned T264152: Fix Maxmind geoip database archive to razzi.
Wed, Sep 30, 8:31 PM · Patch-For-Review, Analytics-Kanban, Analytics
Nuria added a comment to T263692: Requesting access to analytics-privatedata-users for Djellel Difallah.

Ok, let's approve access until 10 March 2021 and when collaboration is extended access can be so. Approved on my end.

Wed, Sep 30, 6:54 PM · Operations, SRE-Access-Requests
Nuria added a comment to T263692: Requesting access to analytics-privatedata-users for Djellel Difallah.

@Isaac When does this collaboration expire?

Wed, Sep 30, 6:36 PM · Operations, SRE-Access-Requests