Page MenuHomePhabricator
Feed Advanced Search

Nov 22 2021

EYener closed T292262: [REQUEST] Manipulate dataset in Superset as Resolved.

Marking resolved as @BTullis was able to help us get this working. Thank you!

Nov 22 2021, 12:37 PM · Data-Engineering-Kanban, Data-Engineering, Product-Analytics
EYener closed T292751: Error creating custom SQL metrics in Superset (event_sanitized.centralnoticebannerhistory) as Resolved.

Thank you @BTullis ! Apologies for missing the ownership of event_sanitized. - I tried to edit this just now and it is working. I also tried to add @JMando via his alias (which ended up being just jm ) and was able to do so via the legacy editor. Thank you - we're all set now. I'll mark this resolved as well as the other open task we have.

Nov 22 2021, 12:36 PM · Data-Engineering-Kanban, Data-Engineering

Nov 19 2021

EYener updated subscribers of T292751: Error creating custom SQL metrics in Superset (event_sanitized.centralnoticebannerhistory).

Hi @BTullis thanks - looking back at this task, it is actually the dataset currently owned by @mpopov (schema: event_sanitized) that I would need to be added as owner of.

Nov 19 2021, 4:35 PM · Data-Engineering-Kanban, Data-Engineering

Nov 9 2021

EYener added a comment to T294144: Results have expired error in Hue.

Thanks @BTullis - we do use Superset's SQL Lab, which is okay at showing a schema once you know the dataset you want to query, but not all we would like a SQL UI to be in terms of showing the whole of available databases and their tables. We can use manual commands in beeline to accomplish this, but a UI is very helpful.

Nov 9 2021, 3:32 PM · Data-Engineering-Kanban, Data-Engineering, Analytics

Nov 8 2021

EYener updated subscribers of T292262: [REQUEST] Manipulate dataset in Superset.

So interesting! Thank you @BTullis, adding @Dwisehaupt to this thread because we were having this same issue - not seeing full user list in dropdown to add them to the dataset owner list - in the Fundraising instance of Superset. @Dwisehaupt looks like I'll just have to use the legacy version until 1.4.0+ is released. Thanks!

Nov 8 2021, 2:01 PM · Data-Engineering-Kanban, Data-Engineering, Product-Analytics

Nov 4 2021

EYener added a comment to T294144: Results have expired error in Hue.

That's great to know @odimitrijevic ! We can work with this data in Superset, yes.

Nov 4 2021, 9:37 PM · Data-Engineering-Kanban, Data-Engineering, Analytics

Nov 3 2021

EYener awarded T292294: upgrade fundraising Superset instance to 1.3.1+ a Party Time token.
Nov 3 2021, 7:56 PM · fundraising-tech-ops
EYener added a project to T282012: WikipediaPortal Event Platform Migration: Web-Team-Backlog.
Nov 3 2021, 1:21 PM · Data-Engineering-Kanban, Patch-For-Review, Web-Team-Backlog (Kanbanana-FY-2021-22), Analytics, Data-Engineering, Event-Platform

Nov 2 2021

EYener added a comment to T294504: Aggregating fields from searchkit.

Ah sorry, @Eileenmcnaughton can I help clarify more? In broad terms, it would be great if we could create a searchkit and then see a big aggregated total of how many contacts / activities / etc the searchkit contains : There are 14,000 donors in this searchkit (and maybe drill down into that 14,000 to bring up a list of donors).

Nov 2 2021, 3:01 PM · FR-CiviCRM-Searchkit, FR-Tech-Analytics, Fundraising-Backlog

Oct 28 2021

EYener updated subscribers of T293926: Email Send with Low Clicks.
Oct 28 2021, 7:38 PM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog, FR-Tech-Analytics
EYener updated subscribers of T293926: Email Send with Low Clicks.
Oct 28 2021, 5:09 PM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog, FR-Tech-Analytics

Oct 27 2021

EYener created T294507: Date format of date fields when other math / aggregates / field transformations are applied.
Oct 27 2021, 11:09 PM · FR-CiviCRM-Searchkit, FR-Tech-Analytics, Fundraising-Backlog
EYener created T294505: Default Value in form builder for dates acting as string.
Oct 27 2021, 11:04 PM · FR-CiviCRM-Searchkit, FR-Tech-Analytics, Fundraising-Backlog
EYener created T294504: Aggregating fields from searchkit.
Oct 27 2021, 11:01 PM · FR-CiviCRM-Searchkit, FR-Tech-Analytics, Fundraising-Backlog

Oct 26 2021

EYener closed T247581: Silverpop replication in frdb1003 as Declined.

Declining. Previously, the silverpop tables were used in some of our scripts for an extra layer of dedupe, but (1) dedupe has evolved since this ticket creation and (2) the effort involved by all parties is much higher than the reward to add that added layer of dedupe on raw email addresses.

Oct 26 2021, 10:31 PM · Fundraising-Backlog

Oct 25 2021

EYener added a comment to T294144: Results have expired error in Hue.

Thanks for taking a look @odimitrijevic! Here is one where both @JMando and I received the Results have expired, rerun the query if needed. error in Hue last Friday:

Oct 25 2021, 6:59 PM · Data-Engineering-Kanban, Data-Engineering, Analytics

Oct 22 2021

EYener created T294144: Results have expired error in Hue.
Oct 22 2021, 6:38 PM · Data-Engineering-Kanban, Data-Engineering, Analytics
EYener created T294130: Upgrade Superset to 1.3.1 - following Product install.
Oct 22 2021, 2:53 PM · fundraising-tech-ops, FR-Tech-Analytics, Fundraising-Backlog

Oct 21 2021

EYener added a project to T293926: Email Send with Low Clicks: Fundraising-Backlog.
Oct 21 2021, 12:52 PM · Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog, FR-Tech-Analytics

Oct 11 2021

EYener added a comment to T292751: Error creating custom SQL metrics in Superset (event_sanitized.centralnoticebannerhistory).

Interestingly, I don't seem to get this error using the pivot table chart type - this could be isolated to the table chart type

Oct 11 2021, 9:44 PM · Data-Engineering-Kanban, Data-Engineering

Oct 7 2021

EYener created T292751: Error creating custom SQL metrics in Superset (event_sanitized.centralnoticebannerhistory).
Oct 7 2021, 2:32 PM · Data-Engineering-Kanban, Data-Engineering
EYener updated subscribers of T292262: [REQUEST] Manipulate dataset in Superset.

Thank you! I'm adding @JMando here as a subscriber. We have a few metrics we'd like to add to the event_sanitized.centralnoticebannerhistory table in Superset and it would be great if we both had access to modify this data source.

Oct 7 2021, 1:57 PM · Data-Engineering-Kanban, Data-Engineering, Product-Analytics

Oct 6 2021

EYener added a comment to T292222: Fundraising access request for Janna Layton.

Added contact info for @JLaytonWMF to the Collab page.

Oct 6 2021, 9:11 PM · fundraising-tech-ops, Fundraising-Backlog

Oct 5 2021

EYener added a comment to T292262: [REQUEST] Manipulate dataset in Superset.

Of course, @cchen!

Oct 5 2021, 1:17 PM · Data-Engineering-Kanban, Data-Engineering, Product-Analytics

Sep 30 2021

EYener created T292262: [REQUEST] Manipulate dataset in Superset.
Sep 30 2021, 9:51 PM · Data-Engineering-Kanban, Data-Engineering, Product-Analytics
EYener created T292247: Collaboration on RML data flow.
Sep 30 2021, 8:09 PM · FR-Tech-Analytics, Fundraising-Backlog
EYener updated subscribers of T291214: Create a table showing failed attempted recurring charges per month.

We should collaborate after code freeze in Q3 with @Cstone to turn logfiles into more usable raw files. Can we follow up by creating a new task on that as a first step? Thank you!

Sep 30 2021, 7:08 PM · FR-Tech-Analytics, Fundraising-Backlog
EYener created T292222: Fundraising access request for Janna Layton.
Sep 30 2021, 6:03 PM · fundraising-tech-ops, Fundraising-Backlog

Sep 29 2021

EYener added a comment to T288721: Create new WMF donor fields.

Thanks, @Eileenmcnaughton this is great! I'm seeing them in wmf_donor now.

Sep 29 2021, 11:45 AM · fundraising sprint Screaming Goats Yelling Zoo, fundraising sprint Roller Toaster, Patch-For-Review, fundraising sprint Quantum Leapfrog, fundraising sprint Parallel processing roller coaster, fundraising sprint onion pit, fundraising Sprint NULL calorie food cart, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Sep 27 2021

EYener added a comment to T291432: Collaborate on WikipediaPortal migration.

Great! Thank you. I'll be there for the second half of it (I have a conflict for the first 30 minutes).

Sep 27 2021, 6:54 PM · FR-Tech-Analytics, Fundraising-Backlog
EYener added a comment to T291432: Collaborate on WikipediaPortal migration.

Hey XenoRyet checking in - would Tuesday or Wednesday this week be a good time to bring this to Tech Talks?

Sep 27 2021, 11:44 AM · FR-Tech-Analytics, Fundraising-Backlog

Sep 21 2021

EYener claimed T291214: Create a table showing failed attempted recurring charges per month.
Sep 21 2021, 5:39 PM · FR-Tech-Analytics, Fundraising-Backlog
EYener closed T90630: Recurring Payments Reporting as Declined.

Thanks, @Ejegg, I haven't read through the comment thread thoroughly, but due to this being authored in 2016 and now having much better (entirely new?) systems of tracking this, I'd say we can close this and start afresh. We have most of this through other systems, and I'd be happy to talk to any stakeholders on the ticket + FR-Tech to see if / what is outstanding.

Sep 21 2021, 12:20 PM · FR-Tech-Analytics, Wikimedia-Fundraising-CiviCRM, Recurring-Donations, Fundraising-Backlog

Sep 20 2021

EYener updated subscribers of T291432: Collaborate on WikipediaPortal migration.
Sep 20 2021, 8:23 PM · FR-Tech-Analytics, Fundraising-Backlog
EYener created T291432: Collaborate on WikipediaPortal migration.
Sep 20 2021, 8:23 PM · FR-Tech-Analytics, Fundraising-Backlog
EYener added a comment to T282012: WikipediaPortal Event Platform Migration.

Hi @Ottomata! Actually that would be super helpful. Would you mind picking anything on my calendar that is open and works for you? I'll remove unnecessary events, and I have my working hours blocked off.

Sep 20 2021, 5:49 PM · Data-Engineering-Kanban, Patch-For-Review, Web-Team-Backlog (Kanbanana-FY-2021-22), Analytics, Data-Engineering, Event-Platform

Sep 7 2021

EYener added a comment to T282012: WikipediaPortal Event Platform Migration.

Hi @Ottomata thanks for the ping - this is on my list of quarterly projects, and I've scheduled time out of this week to focus on it in earnest. I've read through the docs and I'll start on step 3 as outlined here this week. I might be pinging back here or on IRC if I run into any questions!

Sep 7 2021, 10:26 PM · Data-Engineering-Kanban, Patch-For-Review, Web-Team-Backlog (Kanbanana-FY-2021-22), Analytics, Data-Engineering, Event-Platform
EYener added a comment to T279952: event.WikipediaPortal referer modification.

Hi all, just piping in to say thank you for adding this to your queue! There is no urgent need to add this to this quarter's work (and wow, this quarter is nearly done with) but I look forward to using this data when it becomes available.

Sep 7 2021, 10:22 PM · Data-Engineering, Privacy Engineering, FR-Tech-Analytics

Sep 3 2021

EYener closed T289606: Requesting access to Stat1007 for jmando as Resolved.

Ah, nice. I'll go get my vision checked and close out this task. That you for correcting my numerous typos during this setup process.

Sep 3 2021, 8:56 PM · SRE, SRE-Access-Requests
EYener reopened T289606: Requesting access to Stat1007 for jmando as "Open".

Hi again! One further question for you all; does @JMando have access to jupyter? The command ssh -N stat1005.eqiad.wmnet -L 8880:127.0.0.1:8880 seems to open a tunnel successfully but he was unable to reach Jupyter at localhost:8000 ("This site can't be reached" error).

Sep 3 2021, 6:28 PM · SRE, SRE-Access-Requests
EYener added a comment to T289606: Requesting access to Stat1007 for jmando.

Oh yes. That will help. :) Connected, thank you!

Sep 3 2021, 1:37 PM · SRE, SRE-Access-Requests
EYener added a comment to T289606: Requesting access to Stat1007 for jmando.

Thanks! Error for me when I ssh -v stat1007.eqiad.wmnet:

Sep 3 2021, 1:20 PM · SRE, SRE-Access-Requests

Sep 2 2021

EYener added a comment to T289606: Requesting access to Stat1007 for jmando.

Hi all! Thank you for working on this and granting access for @JMando! We have been working from the level of access authorized, which you've all granted, to trying to confirm that we can login as expected, and hitting some roadblocks - probably user error on my part, as I'm guessing the instructions I've written up have changed since I last checked.

Sep 2 2021, 11:07 PM · SRE, SRE-Access-Requests
EYener added a comment to T254928: Inclusion of Endowment gifts in 'Last Donated' search results and reporting.

Yeah I agree with @DStrine. We have a request in for all_funds_last_donated and similar all_funds categories to be implemented that this would fall under.

Sep 2 2021, 4:05 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Aug 30 2021

sguebo_WMF awarded T279952: event.WikipediaPortal referer modification a Like token.
Aug 30 2021, 3:02 PM · Data-Engineering, Privacy Engineering, FR-Tech-Analytics

Aug 25 2021

EYener added a comment to T289606: Requesting access to Stat1007 for jmando.

Thank you for the notes, and absolutely approved! @JMando is a 40-hour / week. long-term contractor in a senior level position with a full confidentiality agreement who is a core member of our team. He will need access to production data on stat100x machines in order to query, model, and analyze data that impacts Fundraising Analytics outcomes, such as pageviews and banner history event collection during Fundraising campaigns.

Aug 25 2021, 1:01 PM · SRE, SRE-Access-Requests

Aug 16 2021

EYener updated subscribers of T288721: Create new WMF donor fields.

Adding @JMando to keep track of changes. @Eileenmcnaughton just so I understand it: the current state is that the FY2122 fields are added and in production in the current table (we can see them, and thank you!) but the new fields and new indexing are going to be covered by this ticket?

Aug 16 2021, 9:59 PM · fundraising sprint Screaming Goats Yelling Zoo, fundraising sprint Roller Toaster, Patch-For-Review, fundraising sprint Quantum Leapfrog, fundraising sprint Parallel processing roller coaster, fundraising sprint onion pit, fundraising Sprint NULL calorie food cart, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog

Aug 11 2021

EYener added a comment to T283798: Recurring donors segmentation criteria Civi/Acoustic.

Chiming in here to clarify a few things on my side - are the 'both_' fields specific to Acoustic? Are they already stored somewhere under this name? If so, what type of effort would be involved in renaming?

Aug 11 2021, 6:38 PM · fundraising sprint Quantum Leapfrog, fundraising sprint Parallel processing roller coaster, Patch-For-Review, fundraising sprint onion pit, fundraising Sprint NULL calorie food cart, FR-donorservices, Wikimedia-Fundraising-CiviCRM, FR-Email, Fundraising-Backlog

Aug 6 2021

EYener added a comment to T256315: Automated Email Import to Civi.

Pinging this thread again, as this has come up as an Analytics request to report on RML data:

Aug 6 2021, 3:04 PM · FR-Email, FR-Tech-Analytics, Fundraising-Backlog

Jul 19 2021

EYener added a comment to T280595: Wmf-donor - new year fields.

@Eileenmcnaughton and I talked about this today. In addition to the FY2122 rollup field, I would also be looking for:

  • foundation_total_fy1819
  • foundation_total_fy1920
  • foundation_total_fy2021
  • foundation_total_fy2122
  • foundation_largest_donation
  • foundation_number_donations
  • foundation_first_donation_date
  • foundation_first_donation_amount
  • foundation_last_donated
  • foundation_lifetime_usd_total
  • foundation_date_of_largest_donation
  • change_fy2021_fy2122 (or the equivalent change between FY2021 and FY2122 metric - AF only)
  • endowment_change_fy2021_fy2122 (or the equivalent change between FY2021 and FY2122 metric - Endowment only)
  • foundation_change_fy2021_fy2122 (or the equivalent change between FY2021 and FY2122 metric - combined funds)
  • foundation_change_fy1920_fy2021 (or the equivalent change between FY1920 and FY2021 metric - combined funds)
  • foundation_change_fy1819_fy1920 (or the equivalent change between FY1819 and FY1920 metric - combined funds)
Jul 19 2021, 11:20 PM · fundraising sprint onion pit, Patch-For-Review, fundraising Sprint NULL calorie food cart, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
EYener added a comment to T286741: record which email addresses are on the MSL in civi.

Update on the immediate use case for this that I was able to pretty easily provide an update for the Email team on who was / was not on the MSL on their necessary list.

Jul 19 2021, 5:15 PM · Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
EYener added a comment to T286556: Fundraising Access for Joseph Mando.

@Dwisehaupt Just noting that I'll send Joseph your way today once he's in his Gmail and IRC, etc, to get setup configured. I forgot to mention that he won't have the 'usual' superset permissions but he'll need an Admin account instead of a Data Consumer account. Thanks!

Jul 19 2021, 12:28 PM · FR-Tech-Analytics, fundraising-tech-ops, Fundraising-Backlog

Jul 14 2021

EYener added a comment to T286556: Fundraising Access for Joseph Mando.

Adding to the list that Joseph will also need a Jupyter instance. I could create a separate task for that if this isn't onboarding-appropriate yet.

Jul 14 2021, 3:04 PM · FR-Tech-Analytics, fundraising-tech-ops, Fundraising-Backlog

Jul 13 2021

EYener added a comment to T286556: Fundraising Access for Joseph Mando.

Oh, Joseph also has an ITS-provided yubikey and macbook pro laptop.

Jul 13 2021, 6:05 PM · FR-Tech-Analytics, fundraising-tech-ops, Fundraising-Backlog
EYener added a comment to T286556: Fundraising Access for Joseph Mando.

Joseph's start date: July 19, 2021. Anything we can get access to (like sql / server / Superset / SSH access setup started) would be awesome! Thank you!

Jul 13 2021, 12:44 PM · FR-Tech-Analytics, fundraising-tech-ops, Fundraising-Backlog
EYener created T286556: Fundraising Access for Joseph Mando.
Jul 13 2021, 12:43 PM · FR-Tech-Analytics, fundraising-tech-ops, Fundraising-Backlog
EYener added a comment to T285359: make acoustic mail data searchable through search kit .

Ah, got it. Thanks @Eileenmcnaughton

Jul 13 2021, 12:03 PM · Patch-For-Review, Fundraising-Backlog, Fundraising Sprint Mandatory corn dogs

Jul 12 2021

EYener added a comment to T280595: Wmf-donor - new year fields.

Makes perfect sense, there are a lot of systems that these would have to go live in. I would just be interested in involvement up to the point of seeing new fields visible in civicrm.wmf_donor - we would use these as soon as they're available (my fault I didn't double check that FY2122 was available already).

Jul 12 2021, 8:02 PM · fundraising sprint onion pit, Patch-For-Review, fundraising Sprint NULL calorie food cart, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
EYener added a comment to T280595: Wmf-donor - new year fields.

Just guessing - probably for the Civi UI update to ensure these fields are visible in the Civi UI, but for use in analytics and reporting, the update to the civicrm.wmf_donor table will get us where we need to be for most use cases, where we can work with this for the Japan campaign and ongoing for 99% of reporting

Jul 12 2021, 7:20 PM · fundraising sprint onion pit, Patch-For-Review, fundraising Sprint NULL calorie food cart, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
EYener updated subscribers of T280595: Wmf-donor - new year fields.

Hi @Eileenmcnaughton - I was just asking about this today! I'll offer to write a commit for wmf_donor for this and submit it to you as a reviewer, if @DStrine is okay with that, as we use these fields all the time in Analytics. I would also like to propose adding a few additional fields that combine Endowment and Annual Fund totals, as this would cut down on the post-processing I do in our data cubes.

Jul 12 2021, 7:00 PM · fundraising sprint onion pit, Patch-For-Review, fundraising Sprint NULL calorie food cart, Wikimedia-Fundraising-CiviCRM, Fundraising-Backlog
EYener added a comment to T285359: make acoustic mail data searchable through search kit .

Sorry @Eileenmcnaughton I'm coming back to this now; is the query in prod in the correct format, or was the patch to make the UI more SQL-like, or something different...? Thanks for the help! Either way, it's working now.

Jul 12 2021, 4:53 PM · Patch-For-Review, Fundraising-Backlog, Fundraising Sprint Mandatory corn dogs

Jun 29 2021

EYener added a comment to T285359: make acoustic mail data searchable through search kit .

@Eileenmcnaughton thanks! This is working in dev but not in prod. Here is the same searchkit reproduced in prod. I'm getting a spinning wheel when I click on 'search' and the results are unexpected: CIDs as old as 1 are showing up in the initial results, which never fully return.

Jun 29 2021, 3:40 PM · Patch-For-Review, Fundraising-Backlog, Fundraising Sprint Mandatory corn dogs
EYener added a comment to T284784: Data Pull: New FY2021 Donors.

Just a note as I saw this pop up - can we change the task title to New FY2021 Donors to avoid confusion? I think I understand from context that this is to be used in FY2122, but my two cents is that it will be hard to tell in the future what links these donors to FY2122. Thanks!

Jun 29 2021, 1:24 PM · Fundraising Sprint Mandatory corn dogs, Wikimedia-Fundraising-CiviCRM, FR-Target-Smart, Fundraising-Backlog

Jun 22 2021

EYener added a comment to T285359: make acoustic mail data searchable through search kit .

I'm trying to test this under the Mailing Datas test searchkit and not seeing any results come up when query for 3 mailing_identifiers that were sent out around October - November

Jun 22 2021, 10:57 PM · Patch-For-Review, Fundraising-Backlog, Fundraising Sprint Mandatory corn dogs

Jun 13 2021

EYener added a comment to T284784: Data Pull: New FY2021 Donors.

The below query pulls a total of 832,108 donors. @LeanneS I realize this is lower than expected: there are a number of US individuals who are first time donors in FY2021 who are opted in (criteria mentioned above) who nonetheless do not have a listed street address, mostly due to matching gifts (at first glance).

Jun 13 2021, 11:22 PM · Fundraising Sprint Mandatory corn dogs, Wikimedia-Fundraising-CiviCRM, FR-Target-Smart, Fundraising-Backlog

Jun 11 2021

EYener added a comment to T282012: WikipediaPortal Event Platform Migration.

Thank you! Yes we can get this done in Q1.

Jun 11 2021, 7:09 PM · Data-Engineering-Kanban, Patch-For-Review, Web-Team-Backlog (Kanbanana-FY-2021-22), Analytics, Data-Engineering, Event-Platform
EYener added a comment to T284784: Data Pull: New FY2021 Donors.

@LeanneS where should the data pull live on the file server once I gather the data? I'll be working on this tomorrow.

Jun 11 2021, 12:33 AM · Fundraising Sprint Mandatory corn dogs, Wikimedia-Fundraising-CiviCRM, FR-Target-Smart, Fundraising-Backlog

May 6 2021

EYener added a comment to T282012: WikipediaPortal Event Platform Migration.

Fair enough, @Ottomata! Is Q1 too late for this self-imposed deadline?

May 6 2021, 10:08 PM · Data-Engineering-Kanban, Patch-For-Review, Web-Team-Backlog (Kanbanana-FY-2021-22), Analytics, Data-Engineering, Event-Platform
EYener added a comment to T282012: WikipediaPortal Event Platform Migration.

@Ottomata when would this migration need to happen? If we have a deadline, we might be able to prioritize it and help find an owner.

May 6 2021, 4:00 PM · Data-Engineering-Kanban, Patch-For-Review, Web-Team-Backlog (Kanbanana-FY-2021-22), Analytics, Data-Engineering, Event-Platform

Apr 16 2021

EYener added a comment to T277065: Requesting access to sites from Google Search Console for pcoombe@wikimedia.org.

Thanks @JKatzWMF - I'm seeing the mobile subdomains now! And thanks @Pcoombe for all your help here.

Apr 16 2021, 6:24 PM · Search-Console-access-request, SRE

Apr 12 2021

EYener closed T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage as Resolved.
Apr 12 2021, 6:50 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics
EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Hi all! I am going to close out this ticket, since the main point - whitelisting the 3 mentioned schemas - has been resolved.

Apr 12 2021, 6:50 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics
EYener created T279952: event.WikipediaPortal referer modification.
Apr 12 2021, 6:47 PM · Data-Engineering, Privacy Engineering, FR-Tech-Analytics

Apr 7 2021

EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Update for those on this task:

Apr 7 2021, 4:04 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics

Apr 5 2021

EYener created T279292: [FR Analytics]: Enable template processing.
Apr 5 2021, 2:19 PM · FR-Tech-Analytics, fundraising-tech-ops, Fundraising-Backlog
EYener added a comment to T278834: Impression weirdness in 2020-12-07 en6C desktop large test.

Hi all! @DStrine : The weirdness you're referring to was isolated to mobile devices only. We saw a slight increase in mobile impressions and a simultaneous slight decrease in mobile donations, leading to an overall notable decrease in mobile donation rate. However, it doesn't appear there was a technical bug....that we've identified, yet.

Apr 5 2021, 1:24 PM · MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Mar 26 2021

EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Hi, just pinging back on this ticket. @mforns are the new gerrit review requests looking better?

Mar 26 2021, 1:39 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics

Mar 18 2021

EYener closed T277721: ssh access to stat100x machines as Resolved.

Super! Thank you both. I have logged in successfully. I'll resolve the task!

Mar 18 2021, 12:02 PM · Analytics

Mar 17 2021

EYener updated subscribers of T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Hi @mforns - thanks again for the help and advice earlier this week. I have updated the gerrit reviews with the information we discussed earlier this week. I used the same branches - I hope that is okay? Please let me know if there is a preferred or better way to push changes - always want to learn more! Also, I am not 100% confident that I've spelled everything correctly!

Mar 17 2021, 11:56 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics
EYener created T277721: ssh access to stat100x machines.
Mar 17 2021, 11:13 PM · Analytics

Mar 16 2021

EYener added a comment to T271416: Benevity Import Error.

Got it, thanks @Eileenmcnaughton

Mar 16 2021, 11:12 AM · Fundraising Sprint File Systems Stage Show, Fundraising Sprint Esperantoland, Fundraising Sprint Downed power line jump rope, Fundraising-Backlog, Wikimedia-Fundraising-CiviCRM

Mar 10 2021

EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Hi @mforns getting back to you on this. I'll schedule a meeting for next week with you, myself, @Jdrewniak, @mpopov , and @Pcoombe please feel free to attend as well as you are a user of this data as well and know our needs (and future needs!) so well! I will look for a time.

Mar 10 2021, 10:19 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics

Mar 9 2021

EYener added a comment to T270503: Presto error in Superest - only when grouping.

Thanks again @JAllemandou . This was confusing for me because, like you said, I was only aware of query optimization and it doesn't fit with my understanding of SQL - so I appreciate the information! I will keep this in mind and (if it comes up again) try to reorder and "trick" the execution.

Mar 9 2021, 1:30 PM · Analytics-Radar

Mar 5 2021

EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Thank you so much for the quick response, @mforns! I figured that I had missed the preservation window, but did want to ask.

Mar 5 2021, 8:25 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics
EYener added a comment to T270503: Presto error in Superest - only when grouping.

@JAllemandou Phew! Thank you for this explanation, and thank you for adding event_l_card to the table definition. I am please to say that this dash is totally fixed! Thank you for your sustained help through several issues and lots of questions.

Mar 5 2021, 4:23 PM · Analytics-Radar
EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Hi all! Independent of the important security questions raised in the gerrit review, I want to ask about the possibility of accessing Portal data from Nov. 30, 2020 onward.

Mar 5 2021, 4:13 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics

Mar 2 2021

EYener added a comment to T272080: [FR Analytics]:Superset user - kill query after 60-65 seconds.

I was thinking about this task the other day, and I don't think that killing running queries after 65 seconds will fix the user experience issue. Because of the way that Superset queues queries, even if everything in the processlist that is being executed by the research user is killed at 65 or 70 seconds, there are still queries waiting to start in the process list that both begin and timeout after the UI says that the query has timed out. Any ideas of how to kill those before they start?

Mar 2 2021, 4:47 PM · fundraising-tech-ops, FR-Tech-Analytics, Fundraising-Backlog

Mar 1 2021

EYener updated subscribers of T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

@mforns thanks for linking to T262433! I've added myself as a subscriber. Heads up for @mpopov, as I believe you authored this (?) that we do use this schema in Fundraising, and would like to use it more. Keeping eyes on the Portal is a good health metric for how users interact with Wikipedia, and the same can be said for the WikiApp and WikiAppiOS schemas. We run fundraising campaigns in each of these places, and keeping a close eye on how user behavior changes over time, across several years of fundraising campaigns, is important to ensuring that we are not under-serving a particular user base who sees our campaigns. We also want to ensure that there are no technical issues with our campaigns in a particular region / access method / etc.

Mar 1 2021, 8:05 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics

Feb 23 2021

EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Thank you @mforns and apologies that it took me a while to return to this. I've submitted three individual reviews for the 3 schemas we would like to whitelist, and I'm looking forward to review.

Feb 23 2021, 12:01 AM · Fundraising-Backlog, FR-Tech-Analytics, Analytics

Feb 22 2021

EYener added a comment to T270503: Presto error in Superest - only when grouping.

Thanks @elukey! I also wanted to ask about caching; it appears that caching is no longer working for this dashboard - do you know of a possible cause for this?

Feb 22 2021, 2:13 PM · Analytics-Radar

Feb 21 2021

EYener added a comment to T270503: Presto error in Superest - only when grouping.

Thanks again for helping with the authentication issue @elukey. I'm sure it's all fixed now, but I also wanted to note that it looks like my email address in Superset is listed as EYener@email.notfound - just in case this is helpful.

Feb 21 2021, 10:05 PM · Analytics-Radar

Feb 4 2021

EYener added a comment to T271992: Adding 2 new columns to Engage Reconciliation reports.

@MDemosWMF I'd be interested to hear about other reports you're currently running in Civi UI. This is something I'm always mentioning to folks - if a report doesn't require individual record or donor lookup, it's a great candidate to be brought over to Superset. I'd be happy to hear more about it!

Feb 4 2021, 7:14 PM · Fundraising Sprint Esperantoland, Fundraising Sprint Downed power line jump rope, Fundraising Sprint Corrugated super slide, Fundraising-Backlog
EYener added a comment to T271992: Adding 2 new columns to Engage Reconciliation reports.

Thanks for the add @MDemosWMF. Is there a need to see individual contributions during this process? If not, I would advocate for keeping the report in Superset, which is great for running aggregated reports and adding / tweaking things as business requirements change. That would also remove the possibility of reports diverging as time goes on.

Feb 4 2021, 6:56 PM · Fundraising Sprint Esperantoland, Fundraising Sprint Downed power line jump rope, Fundraising Sprint Corrugated super slide, Fundraising-Backlog

Jan 29 2021

EYener added a comment to T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.

Thanks, @Pcoombe I added that to the task description to make sure it's captured.

Jan 29 2021, 1:29 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics
EYener updated the task description for T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.
Jan 29 2021, 1:28 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics

Jan 28 2021

EYener created T273246: Whitelist Portal and WikipediaApp event data for (sanitized) long-term storage.
Jan 28 2021, 11:15 PM · Fundraising-Backlog, FR-Tech-Analytics, Analytics
EYener updated subscribers of T270503: Presto error in Superest - only when grouping.

Hi all, I spoke to @JAllemandou today about the issue I am seeing while editing this dashboard:

Jan 28 2021, 4:38 PM · Analytics-Radar

Jan 27 2021

EYener added a comment to T270503: Presto error in Superest - only when grouping.

Hi @JAllemandou thanks for the reply! I am pulling this task back up and opened the dashboard to implement these suggestions. However, I encountered a new error on all charts:

Jan 27 2021, 2:11 AM · Analytics-Radar

Jan 26 2021

EYener closed T266599: As an email reporter, I need to know how to pull domain reports in Civi for soft bounces as Resolved.

Hmm I'm not a pro on that @KHaggard. Let me circle up with the FR tech folks in our next sync up to see if this is more of a Civi thing, a Superset thing, or an ad hoc request thing and we can get back to you. I'll close this out for now since it seems like it's no longer needed?

Jan 26 2021, 2:35 PM · FR-Email, Fundraising-Backlog
EYener added a comment to T266599: As an email reporter, I need to know how to pull domain reports in Civi for soft bounces.

@KHaggard I wanted to circle back on this as it came up as a request in our Asana backlog as well.

Jan 26 2021, 1:09 PM · FR-Email, Fundraising-Backlog