Page MenuHomePhabricator

AndyRussG (Andrew Green)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Oct 28 2014, 2:36 PM (273 w, 3 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
AGreen (WMF) [ Global Accounts ]

Recent Activity

Today

AndyRussG moved T243356: Civi: January 2020 Ingenico recurrings processing in duplicate? from Backlog to Done on the Fundraising Sprint Byzantine Empire Strikes Back board.
Fri, Jan 24, 5:18 PM · Fundraising Sprint Byzantine Empire Strikes Back, Recurring-Donations, Fundraising-Backlog

Wed, Jan 15

AndyRussG added projects to T242895: Safari crashes on some click handling events for banners that move the centralNotice element outside of the the main body: MediaWiki-extensions-CentralNotice, Fundraising-Backlog.
Wed, Jan 15, 5:57 PM · Performance-Team (Radar), Readers-Web-Backlog, MinervaNeue (Tracking), Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG added a comment to T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.

To test the fix locally:

  • Set up two campaigns, one higher priority than the other.
  • Include a close button in the banner for the campaign with higher priority.
  • The higher priority campaign should always show, until the close button is clicked on the banner. On subsequent pageviews after the button has been clicked, the lower priority campaign should show.
  • To test again, clear cookies for the local wiki.
Wed, Jan 15, 5:28 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review

Mon, Jan 13

AndyRussG added a comment to T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.

@AndyRussG Okay, I can see what you mean. When I look at the loop what I see is that state.setCampaign is called early on and that should set the status to CAMPAIGN_CHOSEN for the campaign that gets selected. cancelBanner is called if hide.shouldHide() is true. Just recording my findings as I go.

Mon, Jan 13, 4:20 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review

Fri, Jan 10

AndyRussG added a comment to T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.

@AndyRussG Is there any documentation of what these status codes mean?

Fri, Jan 10, 2:46 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review

Tue, Jan 7

AndyRussG renamed T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden from Campaign fallen back to gets incorrect status code to Campaign fallen back to gets incorrect status code and may be incorrectly hidden.
Tue, Jan 7, 9:17 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review
AndyRussG claimed T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.
Tue, Jan 7, 9:16 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a comment to T183978: [Epic] Fundraising kafkatee changes.

Here's an overview of the status of this project:

Tue, Jan 7, 8:05 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T242065: FRUEC: Ensure compatibility with legacy behaviour for missing and empty values, for all LandingPage event properties.
Tue, Jan 7, 4:44 AM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T242065: FRUEC: Ensure compatibility with legacy behaviour for missing and empty values, for all LandingPage event properties: T183978: [Epic] Fundraising kafkatee changes.
Tue, Jan 7, 4:44 AM · Fundraising-Backlog
AndyRussG created T242065: FRUEC: Ensure compatibility with legacy behaviour for missing and empty values, for all LandingPage event properties.
Tue, Jan 7, 4:43 AM · Fundraising-Backlog

Mon, Jan 6

AndyRussG added a comment to T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

Just updated the draft specification for this. We should also look at legacy default values for empty country and project fields.

Mon, Jan 6, 8:52 PM · Fundraising-Backlog
AndyRussG added a comment to T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.

We've set up a new kafkatee collector host at codfw, frban2001, which will replace the aged alnitak once we're confident everything is working properly on Debian Buster etc. In the meantime it's useful for comparison, to help rule out losses in the kafka->kafkatee->logfile segment in the pipeline. I ran all of yesterdays new-pipeline landingpages json logs through a simple perl json decoder and observed that alnitak and frban2001 collected exactly the same data for 12/11. The script I used is at mintaka:/tmp/json-log-filter, and frban2001's log store is mounted at mintaka:/mnt/banner_logs_new. The beacon-impressions logs are harder to compare since they're sampled at 1:10, and the two hosts are expected to collect different messages. So we set frban1001 to collecting beacon-impressions 1:1 for a day, and at the end we'll compare what was collected to what's in Hive.

Mon, Jan 6, 7:27 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a parent task for T242022: Verify no losses in kafka->kafkatee->logfile data pipeline segment: T183978: [Epic] Fundraising kafkatee changes.
Mon, Jan 6, 7:25 PM · Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T242022: Verify no losses in kafka->kafkatee->logfile data pipeline segment.
Mon, Jan 6, 7:25 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG created T242022: Verify no losses in kafka->kafkatee->logfile data pipeline segment.
Mon, Jan 6, 7:25 PM · Fundraising-Backlog

Fri, Jan 3

AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.
Fri, Jan 3, 4:51 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline: T183978: [Epic] Fundraising kafkatee changes.
Fri, Jan 3, 4:51 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.
Fri, Jan 3, 4:39 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines: T183978: [Epic] Fundraising kafkatee changes.
Fri, Jan 3, 4:39 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Dec 22 2019

AndyRussG moved T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden from Doing to Backlog on the Fundraising Sprint YAMLton, the Musical board.
Dec 22 2019, 7:42 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review

Dec 19 2019

AndyRussG renamed T241162: Turnilo no longer showing sample-rate adjusted data for banner activity from Turnilo no longer showing sample-rate adjusted data to Turnilo no longer showing sample-rate adjusted data for banner activity.
Dec 19 2019, 6:54 PM · Analytics, Fundraising-Backlog
AndyRussG created T241162: Turnilo no longer showing sample-rate adjusted data for banner activity.
Dec 19 2019, 6:27 PM · Analytics, Fundraising-Backlog

Dec 18 2019

AndyRussG created T241070: Server for previewing/usability testing new CentralNotice features.
Dec 18 2019, 3:40 PM · Fundraising-Backlog, Fundraising Sprint Autocorrect Astrology Ascendant, MediaWiki-extensions-CentralNotice, Fundraising Sprint Byzantine Empire Strikes Back
AndyRussG placed T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden up for grabs.
Dec 18 2019, 3:33 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review

Dec 16 2019

AndyRussG claimed T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.
Dec 16 2019, 7:19 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review
AndyRussG moved T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden from Backlog to Doing on the Fundraising Sprint YAMLton, the Musical board.
Dec 16 2019, 7:19 PM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review
AndyRussG added a project to T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden: Fundraising Sprint YAMLton, the Musical.
Dec 16 2019, 5:23 AM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review
AndyRussG edited P9870 T240802 Hive query for status codes.
Dec 16 2019, 5:22 AM
AndyRussG updated the task description for T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.
Dec 16 2019, 5:20 AM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review
AndyRussG updated the task description for T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.
Dec 16 2019, 12:22 AM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review
AndyRussG created P9870 T240802 Hive query for status codes.
Dec 16 2019, 12:22 AM
AndyRussG updated the task description for T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.
Dec 16 2019, 12:17 AM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review
AndyRussG created T240802: Campaign fallen back to gets incorrect status code and may be incorrectly hidden.
Dec 16 2019, 12:14 AM · MW-1.35-notes (1.35.0-wmf.16; 2020-01-21), Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Fundraising Sprint YAMLton, the Musical, Fundraising Sprint Autocorrect Astrology Ascendant, Fundraising Sprint Byzantine Empire Strikes Back, Patch-For-Review

Dec 12 2019

AndyRussG moved T196563: Write a specification for mapping banner/landing page impression event properties -> database schema from Backlog to Pending Deployment on the Fundraising Sprint YAMLton, the Musical board.
Dec 12 2019, 1:15 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Princess Mongodb, Fundraising Sprint Office  , Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline from Backlog to Review on the Fundraising Sprint YAMLton, the Musical board.
Dec 12 2019, 1:15 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG moved T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines from Backlog to Review on the Fundraising Sprint YAMLton, the Musical board.
Dec 12 2019, 1:15 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG moved T237736: FRUEC: Raise error when timestamp not found in filename from Backlog to Review on the Fundraising Sprint YAMLton, the Musical board.
Dec 12 2019, 1:14 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Patch-For-Review, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG moved T240505: Unbreak now (please) : newly broken CentralNotice admin interface from Backlog to Deployed on the Fundraising Sprint YAMLton, the Musical board.
Dec 12 2019, 1:14 AM · Fundraising Sprint YAMLton, the Musical, Fundraising-Backlog

Dec 11 2019

AndyRussG added a comment to T240505: Unbreak now (please) : newly broken CentralNotice admin interface.

As per T219604, it's just the RL modules aliases that have changed, but the modules are still around, so we should be able to fix pretty easily.

Dec 11 2019, 9:38 PM · Fundraising Sprint YAMLton, the Musical, Fundraising-Backlog
AndyRussG added a comment to T240505: Unbreak now (please) : newly broken CentralNotice admin interface.

jquery.ui.datepicker was removed in wmf.10, yes. wmf_deploy strikes yet again.

Dec 11 2019, 9:35 PM · Fundraising Sprint YAMLton, the Musical, Fundraising-Backlog

Dec 5 2019

AndyRussG added a comment to T239778: Security review of banner with FB and Twitter share buttons.

Ugh, thanks for finding that, @Bawolff. I'm going to break that out into a separate high/ubn ticket.
Filed: T239919

Dec 5 2019, 3:34 PM · Security Readiness Reviews, Privacy Engineering, MediaWiki-extensions-CentralNotice, Privacy, Fundraising-Backlog
AndyRussG added a comment to T239778: Security review of banner with FB and Twitter share buttons.

@Bawolff thank you so much for finding this!!!! This same code is in live FR banners across enwiki. I've created a separate task: T239922

Dec 5 2019, 3:28 PM · Security Readiness Reviews, Privacy Engineering, MediaWiki-extensions-CentralNotice, Privacy, Fundraising-Backlog

Dec 4 2019

AndyRussG added a comment to T237605: Create kerberos principals for users.

Hi! Here's my request for the new creds for stat100* and notebook100*, please. Username: andyrussg. Thanks so much for working on this!!!!! :)

Dec 4 2019, 5:02 PM · Patch-For-Review, Analytics-Kanban, Analytics
AndyRussG updated the task description for T239778: Security review of banner with FB and Twitter share buttons.
Dec 4 2019, 3:44 PM · Security Readiness Reviews, Privacy Engineering, MediaWiki-extensions-CentralNotice, Privacy, Fundraising-Backlog
AndyRussG changed the visibility for T239778: Security review of banner with FB and Twitter share buttons.
Dec 4 2019, 3:11 PM · Security Readiness Reviews, Privacy Engineering, MediaWiki-extensions-CentralNotice, Privacy, Fundraising-Backlog
AndyRussG created T239778: Security review of banner with FB and Twitter share buttons.
Dec 4 2019, 6:44 AM · Security Readiness Reviews, Privacy Engineering, MediaWiki-extensions-CentralNotice, Privacy, Fundraising-Backlog
AndyRussG changed the visibility for F31453782: T236834_log_differences_20191105.html.
Dec 4 2019, 6:17 AM
AndyRussG changed the visibility for F31453782: T236834_log_differences_20191105.html.
Dec 4 2019, 6:16 AM

Dec 2 2019

AndyRussG added a comment to T239570: Investigate options for dropped CN EventLogging events for new pipeline.

I think it's blocking on the URL path /beacon/event. See https://easylist.to/easylist/easyprivacy.txt and T220627#5638168.

Dec 2 2019, 6:05 PM · Fundraising-Backlog
AndyRussG moved T198752: Queries and maybe scripts to verify equivalence of data in new-Kafka-pipeline-testing and pgehres production databases from Backlog to Review on the Fundraising Sprint X-rays board.
Dec 2 2019, 7:50 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Bert and Ernie's Excellent Adventure, Fundraising Sprint A series of unfortunate event handlers, Fundraising Sprint XML ate my homework, Fundraising Sprint Window dressing is mostly olive oil, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T239570: Investigate options for dropped CN EventLogging events for new pipeline.
Dec 2 2019, 7:44 AM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T239570: Investigate options for dropped CN EventLogging events for new pipeline: T183978: [Epic] Fundraising kafkatee changes.
Dec 2 2019, 7:44 AM · Fundraising-Backlog
AndyRussG updated the task description for T239570: Investigate options for dropped CN EventLogging events for new pipeline.
Dec 2 2019, 7:44 AM · Fundraising-Backlog
AndyRussG created T239570: Investigate options for dropped CN EventLogging events for new pipeline.
Dec 2 2019, 7:44 AM · Fundraising-Backlog
AndyRussG added a comment to T220627: QuickSurveys EventLogging missing ~10% of interactions.

Just to note, we have the same problem for the new CentralNotice data pipeline, which uses EventLogging, as compared to the old pipeline, which uses a custom call to beacon/impression not blocked by AdBlock. In case it's useful: see T236834#5696044 (and the two comments after that).

Dec 2 2019, 7:33 AM · MW-1.35-notes (1.35.0-wmf.3; 2019-10-22), Patch-For-Review, Readers-Web-Backlog (Kanbanana-2019-20-Q2), Analytics, Analytics-EventLogging, QuickSurveys
AndyRussG added a comment to T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.

I'm not sure if this is at all pertinent, but we spent some time trying to debug a situation where we were missing about 10% of EventLogging data from people taking a survey served via the QuickSurveys tool. In essence, for 10% of readers, the tool was displaying the surveys correctly and we knew they had taken the survey but we never get the EventLogging that we should have. We ultimately decided that it was a mixture of adblock (which has settings that allow the javascript etc. to show the survey but blocks EventLogging) and, in our case, people could right-click off the page to take the survey and that wasn't triggered EventLogging as expected.
T220627#5641946

Dec 2 2019, 7:27 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG updated the task description for T239564: Monitor and investigate possible event dropping by Kafkatee.
Dec 2 2019, 7:00 AM · fundraising-tech-ops, Fundraising-Backlog
AndyRussG moved T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline from Doing to Review on the Fundraising Sprint X-rays board.
Dec 2 2019, 6:58 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG updated subscribers of T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.

Windows for log samples:

Dec 2 2019, 6:57 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG created T239564: Monitor and investigate possible event dropping by Kafkatee.
Dec 2 2019, 4:58 AM · fundraising-tech-ops, Fundraising-Backlog

Nov 27 2019

AndyRussG moved T196563: Write a specification for mapping banner/landing page impression event properties -> database schema from Backlog to Pending Deployment on the Fundraising Sprint X-rays board.
Nov 27 2019, 5:35 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Princess Mongodb, Fundraising Sprint Office  , Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T235284: FRUEC: Debug large discrepancy in data in initial test run. from Backlog to Deployed on the Fundraising Sprint X-rays board.
Nov 27 2019, 5:34 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG moved T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines from Backlog to Review on the Fundraising Sprint X-rays board.
Nov 27 2019, 5:34 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG moved T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline from Backlog to Doing on the Fundraising Sprint X-rays board.
Nov 27 2019, 5:34 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG moved T237736: FRUEC: Raise error when timestamp not found in filename from Backlog to Review on the Fundraising Sprint X-rays board.
Nov 27 2019, 5:34 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Patch-For-Review, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a comment to T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.

Differences found in orphaned old pipeline events:

  • 28% orphaned GET requests vs. 10% overall GET requests
  • 63% orphaned Windows requests vs. 39% overall Windows requests
Nov 27 2019, 5:08 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a comment to T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.

Just did one-to-one merges using web request logs in Hive, in both directions, using fairly large samples in both cases.

Nov 27 2019, 5:47 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG created P9757 T236834_merge_new_old_logs_1.hql.
Nov 27 2019, 5:40 AM
AndyRussG created P9756 T236834_merge_old_new_logs_1.hql.
Nov 27 2019, 5:32 AM

Nov 25 2019

AndyRussG added a comment to T238560: Doubts and questions about Kerberos and Hadoop.

@elukey @Nuria Thanks so much!!!!!!!!!!!!!!!!!!!!!!!!

Nov 25 2019, 8:26 PM · Analytics
AndyRussG added a comment to T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.

Here are some results:

Nov 25 2019, 6:00 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Nov 21 2019

AndyRussG added a comment to T238560: Doubts and questions about Kerberos and Hadoop.

could you give some examples of issues you expect to see and troubleshoot (maybe some tickets from the past?)?

Nov 21 2019, 8:07 PM · Analytics

Nov 20 2019

AndyRussG renamed T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline from FRUEC: Debug minor discrepancy in banner impression data between old and new pipelines to FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline.
Nov 20 2019, 3:58 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a comment to T235447: 2019 English campaign fundraising in apps.

Hi all! Congrats to all for your work on this...

Nov 20 2019, 3:21 PM · Wikipedia-Android-App-Backlog, Wikipedia-iOS-App-Backlog, Android-app-feature-Feeds, iOS-app-feature-Feed

Nov 19 2019

AndyRussG moved T236834: FRUEC: Detailed comparison of events in old and new log files for banner impression pipeline from Backlog to Doing on the Fundraising Sprint A Wrinkle in Timezones board.
Nov 19 2019, 7:55 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG moved T235461: FRUEC: For CentralNotice impression counts, take into account client-side sample rate from Doing to Backlog on the Fundraising Sprint A Wrinkle in Timezones board.
Nov 19 2019, 7:55 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising-Backlog

Nov 18 2019

AndyRussG created T238594: FRUEC: Adapt comparison scripts to focus on specific campaigns or other event properties with expected specific values.
Nov 18 2019, 8:55 PM · Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T238592: Ask other teams for input on extra entries in new pipeline landing page logs .
Nov 18 2019, 8:45 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T238592: Ask other teams for input on extra entries in new pipeline landing page logs : T183978: [Epic] Fundraising kafkatee changes.
Nov 18 2019, 8:45 PM · Fundraising-Backlog
AndyRussG created T238592: Ask other teams for input on extra entries in new pipeline landing page logs .
Nov 18 2019, 8:44 PM · Fundraising-Backlog
AndyRussG moved T235461: FRUEC: For CentralNotice impression counts, take into account client-side sample rate from Backlog to Doing on the Fundraising Sprint A Wrinkle in Timezones board.
Nov 18 2019, 11:30 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising-Backlog
AndyRussG moved T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines from Doing to Review on the Fundraising Sprint A Wrinkle in Timezones board.
Nov 18 2019, 11:30 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG changed the point value for T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines from 2 to 4.
Nov 18 2019, 11:30 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a comment to T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.

Windows for log samples:

Nov 18 2019, 11:29 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Nov 14 2019

AndyRussG moved T235461: FRUEC: For CentralNotice impression counts, take into account client-side sample rate from Deployed to Backlog on the Fundraising Sprint A Wrinkle in Timezones board.
Nov 14 2019, 5:51 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising-Backlog
AndyRussG moved T235284: FRUEC: Debug large discrepancy in data in initial test run. from Backlog to Deployed on the Fundraising Sprint A Wrinkle in Timezones board.
Nov 14 2019, 5:51 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG moved T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines from Backlog to Doing on the Fundraising Sprint A Wrinkle in Timezones board.
Nov 14 2019, 5:51 PM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Nov 12 2019

AndyRussG closed T236627: CentralNotice: Adapt impression event schema for campaign fallback, a subtask of T183978: [Epic] Fundraising kafkatee changes, as Resolved.
Nov 12 2019, 9:12 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG closed T236627: CentralNotice: Adapt impression event schema for campaign fallback as Resolved.
Nov 12 2019, 9:12 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG added a comment to T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.

Here's a summary of the situation regarding discrepancies between the new and old pipelines for Landing Pages (includes also measures obtained in T235284).

Nov 12 2019, 5:34 AM · Fundraising Sprint X-rays, Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Nov 11 2019

AndyRussG renamed T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages from FREUC: Check that empty uselang or missing URL parameter should default to 'en' language for Landing Pages to FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages.
Nov 11 2019, 11:25 PM · Fundraising-Backlog
AndyRussG renamed T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages from FREUC: Check that empty uselang URL parameter should default to 'en' language for Landing Pages to FREUC: Check that empty uselang or missing URL parameter should default to 'en' language for Landing Pages.
Nov 11 2019, 8:56 PM · Fundraising-Backlog
AndyRussG renamed T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions from FRUEC: Empty language property should default to 'en' for LandingPage impressions to FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.
Nov 11 2019, 8:53 PM · Fundraising-Backlog
AndyRussG added a comment to T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

See also T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

Nov 11 2019, 8:51 PM · Fundraising-Backlog
AndyRussG added a comment to T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

See also T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages.

Nov 11 2019, 8:50 PM · Fundraising-Backlog
AndyRussG created T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages.
Nov 11 2019, 8:50 PM · Fundraising-Backlog
AndyRussG added a comment to T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

FRUEC currently accepts LandingPage events with no language property in the JSON input. However, if the property exists and its value is an empty string, the event is marked invalid and not counted. However, in such a case, the legacy system (DjangoBannerStats) defaults the language to 'en'.

Nov 11 2019, 8:40 PM · Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.
Nov 11 2019, 3:54 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions: T183978: [Epic] Fundraising kafkatee changes.
Nov 11 2019, 3:54 PM · Fundraising-Backlog