Page MenuHomePhabricator

AndyRussG (Andrew Green)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Oct 28 2014, 2:36 PM (263 w, 11 h)
Availability
Available
LDAP User
Unknown
MediaWiki User
AGreen (WMF) [ Global Accounts ]

Recent Activity

Yesterday

AndyRussG closed T236627: CentralNotice: Adapt impression event schema for campaign fallback, a subtask of T183978: [Epic] Fundraising kafkatee changes, as Resolved.
Tue, Nov 12, 9:12 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG closed T236627: CentralNotice: Adapt impression event schema for campaign fallback as Resolved.
Tue, Nov 12, 9:12 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG added a comment to T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.

Here's a summary of the situation regarding discrepancies between the new and old pipelines for Landing Pages (includes also measures obtained in T235284).

Tue, Nov 12, 5:34 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Mon, Nov 11

AndyRussG renamed T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages from FREUC: Check that empty uselang or missing URL parameter should default to 'en' language for Landing Pages to FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages.
Mon, Nov 11, 11:25 PM · Fundraising-Backlog
AndyRussG renamed T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages from FREUC: Check that empty uselang URL parameter should default to 'en' language for Landing Pages to FREUC: Check that empty uselang or missing URL parameter should default to 'en' language for Landing Pages.
Mon, Nov 11, 8:56 PM · Fundraising-Backlog
AndyRussG renamed T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions from FRUEC: Empty language property should default to 'en' for LandingPage impressions to FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.
Mon, Nov 11, 8:53 PM · Fundraising-Backlog
AndyRussG added a comment to T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

See also T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

Mon, Nov 11, 8:51 PM · Fundraising-Backlog
AndyRussG added a comment to T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

See also T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages.

Mon, Nov 11, 8:50 PM · Fundraising-Backlog
AndyRussG created T238023: FREUC: Check that empty or missing uselang or language URL parameter should default to 'en' language for Landing Pages.
Mon, Nov 11, 8:50 PM · Fundraising-Backlog
AndyRussG added a comment to T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.

FRUEC currently accepts LandingPage events with no language property in the JSON input. However, if the property exists and its value is an empty string, the event is marked invalid and not counted. However, in such a case, the legacy system (DjangoBannerStats) defaults the language to 'en'.

Mon, Nov 11, 8:40 PM · Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.
Mon, Nov 11, 3:54 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions: T183978: [Epic] Fundraising kafkatee changes.
Mon, Nov 11, 3:54 PM · Fundraising-Backlog
AndyRussG created T237997: FRUEC: For legacy compatibility, empty language property should default to 'en' for LandingPage impressions.
Mon, Nov 11, 3:54 PM · Fundraising-Backlog

Fri, Nov 8

AndyRussG moved T237736: FRUEC: Raise error when timestamp not found in filename from Backlog to Review on the Fundraising Sprint Visual Basic Instinct board.
Fri, Nov 8, 3:48 PM · Fundraising Sprint A Wrinkle in Timezones, Patch-For-Review, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG renamed T237736: FRUEC: Raise error when timestamp not found in filename from FRUEC: Raise error when no timestamp in filename to FRUEC: Raise error when timestamp not found in filename.
Fri, Nov 8, 3:47 PM · Fundraising Sprint A Wrinkle in Timezones, Patch-For-Review, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG set the point value for T237736: FRUEC: Raise error when timestamp not found in filename to 1.
Fri, Nov 8, 3:47 PM · Fundraising Sprint A Wrinkle in Timezones, Patch-For-Review, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG created T237736: FRUEC: Raise error when timestamp not found in filename.
Fri, Nov 8, 3:47 PM · Fundraising Sprint A Wrinkle in Timezones, Patch-For-Review, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Wed, Nov 6

AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T237553: FRUEC: Discuss with stakeholders, Analytics and fr-tech implications and options for new Landing Page pipeline.
Wed, Nov 6, 5:48 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T237553: FRUEC: Discuss with stakeholders, Analytics and fr-tech implications and options for new Landing Page pipeline: T183978: [Epic] Fundraising kafkatee changes.
Wed, Nov 6, 5:48 PM · Fundraising-Backlog
AndyRussG updated the task description for T237553: FRUEC: Discuss with stakeholders, Analytics and fr-tech implications and options for new Landing Page pipeline.
Wed, Nov 6, 5:47 PM · Fundraising-Backlog
AndyRussG created T237553: FRUEC: Discuss with stakeholders, Analytics and fr-tech implications and options for new Landing Page pipeline.
Wed, Nov 6, 5:31 PM · Fundraising-Backlog

Mon, Nov 4

AndyRussG added a comment to T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.

Matching on landing page, country, language, and other event fields, with old log timestamps always earlier than the new log timestamps, by at most 30 seconds, we get:

Mon, Nov 4, 6:23 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a comment to T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.

Trying different options for better matching... Just a small improvement by allowing new log timestamps that are closest to the new old log ones, that is, removing the requirement that the new log event be after the old log one. With this method, we get 136 unmatched events in new log, and 510 in the old one.

Mon, Nov 4, 5:56 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG added a comment to T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.

I've dug into this some more, improving filtering compared to what was done for T235284. I've got some more clarity about what the differences are, but it's still pretty ugly.

Mon, Nov 4, 8:03 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG claimed T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.
Mon, Nov 4, 7:49 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Fri, Nov 1

AndyRussG moved T236627: CentralNotice: Adapt impression event schema for campaign fallback from Review to Deployed on the Fundraising Sprint Visual Basic Instinct board.
Fri, Nov 1, 4:35 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG added a comment to T235845: Implement banner design for WMDEs autum new editor recruitment campaign.

Okay, great, thank you for the update! @GoranSMilovanovic @Tim_WMDE Does it work now?

Fri, Nov 1, 3:30 PM · Analytics, WMDE-Analytics-Engineering, WMDE-FUN-Funban-2019, WMDE-FUN-Sprint-2019-10-14, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)

Thu, Oct 31

AndyRussG added a comment to T235845: Implement banner design for WMDEs autum new editor recruitment campaign.

Scheduled to deploy in a few minutes...

Thu, Oct 31, 6:00 PM · Analytics, WMDE-Analytics-Engineering, WMDE-FUN-Funban-2019, WMDE-FUN-Sprint-2019-10-14, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
AndyRussG added a comment to T235845: Implement banner design for WMDEs autum new editor recruitment campaign.

Great, thank you everyone! @GoranSMilovanovic Can you now get the impression data or do you need anything else?

Thu, Oct 31, 4:13 PM · Analytics, WMDE-Analytics-Engineering, WMDE-FUN-Funban-2019, WMDE-FUN-Sprint-2019-10-14, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
AndyRussG added a comment to T235845: Implement banner design for WMDEs autum new editor recruitment campaign.

Thanks so much for flagging this, and many apologies for the noise!! There's now a patch in review for T236627: CentralNotice: Adapt impression event schema for campaign fallback.

Thu, Oct 31, 3:54 PM · Analytics, WMDE-Analytics-Engineering, WMDE-FUN-Funban-2019, WMDE-FUN-Sprint-2019-10-14, WMDE-New-Editors-Banner-Campaigns (Banner Campaign Autumn 2019)
AndyRussG moved T236627: CentralNotice: Adapt impression event schema for campaign fallback from Backlog to Review on the Fundraising Sprint Visual Basic Instinct board.
Thu, Oct 31, 3:51 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG added a project to T236627: CentralNotice: Adapt impression event schema for campaign fallback: Fundraising Sprint Visual Basic Instinct.
Thu, Oct 31, 3:51 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG added a comment to T236627: CentralNotice: Adapt impression event schema for campaign fallback.

Here's a patch!!! Apologies for the trouble...!

Thu, Oct 31, 3:51 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T235284: FRUEC: Debug large discrepancy in data in initial test run. from Review to Pending Deployment on the Fundraising Sprint Visual Basic Instinct board.
Thu, Oct 31, 1:36 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Wed, Oct 30

AndyRussG moved T196563: Write a specification for mapping banner/landing page impression event properties -> database schema from Backlog to Pending Deployment on the Fundraising Sprint Visual Basic Instinct board.
Wed, Oct 30, 3:30 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Princess Mongodb, Fundraising Sprint Office  , Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines from Backlog to Doing on the Fundraising Sprint Visual Basic Instinct board.
Wed, Oct 30, 3:29 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog

Tue, Oct 29

AndyRussG moved T235284: FRUEC: Debug large discrepancy in data in initial test run. from Backlog to Review on the Fundraising Sprint Visual Basic Instinct board.
Tue, Oct 29, 9:17 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG added a comment to T234248: More small fixes needed for Campaign fallback.

Note: the second bullet point from the task description has been spun out as T236845.

Tue, Oct 29, 8:55 PM · Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG renamed T236845: Still one more small fix needed for Campaign fallback: local campaign variable. from Still one more small fixe needed for Campaign fallback: local campaign variable. to Still one more small fix needed for Campaign fallback: local campaign variable..
Tue, Oct 29, 8:54 PM · Fundraising-Backlog
AndyRussG created T236845: Still one more small fix needed for Campaign fallback: local campaign variable..
Tue, Oct 29, 8:53 PM · Fundraising-Backlog
AndyRussG moved T235284: FRUEC: Debug large discrepancy in data in initial test run. from Doing to Review on the Fundraising Sprint Usual Subscripts board.
Tue, Oct 29, 8:43 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

This task was about the large-scale discrepancy, which I think we can consider to be solved. There are still smaller unexplained differences between data we're getting from the old and new pipelines. I've created new tasks to investigate that: T236835 and T236834.

Tue, Oct 29, 7:28 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG created T236835: FRUEC: Debug minor discrepancy in landing page data between old and new pipelines.
Tue, Oct 29, 7:26 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG created T236834: FRUEC: Debug minor discrepancy in banner impression data between old and new pipelines.
Tue, Oct 29, 7:25 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising-Backlog
AndyRussG moved T234728: Andy to finish estimating old tasks from Backlog to Deployed on the Fundraising Sprint Usual Subscripts board.
Tue, Oct 29, 7:21 PM · Fundraising Sprint Usual Subscripts, Fundraising-Backlog
AndyRussG set the point value for T213915: wmf_deploy updated but not merged and deployed into .12 to 1.
Tue, Oct 29, 7:20 PM · Fundraising Sprint Bert and Ernie's Excellent Adventure, MW-1.33-notes (1.33.0-wmf.12; 2019-01-08), Fundraising Sprint A series of unfortunate event handlers, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG set the point value for T203925: Save times for changes to translation variable text in centralnotice paralysingly slow to 4.
Tue, Oct 29, 7:16 PM · Core Platform Team Workboards (Done with CPT), Performance-Team-publish, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Core Platform Team (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), Performance-Team, Fundraising Sprint Sasquatches can't find us either, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG set the point value for T195276: CentralNotice: Some URL params break EventLogging impression schema to 1.
Tue, Oct 29, 7:14 PM · Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Junebugs prefer July, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG set the point value for T185816: CentralNotice: Prevent autofill of multiple selection fields by browsers to 2.
Tue, Oct 29, 7:13 PM · Fundraising Sprint Dinosaur Cookies co-existed with Gingerbread People, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Mon, Oct 28

AndyRussG created T236734: Adapt Druid storage of CentralNotice data following campaign fallback.
Mon, Oct 28, 7:46 PM · Fundraising-Backlog
AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

I've dug deeper into the Landing Page discrepancy, comparing sequences of log entries from the same IPs in both old and new pipelines.

Mon, Oct 28, 8:49 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Sun, Oct 27

AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T236627: CentralNotice: Adapt impression event schema for campaign fallback.
Sun, Oct 27, 6:08 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T236627: CentralNotice: Adapt impression event schema for campaign fallback: T183978: [Epic] Fundraising kafkatee changes.
Sun, Oct 27, 6:08 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG created T236627: CentralNotice: Adapt impression event schema for campaign fallback.
Sun, Oct 27, 6:07 PM · Fundraising Sprint Visual Basic Instinct, MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Fri, Oct 25

AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

So actually it seems the problem is not duplicate entries in the old logs, but rather a few IP addresses hammering on the site using some sort of script, which doesn't run client-side code, so it doesn't generate any client-side events.

Fri, Oct 25, 3:06 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

Made some progress on figuring out what the difference is between old and new logs. It looks like there are a lot of duplicate entries in the old log files.

Fri, Oct 25, 6:00 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Wed, Oct 23

AndyRussG set the point value for T235284: FRUEC: Debug large discrepancy in data in initial test run. to 4.
Wed, Oct 23, 4:45 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG created T236285: CentralNotice: Adapt banner history for campaign fallback.
Wed, Oct 23, 3:29 PM · MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Wed, Oct 16

AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

Looking at LandingPage counts, it seems there is either a significant difference in the contents of the log files for the two pipelines, or how the scripts are filtering events, or both.

Wed, Oct 16, 4:32 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG moved T196563: Write a specification for mapping banner/landing page impression event properties -> database schema from Backlog to Pending Deployment on the Fundraising Sprint Usual Subscripts board.
Wed, Oct 16, 4:27 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Princess Mongodb, Fundraising Sprint Office  , Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T198752: Queries and maybe scripts to verify equivalence of data in new-Kafka-pipeline-testing and pgehres production databases from Backlog to Review on the Fundraising Sprint Usual Subscripts board.
Wed, Oct 16, 4:27 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Bert and Ernie's Excellent Adventure, Fundraising Sprint A series of unfortunate event handlers, Fundraising Sprint XML ate my homework, Fundraising Sprint Window dressing is mostly olive oil, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising-Backlog
AndyRussG moved T232859: Small fixes needed for Campaign fallback from Backlog to Pending Deployment on the Fundraising Sprint Usual Subscripts board.
Wed, Oct 16, 4:27 PM · Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T234553: exception in module-execute in module ext.centralNotice.startUp: Cannot read property 'name' of undefined / "campaign is undefined from Backlog to Pending Deployment on the Fundraising Sprint Usual Subscripts board.
Wed, Oct 16, 4:26 PM · Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG moved T235284: FRUEC: Debug large discrepancy in data in initial test run. from Backlog to Doing on the Fundraising Sprint Usual Subscripts board.
Wed, Oct 16, 4:26 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Tue, Oct 15

AndyRussG moved T232859: Small fixes needed for Campaign fallback from Review to Pending Deployment on the Fundraising Sprint Trojan Horse Wisperer board.
Tue, Oct 15, 7:54 PM · Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG renamed T235461: FRUEC: For CentralNotice impression counts, take into account client-side sample rate from FRUEC: For CentralNotice impression counts, take into account client-side sample rate. to FRUEC: For CentralNotice impression counts, take into account client-side sample rate.
Tue, Oct 15, 4:43 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising-Backlog
AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

Working on the assumption that the cause or causes of the discrepancy could be different for LandingPage events than for CentralNotice ones... It seems that the discrepancy in CentralNotice event counts can be explained by the fact that neither FRUEC nor the legacy script take into account client-side sample rate.

Tue, Oct 15, 4:39 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T235461: FRUEC: For CentralNotice impression counts, take into account client-side sample rate.
Tue, Oct 15, 4:25 AM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T235461: FRUEC: For CentralNotice impression counts, take into account client-side sample rate: T183978: [Epic] Fundraising kafkatee changes.
Tue, Oct 15, 4:25 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising-Backlog
AndyRussG created T235461: FRUEC: For CentralNotice impression counts, take into account client-side sample rate.
Tue, Oct 15, 4:25 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising-Backlog
AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

Also a large difference in log file contents for landing pages for a more recent date:

Tue, Oct 15, 12:23 AM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Mon, Oct 14

AndyRussG added a comment to T235284: FRUEC: Debug large discrepancy in data in initial test run..

There's a wide difference in the number of events in the files being consumed:

Mon, Oct 14, 5:21 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG updated the task description for T235284: FRUEC: Debug large discrepancy in data in initial test run..
Mon, Oct 14, 5:01 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG updated the task description for T235284: FRUEC: Debug large discrepancy in data in initial test run..
Mon, Oct 14, 4:56 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Oct 13 2019

AndyRussG closed T234737: FRUEC: Allow multiple files to contribute to aggregate bannerimpressions cells, a subtask of T183978: [Epic] Fundraising kafkatee changes, as Resolved.
Oct 13 2019, 11:19 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG closed T234737: FRUEC: Allow multiple files to contribute to aggregate bannerimpressions cells as Resolved.

Now deployed, seems to work!

Oct 13 2019, 11:19 PM · Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG closed T234352: FRUEC: Fixes following contact with real data, a subtask of T183978: [Epic] Fundraising kafkatee changes, as Resolved.
Oct 13 2019, 11:18 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG closed T234352: FRUEC: Fixes following contact with real data as Resolved.

Now deployed, seems to work!

Oct 13 2019, 11:18 PM · Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising-Backlog
AndyRussG moved T234352: FRUEC: Fixes following contact with real data from Pending Deployment to Deployed on the Fundraising Sprint Trojan Horse Wisperer board.
Oct 13 2019, 11:05 PM · Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, Fundraising-Backlog
AndyRussG moved T234737: FRUEC: Allow multiple files to contribute to aggregate bannerimpressions cells from Pending Deployment to Deployed on the Fundraising Sprint Trojan Horse Wisperer board.
Oct 13 2019, 11:05 PM · Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG moved T235284: FRUEC: Debug large discrepancy in data in initial test run. from Backlog to Doing on the Fundraising Sprint Trojan Horse Wisperer board.
Oct 13 2019, 11:04 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Oct 11 2019

AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T235284: FRUEC: Debug large discrepancy in data in initial test run..
Oct 11 2019, 4:30 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T235284: FRUEC: Debug large discrepancy in data in initial test run.: T183978: [Epic] Fundraising kafkatee changes.
Oct 11 2019, 4:30 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG created T235284: FRUEC: Debug large discrepancy in data in initial test run..
Oct 11 2019, 4:30 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG committed rWMFR5038f2e6faa0: Allow bannerimpressions cells from multiple files (authored by AndyRussG).
Allow bannerimpressions cells from multiple files
Oct 11 2019, 3:25 PM

Oct 10 2019

AndyRussG added a comment to T234248: More small fixes needed for Campaign fallback.

Here are some suggestions on what to smoke test for any changes to the fallback loop. You could check all the following situations, each time looking for errors in the browser console and checking the contents of mw.centralNotice.data.

Oct 10 2019, 4:41 AM · Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Oct 8 2019

AndyRussG assigned T232859: Small fixes needed for Campaign fallback to mepps.
Oct 8 2019, 6:19 PM · Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising Sprint Sysadmin Kane, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG assigned T234553: exception in module-execute in module ext.centralNotice.startUp: Cannot read property 'name' of undefined / "campaign is undefined to mepps.
Oct 8 2019, 6:16 PM · Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG closed T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL, a subtask of T183978: [Epic] Fundraising kafkatee changes, as Resolved.
Oct 8 2019, 5:12 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG closed T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL as Resolved.

I'm closing this task, as the initial work is done, and the remaining work is now tracked separately.

Oct 8 2019, 5:12 PM · Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Princess Mongodb, Fundraising Sprint Office  , Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T234969: FRUEC: Apply schema changes to pgehres database.
Oct 8 2019, 5:03 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T234969: FRUEC: Apply schema changes to pgehres database: T183978: [Epic] Fundraising kafkatee changes.
Oct 8 2019, 5:03 PM · Fundraising-Backlog
AndyRussG created T234969: FRUEC: Apply schema changes to pgehres database.
Oct 8 2019, 5:03 PM · Fundraising-Backlog
AndyRussG updated the task description for T234958: FRUEC: New SQL to modify existing pgehres database.
Oct 8 2019, 4:51 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG added a subtask for T183978: [Epic] Fundraising kafkatee changes: T234958: FRUEC: New SQL to modify existing pgehres database.
Oct 8 2019, 4:32 PM · Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a parent task for T234958: FRUEC: New SQL to modify existing pgehres database: T183978: [Epic] Fundraising kafkatee changes.
Oct 8 2019, 4:32 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG set the point value for T234958: FRUEC: New SQL to modify existing pgehres database to 1.
Oct 8 2019, 4:32 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog
AndyRussG created T234958: FRUEC: New SQL to modify existing pgehres database.
Oct 8 2019, 4:32 PM · Fundraising Sprint A Wrinkle in Timezones, Fundraising Sprint Visual Basic Instinct, Fundraising Sprint Usual Subscripts, Fundraising Sprint Trojan Horse Wisperer, Fundraising-Backlog

Oct 7 2019

AndyRussG moved T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL from Q3 (January - March) 2019-2020 to Triage on the Fundraising-Backlog board.
Oct 7 2019, 7:08 AM · Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Princess Mongodb, Fundraising Sprint Office  , Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG added a comment to T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL.

This needs updating due to this schema change: https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/FRUEC/+/541155

Oct 7 2019, 7:08 AM · Fundraising Sprint Sysadmin Kane, Fundraising Sprint Rocky Horror Presentation Layer, Fundraising Sprint Quick and the Deadlocked, Fundraising Sprint Princess Mongodb, Fundraising Sprint Office  , Fundraising Sprint Never Ending Query, Fundraising Sprint Men In Slack, Fundraising Sprint Land before Timeouts, Fundraising Sprint Vestigial tails shoot from the hip, Fundraising Sprint USB stands for underhanded socket bureaucracy, Fundraising Sprint They Live, Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog