AndyRussG (Andrew Green)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Oct 28 2014, 2:36 PM (203 w, 5 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
AGreen (WMF) [ Global Accounts ]

Recent Activity

Fri, Sep 21

AndyRussG created T205118: CentralNotice: When fetching banner settings, pull translation metadata only when necessary.
Fri, Sep 21, 4:28 PM · Fr-CentralNotice-Translation-Bugs, MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Tue, Sep 18

AndyRussG moved T178930: CentralNotice: Consolidate typical analytics queries (for example, for impression rates) into a library from Backlog to Review on the Fundraising Sprint Sasquatches can't find us either board.
Tue, Sep 18, 9:20 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Junebugs prefer July, Fundraising Sprint Ivory and eggshell white are the same color, Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol, Fundraising Sprint Gravity wasn't always this pushy, Fundraising Sprint Fhabricator is spelled with an "F", Fundraising Sprint Elevators were never intended to go down, Fundraising Sprint Dinosaur Cookies co-existed with Gingerbread People, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising Sprint Winter Wanderland, Fundraising Sprint Vaporwerewolf, Fundraising Sprint Uptight Piano, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T195594: New scripts to ingress data from Kafkatee into MySQL from Backlog to Review on the Fundraising Sprint Sasquatches can't find us either board.
Tue, Sep 18, 9:20 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog
AndyRussG moved T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL from Backlog to Review on the Fundraising Sprint Sasquatches can't find us either board.
Tue, Sep 18, 9:20 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T203925: Save times for changes to translation variable text in centralnotice paralysingly slow from Backlog to Doing on the Fundraising Sprint Sasquatches can't find us either board.
Tue, Sep 18, 9:20 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice

Mon, Sep 17

AndyRussG added a comment to T195594: New scripts to ingress data from Kafkatee into MySQL.

@Ejegg I'm seeing a patch merged here. Is this task Pending Deployment?

Mon, Sep 17, 6:29 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog

Thu, Sep 13

AndyRussG added a comment to T203669: Return to real time banner impressions in Druid.

@AndyRussG Hi! I'd like to ask you a couple of questions before starting to work on this task.. are eventlogging_CentralNoticeImpression and eventlogging_LandingPageImpression good authoritative sources for banner impression data instead of filtering webrequest logs?

Thu, Sep 13, 3:30 PM · User-Elukey, Analytics
AndyRussG added a comment to T195840: Track when a CentralNotice banner was displayed to the user in NavTiming.

@Gilles Apologies for the delay... Is it ok with you if this goes on next week's deployment train? (Also replied to your e-mail... Apologies again!!!)

Thu, Sep 13, 2:53 PM · Wikimedia-Fundraising, MediaWiki-extensions-NavigationTiming, Performance-Team

Wed, Sep 12

AndyRussG added a comment to T203925: Save times for changes to translation variable text in centralnotice paralysingly slow.

Hi! Some notes here:

  • As far as I can tell, by requesting that CentralNotice administrators refrain from creating or editing banners with translatable messages, we're preventing any affectation of cluster performance due to the specific problem described in this bug (incredibly slow save times for banners with translatable messages).
  • Nonetheless, we do need a careful review of CentralNotice-Translate interaction, to improve performance and code sanity in general, which includes this specific bug.
  • The option suggested by @Nikerabbit is the immediate action we're pursuing, though that should also not be deployed until we're clear about its impact on all bits and pieces of this complex system.
  • @Krenair, indeed we wouldn't disable CN-Translate integration without looking carefully at the impact, and, also, that doesn't look like the right option at this point :)
Wed, Sep 12, 3:01 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice

Tue, Sep 11

AndyRussG added a comment to T203925: Save times for changes to translation variable text in centralnotice paralysingly slow.

While checking callers of TranslateMetadata I found this code: https://gerrit.wikimedia.org/g/mediawiki/extensions/CentralNotice/+/e8f750a205e1ae61d694d6360c050bff724e7d03/includes/Banner.php#1008

It seems to be running MessageIndexRebuildJob during the request! This should happen in the JobQueue. No wonder saving will take a long time if this is indeed the case.

It also calls MessageGroups::clearCache while MessageGroups::recache is preferred to avoid multiple threads hurrying to rebuild the deleted cache.

Tue, Sep 11, 6:12 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG added a comment to T203925: Save times for changes to translation variable text in centralnotice paralysingly slow.

@jcrespo @Nikerabbit Thanks!!! I think we could potentially look at disabling CentralNotice-Translate integration as a measure of last resort. (Note that we have asked CentralNotice administrators to not use translatable messages in banners for now, also.)

Tue, Sep 11, 12:27 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice

Mon, Sep 10

AndyRussG added a comment to T203925: Save times for changes to translation variable text in centralnotice paralysingly slow.

Just to note, though the general slow-to-save banner issue is important, that problem, as far as I can tell, has a different cause from very-very-slow-to-save problem with banners containing translatable messages...

Mon, Sep 10, 7:35 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG added a comment to T203925: Save times for changes to translation variable text in centralnotice paralysingly slow.

Could this be related to T195293 ?

Mon, Sep 10, 7:26 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG added a project to T203925: Save times for changes to translation variable text in centralnotice paralysingly slow: MediaWiki-Database.
Mon, Sep 10, 2:53 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG added a comment to T203925: Save times for changes to translation variable text in centralnotice paralysingly slow.

Hi! Looked at this quickly:

  • This does not seem to be affecting banner displays, as far as I can see.
  • There are a lot of Database warnings related to translatable messages.
Mon, Sep 10, 2:52 PM · Fundraising Sprint Sasquatches can't find us either, Performance-Team (Radar), Patch-For-Review, Language-Team, Fundraising Sprint Raw data can give you salmonella, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice

Thu, Sep 6

AndyRussG committed rWMFRa59621927188: Minor improvements in create_tables.sql (authored by AndyRussG).
Minor improvements in create_tables.sql
Thu, Sep 6, 7:21 PM
AndyRussG committed rWMFR73c31d9fdacb: Inline doc and comments (authored by AndyRussG).
Inline doc and comments
Thu, Sep 6, 7:12 PM
AndyRussG moved T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL from Doing to Review on the Fundraising Sprint Raw data can give you salmonella board.
Thu, Sep 6, 3:30 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG added a comment to T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL.

Tested the update script locally--works so far!

Thu, Sep 6, 3:26 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog

Wed, Sep 5

AndyRussG committed rWMFRfe75b131890f: Inline doc and comments (authored by AndyRussG).
Inline doc and comments
Wed, Sep 5, 4:39 PM
AndyRussG added a comment to T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL.

So, the SQL to create the testing database should just be whatever's in sql/create_tables.sql in FRUEC.

Wed, Sep 5, 1:58 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG added a comment to T203142: [FundraisingLandingPage] should not double escape.

Hi! Thanks much for finding this cruft!!!

Wed, Sep 5, 3:27 AM · Technical-Debt, Fundraising-Backlog
AndyRussG moved T196563: Write a specification for mapping banner/landing page impression event properties -> database schema from Backlog to Doing on the Fundraising Sprint Raw data can give you salmonella board.
Wed, Sep 5, 1:55 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL from Backlog to Doing on the Fundraising Sprint Raw data can give you salmonella board.
Wed, Sep 5, 1:54 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T195594: New scripts to ingress data from Kafkatee into MySQL from Backlog to Review on the Fundraising Sprint Raw data can give you salmonella board.
Wed, Sep 5, 1:54 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog
AndyRussG moved T178930: CentralNotice: Consolidate typical analytics queries (for example, for impression rates) into a library from Backlog to Review on the Fundraising Sprint Raw data can give you salmonella board.
Wed, Sep 5, 1:53 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Junebugs prefer July, Fundraising Sprint Ivory and eggshell white are the same color, Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol, Fundraising Sprint Gravity wasn't always this pushy, Fundraising Sprint Fhabricator is spelled with an "F", Fundraising Sprint Elevators were never intended to go down, Fundraising Sprint Dinosaur Cookies co-existed with Gingerbread People, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising Sprint Winter Wanderland, Fundraising Sprint Vaporwerewolf, Fundraising Sprint Uptight Piano, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T203499: Update EventLogging schema for CentralNotice from Doing to Backlog on the Fundraising Sprint Raw data can give you salmonella board.
Wed, Sep 5, 1:52 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Epic, Fundraising-Backlog
AndyRussG moved T203499: Update EventLogging schema for CentralNotice from Backlog to Doing on the Fundraising Sprint Raw data can give you salmonella board.
Wed, Sep 5, 1:52 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Epic, Fundraising-Backlog

Tue, Sep 4

AndyRussG added a comment to T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL.

Updated SQL to create the testing database, as per

Tue, Sep 4, 8:11 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T196563: Write a specification for mapping banner/landing page impression event properties -> database schema from Backlog to Doing on the Fundraising Sprint Queue is pronounced GJif board.
Tue, Sep 4, 7:53 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG moved T196564: DB schemas (production changes and test DB) and SQL commands to run for new banner and LP impression data from EL from Backlog to Doing on the Fundraising Sprint Queue is pronounced GJif board.
Tue, Sep 4, 7:53 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising-Backlog
AndyRussG triaged T203501: Investigate missing country and language fields on LandingPage events. as Normal priority.
Tue, Sep 4, 7:52 PM · Epic, Fundraising-Backlog
AndyRussG triaged T203499: Update EventLogging schema for CentralNotice as Normal priority.
Tue, Sep 4, 7:45 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Epic, Fundraising-Backlog
AndyRussG committed rWMFR86811bb55da7: Inline doc and comments (authored by AndyRussG).
Inline doc and comments
Tue, Sep 4, 7:35 PM
AndyRussG moved T195594: New scripts to ingress data from Kafkatee into MySQL from Doing to Review on the Fundraising Sprint Queue is pronounced GJif board.
Tue, Sep 4, 7:31 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog

Mon, Sep 3

AndyRussG committed rWMFR58ccf4de7602: [WIP] Inline doc and comments (authored by AndyRussG).
[WIP] Inline doc and comments
Mon, Sep 3, 10:02 PM
AndyRussG committed rWMFRbf97bd17c9b4: Flag SQL template constants as private (authored by AndyRussG).
Flag SQL template constants as private
Mon, Sep 3, 10:02 PM
AndyRussG committed rWMFR7c26a52a8a01: [WIP] Inline doc and comments (authored by AndyRussG).
[WIP] Inline doc and comments
Mon, Sep 3, 4:39 AM
AndyRussG committed rWMFR31123b2bdc26: Add event_type arg to log_file_mapper.get_lastest_time() (authored by AndyRussG).
Add event_type arg to log_file_mapper.get_lastest_time()
Mon, Sep 3, 4:31 AM

Sun, Sep 2

AndyRussG committed rWMFR2379579205c0: Rename package fr_user_event_consumer -> fruec (authored by AndyRussG).
Rename package fr_user_event_consumer -> fruec
Sun, Sep 2, 2:44 PM
AndyRussG committed rWMFRec426f4db0c3: Implement purge-incomplete for landingpage and output stats (authored by AndyRussG).
Implement purge-incomplete for landingpage and output stats
Sun, Sep 2, 2:19 PM

Sat, Sep 1

AndyRussG committed rWMFR03d24d09e2b8: Print a friendly message confirming config (authored by AndyRussG).
Print a friendly message confirming config
Sat, Sep 1, 5:48 PM

Fri, Aug 31

AndyRussG committed rWMFR34d4182c2d84: Print a friendly message confirming config (authored by AndyRussG).
Print a friendly message confirming config
Fri, Aug 31, 11:54 PM
AndyRussG committed rWMFR5d32610e153f: Print a friendly message confirming config (authored by AndyRussG).
Print a friendly message confirming config
Fri, Aug 31, 6:51 PM
AndyRussG committed rWMFR137432d63e62: Refactor stats output (authored by AndyRussG).
Refactor stats output
Fri, Aug 31, 6:27 PM
AndyRussG committed rWMFR3e4959b9d2d6: Refactor stats output (authored by AndyRussG).
Refactor stats output
Fri, Aug 31, 6:05 PM
AndyRussG committed rWMFRf087245f008f: Truncate strings to DB column limit (authored by AndyRussG).
Truncate strings to DB column limit
Fri, Aug 31, 6:01 PM
AndyRussG committed rWMFRb002a1a78aa4: Truncate strings to DB column limit (authored by AndyRussG).
Truncate strings to DB column limit
Fri, Aug 31, 6:01 PM
AndyRussG committed rWMFR38883f02e7b8: Add landingpage event processing (authored by AndyRussG).
Add landingpage event processing
Fri, Aug 31, 5:51 PM
AndyRussG committed rWMFR549811d4db5c: Add LandingPage test data (authored by AndyRussG).
Add LandingPage test data
Fri, Aug 31, 5:45 PM
AndyRussG committed rWMFR5595e8bcca33: Refactor stats output (authored by AndyRussG).
Refactor stats output
Fri, Aug 31, 5:05 PM

Thu, Aug 30

AndyRussG committed rWMFRe8e47806cc52: Truncate strings to DB column limit (authored by AndyRussG).
Truncate strings to DB column limit
Thu, Aug 30, 8:00 PM
AndyRussG committed rWMFR0e0086aee60d: Add landingpage event processing (authored by AndyRussG).
Add landingpage event processing
Thu, Aug 30, 4:20 PM

Wed, Aug 29

AndyRussG committed rWMFR0f073a915bb3: WIP Add landingpage event processing (authored by AndyRussG).
WIP Add landingpage event processing
Wed, Aug 29, 7:35 PM

Tue, Aug 28

AndyRussG renamed T203021: FRUEC: Implement a command to check validity of events in a file, without touching the DB from FRUEC: Implement a command to validity of events in a file, without touching the DB to FRUEC: Implement a command to check validity of events in a file, without touching the DB.
Tue, Aug 28, 8:20 PM · Epic, Fundraising-Backlog
AndyRussG renamed T203021: FRUEC: Implement a command to check validity of events in a file, without touching the DB from FUEC: Implement a command to validity of events in a file, without touching the DB to FRUEC: Implement a command to validity of events in a file, without touching the DB.
Tue, Aug 28, 8:20 PM · Epic, Fundraising-Backlog
AndyRussG triaged T203021: FRUEC: Implement a command to check validity of events in a file, without touching the DB as Normal priority.
Tue, Aug 28, 7:38 PM · Epic, Fundraising-Backlog
AndyRussG triaged T203020: Turn off LandingPage events from testwiki as Normal priority.
Tue, Aug 28, 7:35 PM · Epic, Fundraising-Backlog
AndyRussG committed rWMFR86f346f326d5: WIP Add landingpage event processing (authored by AndyRussG).
WIP Add landingpage event processing
Tue, Aug 28, 7:32 PM
AndyRussG committed rWMFRdaf0be06708b: WIP Add landingpage event processing (authored by AndyRussG).
WIP Add landingpage event processing
Tue, Aug 28, 5:39 PM
AndyRussG committed rWMFR14c716ed3ec4: WIP Add landingpage event processing (authored by AndyRussG).
WIP Add landingpage event processing
Tue, Aug 28, 5:30 PM
AndyRussG updated subscribers of T202244: CentralNotice provides a means for non interface-admins to bypass new CSS/JS restrictions.

@matmarex @Tgr Interesting! Well, if permission changes are pretty easy and not a risk to CentralNotice infrastructure ahead of the year-end fundraising campaigns, I'm ok with it!!! Moving CN pages out of the Mediawiki namespace is probably eventually a good idea (for previous discussions, see T33595 and this RFC). And, in general, the CentralNotice backend and administration interface need quite a lot of reworking--it has to be carefully planned and executed, though.

Tue, Aug 28, 1:46 PM · Fr-CentralNotice-translations, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Trust-and-Safety, Security, JavaScript, Security-Core

Mon, Aug 27

AndyRussG added a comment to T202244: CentralNotice provides a means for non interface-admins to bypass new CSS/JS restrictions.

Hi! Just a few notes here:

  • Inline JS is used quite a lot in CentralNotice banners, for both community and Fundraising campaigns. However, many campaigns don't really need it.
  • The reason Meta Admins can edit CentralNotice banners is that banners are stored as Mediawiki namespace pages. So, anyone with the ability to edit interface messages (i.e. Admins) can edit banners.
Mon, Aug 27, 7:41 PM · Fr-CentralNotice-translations, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, Trust-and-Safety, Security, JavaScript, Security-Core
AndyRussG moved T104774: Publishing translations for central notice banners fails from Sprint +3 to Analysis on the Fundraising-Backlog board.
Mon, Aug 27, 7:16 PM · Fr-CentralNotice-Translation-Bugs, Operations, Fundraising Sprint Snoop (Dogg|Lion), Fundraising Sprint ODB, Fundraising Sprint N*E*R*D, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, MediaWiki-extensions-Translate
AndyRussG moved T72939: CentralNotice reloads old translatable messages on form submit from Sprint +3 to Analysis on the Fundraising-Backlog board.
Mon, Aug 27, 7:13 PM · Fr-CentralNotice-Translation-Bugs, Fundraising-Backlog, Easy, I18n, MediaWiki-extensions-CentralNotice
AndyRussG moved T158261: CentralNotice: Occasional unexplained missing banner messages from Q4 (April-June) 2017-18 to Analysis on the Fundraising-Backlog board.
Mon, Aug 27, 7:06 PM · Fr-CentralNotice-Caching, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T90863: BUG: CentralNotice banner translations sometimes go missing from Translate interface from FY 2017-18 to Analysis on the Fundraising-Backlog board.
Mon, Aug 27, 7:03 PM · Fr-CentralNotice-Translation-Bugs, MediaWiki-extensions-Translate, Fundraising-Backlog, MediaWiki-extensions-CentralNotice
AndyRussG moved T111189: Central Notice message groups are slow to index from Blocked & not fr-tech to Analysis on the Fundraising-Backlog board.
Mon, Aug 27, 7:02 PM · Fr-CentralNotice-Translation-Bugs, Fundraising-Backlog, Fundraising Sprint Snoop (Dogg|Lion), MediaWiki-extensions-Translate, MediaWiki-extensions-CentralNotice
AndyRussG moved T158084: Mediawiki namespace pages, including CentralNotice banners, are slow to save from Blocked & not fr-tech to Analysis on the Fundraising-Backlog board.
Mon, Aug 27, 7:01 PM · Performance-Team (Radar), MediaWiki-Cache, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG added a comment to T201422: Wikimedia Foundation website includes Wordpress tracking pixel.

It looks like there is tracking of all navigation to external sites with this. For example, when I clicked on "Donate Now", the following request was sent:
https://pixel.wp.com/c.gif?s=2&u=https%3A%2F%2Fdonate.wikimedia.org%2F&r=&b=147851870&p=10&rand=0.17689332155574422

Mon, Aug 27, 6:50 PM · Privacy, Fundraising-Backlog, wikimediafoundation.org

Fri, Aug 24

AndyRussG added a comment to T201623: Test data for new scripts to ingress data from Kafkatee into MySQL.

There's now (in review) some basic test data for both CentralNotice and LandingPage events. However, at least the CN data should be need to be more varied. Also, for CN, the filenames should be changed to match those currently used on the cluster. Thanks!!!

Fri, Aug 24, 6:04 PM · Epic, Fundraising-Backlog

Aug 24 2018

AndyRussG committed rWMFR807548b96d95: Add LandingPage test data (authored by AndyRussG).
Add LandingPage test data
Aug 24 2018, 3:57 PM

Aug 22 2018

AndyRussG moved T178930: CentralNotice: Consolidate typical analytics queries (for example, for impression rates) into a library from Backlog to Review on the Fundraising Sprint Queue is pronounced GJif board.
Aug 22 2018, 1:54 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Junebugs prefer July, Fundraising Sprint Ivory and eggshell white are the same color, Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol, Fundraising Sprint Gravity wasn't always this pushy, Fundraising Sprint Fhabricator is spelled with an "F", Fundraising Sprint Elevators were never intended to go down, Fundraising Sprint Dinosaur Cookies co-existed with Gingerbread People, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising Sprint Winter Wanderland, Fundraising Sprint Vaporwerewolf, Fundraising Sprint Uptight Piano, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T195594: New scripts to ingress data from Kafkatee into MySQL from Backlog to Doing on the Fundraising Sprint Queue is pronounced GJif board.
Aug 22 2018, 1:54 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog

Aug 21 2018

AndyRussG added a project to T202372: Add phan-taint-check-plugin to CentralNotice extension: Fundraising-Backlog.
Aug 21 2018, 8:25 PM · Patch-For-Review, Fundraising-Backlog, MediaWiki-extensions-CentralNotice, phan-taint-check-plugin

Aug 20 2018

AndyRussG added a comment to T197602: Create job to deliver the eventlogging_LandingPageImpression topic.

I think perhaps this is all done? (As per comment on merged-in task, the log files are getting written as needed, thx much!!!)

Aug 20 2018, 4:30 PM · fundraising-tech-ops, Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG merged task T200449: Create job to deliver the eventlogging_LandingPageImpression topic into T197602: Create job to deliver the eventlogging_LandingPageImpression topic.
Aug 20 2018, 4:29 PM · fundraising-tech-ops, Epic, Fundraising-Backlog
AndyRussG merged T200449: Create job to deliver the eventlogging_LandingPageImpression topic into T197602: Create job to deliver the eventlogging_LandingPageImpression topic.
Aug 20 2018, 4:29 PM · fundraising-tech-ops, Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a comment to T200449: Create job to deliver the eventlogging_LandingPageImpression topic.

@Jgreen yeah looks great! Apologies for the delay in checking this out :) Thx much!!!!!

Aug 20 2018, 4:28 PM · fundraising-tech-ops, Epic, Fundraising-Backlog
AndyRussG added a comment to T200853: Banner previews occasionally fail to load.
errorMsg"Banner message key Centralnotice-template-spatton_dsk_sm_optin_pponly could not be found in en"
Aug 20 2018, 3:18 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG added a comment to T200853: Banner previews occasionally fail to load.

A first glance at the error logs shows a spike in "Banner message key" warnings during the first week in August. This would likely point to a problem with i18n caching. There's still a lot more digging to do, though... :)

Aug 20 2018, 3:08 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG claimed T200853: Banner previews occasionally fail to load.
Aug 20 2018, 3:59 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T200853: Banner previews occasionally fail to load from Backlog to Doing on the Fundraising Sprint Pluto is still a planet board.
Aug 20 2018, 3:59 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Aug 17 2018

Krinkle awarded T187207: Spin out a tiny EventLogging RL module for lightweight logging a Orange Medal token.
Aug 17 2018, 1:29 AM · Patch-For-Review, Analytics-Kanban, Performance-Team (Radar), Analytics-EventLogging, Analytics

Aug 13 2018

AndyRussG added a comment to T198752: Queries and maybe scripts to verify equivalence of data in new-Kafka-pipeline-testing and pgehres production databases.

Location of the log files to be consumed into the database in the new system: alnitak:/srv/banner_logs/2018/. (There's a lot in that directory... To find some, try: ls /srv/banner_logs/2018/ | grep -v beacon | tail -n 10

Aug 13 2018, 9:54 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising-Backlog
AndyRussG added a comment to T200853: Banner previews occasionally fail to load.

Fantastic, thanks @Pcoombe!!!

Aug 13 2018, 3:19 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Aug 10 2018

AndyRussG added a comment to T195594: New scripts to ingress data from Kafkatee into MySQL.

Temporary repo: https://github.com/AndrewGreen/fr_user_event_consumer
Notes: https://etherpad.wikimedia.org/p/fr_user_event_consumer_notes

Aug 10 2018, 8:53 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog
AndyRussG added a comment to T198752: Queries and maybe scripts to verify equivalence of data in new-Kafka-pipeline-testing and pgehres production databases.

Hey Andy, could we chat about this when convenient?

Aug 10 2018, 3:22 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising-Backlog

Aug 9 2018

AndyRussG triaged T201623: Test data for new scripts to ingress data from Kafkatee into MySQL as Normal priority.
Aug 9 2018, 4:10 PM · Epic, Fundraising-Backlog
AndyRussG moved T178930: CentralNotice: Consolidate typical analytics queries (for example, for impression rates) into a library from Backlog to Review on the Fundraising Sprint Pluto is still a planet board.
Aug 9 2018, 3:54 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Junebugs prefer July, Fundraising Sprint Ivory and eggshell white are the same color, Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol, Fundraising Sprint Gravity wasn't always this pushy, Fundraising Sprint Fhabricator is spelled with an "F", Fundraising Sprint Elevators were never intended to go down, Fundraising Sprint Dinosaur Cookies co-existed with Gingerbread People, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising Sprint Winter Wanderland, Fundraising Sprint Vaporwerewolf, Fundraising Sprint Uptight Piano, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T195594: New scripts to ingress data from Kafkatee into MySQL from Backlog to Doing on the Fundraising Sprint Pluto is still a planet board.
Aug 9 2018, 3:54 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog

Aug 2 2018

AndyRussG added a comment to T200853: Banner previews occasionally fail to load.

@Pcoombe ok thanks that's an important detail!

Aug 2 2018, 12:21 AM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, MediaWiki-extensions-CentralNotice, Fundraising-Backlog

Aug 1 2018

AndyRussG added a comment to T200449: Create job to deliver the eventlogging_LandingPageImpression topic.

duplicate of T197602 ?

Aug 1 2018, 3:53 PM · fundraising-tech-ops, Epic, Fundraising-Backlog

Jul 30 2018

AndyRussG created T200721: pgehres: Remove unused columns.
Jul 30 2018, 7:40 PM · Fundraising-Backlog

Jul 26 2018

AndyRussG added a comment to T189820: Create job to deliver the eventlogging_CentralNoticeImpression topic.

I'm not 100% sure how kafkatee does sampling, but I bet you it just filters for every Nth message. E.g. 1/100 would get you every 100th message.

Jul 26 2018, 4:56 PM · fundraising-tech-ops, Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG triaged T200449: Create job to deliver the eventlogging_LandingPageImpression topic as Normal priority.
Jul 26 2018, 4:51 PM · fundraising-tech-ops, Epic, Fundraising-Backlog
AndyRussG added a comment to T189820: Create job to deliver the eventlogging_CentralNoticeImpression topic.

A few notes from discussions on IRC...

Jul 26 2018, 4:20 PM · fundraising-tech-ops, Epic, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising-Backlog
AndyRussG added a comment to T199399: Document the new Kafka EventLogging -> MariaDB pipelines.

Part of this should be to update or remove and archive oudated documentation about DjangoBannerStats and other bits of the pipeline that have changed. Here are a few bits that I found (though there may well be more):

Jul 26 2018, 3:36 PM · Fundraising-Backlog

Jul 24 2018

AndyRussG moved T178930: CentralNotice: Consolidate typical analytics queries (for example, for impression rates) into a library from Backlog to Review on the Fundraising Sprint Owls board.
Jul 24 2018, 8:36 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising Sprint Junebugs prefer July, Fundraising Sprint Ivory and eggshell white are the same color, Fundraising Sprint HTTP originally stood for Happy Turtle Transfer Protocol, Fundraising Sprint Gravity wasn't always this pushy, Fundraising Sprint Fhabricator is spelled with an "F", Fundraising Sprint Elevators were never intended to go down, Fundraising Sprint Dinosaur Cookies co-existed with Gingerbread People, Fundraising Sprint Cottage Cheese isn't Made of Cottages, Fundraising Sprint Bermuda Rhombus (where things disappear then reappear), Fundraising Sprint Asymmetrical Earth Theory, Fundraising Sprint Winter Wanderland, Fundraising Sprint Vaporwerewolf, Fundraising Sprint Uptight Piano, MediaWiki-extensions-CentralNotice, Fundraising-Backlog
AndyRussG moved T195594: New scripts to ingress data from Kafkatee into MySQL from Backlog to Doing on the Fundraising Sprint Owls board.
Jul 24 2018, 8:36 PM · Fundraising Sprint Sasquatches can't find us either, Fundraising Sprint Raw data can give you salmonella, Patch-For-Review, Fundraising Sprint Queue is pronounced GJif, Fundraising Sprint Pluto is still a planet, Fundraising Sprint Owls, Fundraising Sprint Naming Sprints Is Not Important, Fundraising Sprint Matt Damon to head up Space Force, Fundraising Sprint Lactose is unusually tolerant, Fundraising Sprint Karma chameleons hide amongst us, Fundraising-Backlog