Page MenuHomePhabricator

dvd (dvd)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Nov 27 2019, 12:22 AM (230 w, 1 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Archivedvd [ Global Accounts ]

Recent Activity

Dec 2 2019

dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.

Since we don't have the source in a public repo currently:

Dec 2 2019, 8:28 PM · User-Elukey, EventStreams, Internet-Archive, MediaWiki-extensions-WikimediaEvents, The-Wikipedia-Library
dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.

Could this be related to T179986 - another Phab task related to Python sseclient randomly hanging on the eventstreams?

Dec 2 2019, 8:13 PM · User-Elukey, EventStreams, Internet-Archive, MediaWiki-extensions-WikimediaEvents, The-Wikipedia-Library

Nov 28 2019

dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.

If you are still seeing impact it means that it was not related to connections slot being fully, since we have been stable for a while. Is there a way that you can show us a graph related to the missing events? It would help a lot in debugging.. Moreover, did you notice if you missed events or if they have just slowed down?

Nov 28 2019, 4:18 PM · User-Elukey, EventStreams, Internet-Archive, MediaWiki-extensions-WikimediaEvents, The-Wikipedia-Library

Nov 27 2019

dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.

Within the last minute or two, I just saw another burst of several thousand messages after a long pause. Now they are coming back in again at the usual rate of a few URLs per second.

Nov 27 2019, 9:31 PM · User-Elukey, EventStreams, Internet-Archive, MediaWiki-extensions-WikimediaEvents, The-Wikipedia-Library
dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.

We have a very simple Python loop around sseclient.SSEClient('https://stream.wikimedia.org/v2/stream/page-links-change'). We parse the message data JSON blob, and take any external links for changes with added_links, and put those URLs onto a Kafka topic. Starting sometime after midnight UTC on November 18th our graphs showed a significant decrease in the number of URLs put onto that Kafka topic.

Nov 27 2019, 1:01 AM · User-Elukey, EventStreams, Internet-Archive, MediaWiki-extensions-WikimediaEvents, The-Wikipedia-Library