User Details
User Details
- User Since
- Nov 27 2019, 12:22 AM (230 w, 1 d)
- Availability
- Available
- LDAP User
- Unknown
- MediaWiki User
- Archivedvd [ Global Accounts ]
Dec 2 2019
Dec 2 2019
dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.
Since we don't have the source in a public repo currently:
dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.
Nov 28 2019
Nov 28 2019
dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.
Nov 27 2019
Nov 27 2019
dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.
Within the last minute or two, I just saw another burst of several thousand messages after a long pause. Now they are coming back in again at the usual rate of a few URLs per second.
dvd added a comment to T239220: page-links-change EventStream doesn't appear to be outputting events.
We have a very simple Python loop around sseclient.SSEClient('https://stream.wikimedia.org/v2/stream/page-links-change'). We parse the message data JSON blob, and take any external links for changes with added_links, and put those URLs onto a Kafka topic. Starting sometime after midnight UTC on November 18th our graphs showed a significant decrease in the number of URLs put onto that Kafka topic.