⚓ T156919 Port RCStream clients to EventStreams

Status	Assigned	Task
Declined	Xqt	T125197 Give hint to the current socketIO_client in ImportError of rcstream.py
Declined	None	T91393 RCStream is not accessible from python client due to using socket-io 1.0 while only socket-io 0.9 is offered
Declined	None	T68232 Upgrade RCStream backend to use socket.io 1.0 protocol
Resolved	Ottomata	T130651 EventStreams
Resolved	Ottomata	T156919 Port RCStream clients to EventStreams
Resolved	Xqt	T158943 Implement EventStreams client for pywikibot
Duplicate	None	T160997 Migrate pywikibot from RCStream to EventStreams
Resolved	• Cmjohnson	T170157 decommission rcs100[12]
Resolved	Xqt	T170534 Decommission RCStream in pywikibot framework

Ottomata created this task.Feb 1 2017, 3:24 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 1 2017, 3:24 PM

Ottomata updated the task description. (Show Details)Feb 1 2017, 9:50 PM

Ottomata updated the task description. (Show Details)Feb 1 2017, 10:05 PM

Ottomata updated the task description. (Show Details)Feb 1 2017, 10:14 PM

Ottomata updated the task description. (Show Details)

Milimetric moved this task from Incoming to Backlog (Later) on the Analytics board.Feb 2 2017, 5:15 PM

elukey subscribed.Feb 6 2017, 4:14 PM

I know a chunk of our rcstream traffic that I've observed in the past came from Google. I'm not sure who/what in Google drives that...

From Google?! :o

Ottomata updated the task description. (Show Details)Feb 6 2017, 10:29 PM

Ottomata updated the task description. (Show Details)Feb 8 2017, 5:50 PM

Milimetric edited projects, added Analytics-Kanban; removed Analytics.Feb 9 2017, 5:11 PM

Milimetric moved this task from Next Up to Parent Tasks on the Analytics-Kanban board.

tom29739 subscribed.Feb 22 2017, 10:13 PM

Ricordisamoa subscribed.Feb 23 2017, 11:13 PM

zhuyifei1999 subscribed.Feb 24 2017, 1:23 AM

Xqt added a subtask: T158943: Implement EventStreams client for pywikibot.Feb 24 2017, 5:52 AM

Ottomata updated the task description. (Show Details)Mar 21 2017, 1:59 PM

Ottomata added a subtask: T160997: Migrate pywikibot from RCStream to EventStreams.Mar 21 2017, 2:11 PM

@Halfak, does Huggle use irc.wikimedia.org, not RCStream?

Ottomata closed subtask T160997: Migrate pywikibot from RCStream to EventStreams as Declined.Mar 21 2017, 2:28 PM

Ottomata updated the task description. (Show Details)

@Petrb ^

Ottomata updated the task description. (Show Details)Mar 21 2017, 6:21 PM

Ottomata updated the task description. (Show Details)Mar 21 2017, 6:23 PM

Ottomata updated the task description. (Show Details)Mar 21 2017, 6:27 PM

Krinkle updated the task description. (Show Details)Mar 21 2017, 8:32 PM

Krinkle updated the task description. (Show Details)Mar 21 2017, 9:11 PM

Ottomata updated the task description. (Show Details)Mar 22 2017, 1:17 PM

Ottomata updated the task description. (Show Details)Mar 28 2017, 2:14 PM

Ottomata mentioned this in T158943: Implement EventStreams client for pywikibot.Mar 29 2017, 1:37 PM

Xqt closed subtask T158943: Implement EventStreams client for pywikibot as Resolved.Jun 11 2017, 2:48 PM

Xqt updated the task description. (Show Details)

Just a reminder that we will be shutting off RCStream after July 7th.

Krinkle updated the task description. (Show Details)Jun 22 2017, 8:27 PM

Krinkle moved this task from Backlog to Backlog-RCStream on the EventStreams board.Jun 22 2017, 8:34 PM

Krinkle mentioned this in T86771: RCStream should remember subscriptions after socket.io re-connects.Jun 22 2017, 8:36 PM

Krinkle mentioned this in T106636: Verify that health check from rcstream load balancer actually fails if Redis backend is unavailable .

Krinkle mentioned this in T126313: occasional 502 from rcstream seen by pybal.

Krinkle mentioned this in T116721: RCStream: Investigate source of invalid JSON data.

For Google, that probably comes from a time we provided them a stream of updates using OAI. There were several users of that service which we phased out end of 2013/early 2014 iirc. Users were instructed to use RCStream or consuming the MediaWiki API directly.

Whatever Google uses it for, we most probably should reach out to them. Maybe @Reedy would remember.

See @BBlack note
" in https://phabricator.wikimedia.org/T168919 I was looking at RCStream's traffic, it's still in the ballpark of ~2-3 reqs/sec averaged over a day (~200-250K reqs/day), mostly from google exit IPs and amazon instances it looks like"

BBlack added a parent task: T168919: stream.wikimedia.org: remove legacy rcstream/socket.io HTTPS redirect hole punches.Jun 27 2017, 5:59 PM

fgiunchedi mentioned this in T129153: Deploy rcstream with scap3.Jul 3 2017, 5:13 PM

Aklapper updated the task description. (Show Details)Jul 4 2017, 6:39 AM

Aklapper mentioned this in T153773: rcstream service - gevent dependency incompatibility.Jul 7 2017, 3:35 PM

Aklapper mentioned this in T153772: Upstream prematurely closed connection.

Aklapper mentioned this in T153770: Error on RCStream server startup for the "flash policy server".

Ottomata updated the task description. (Show Details)Jul 10 2017, 2:00 PM

Ottomata created subtask T170157: decommission rcs100[12].Jul 10 2017, 2:52 PM

Ottomata updated the task description. (Show Details)Jul 10 2017, 6:05 PM

Ottomata moved this task from Parent Tasks to Done on the Analytics-Kanban board.Jul 10 2017, 6:07 PM

Kenrick95 updated the task description. (Show Details)Jul 11 2017, 12:01 AM

Kenrick95 subscribed.