Page MenuHomePhabricator
Create Task
Maniphest T334

Document RCStream in the Developer Hub
Closed, ResolvedPublic
Actions

Description

Other doc changes:

Some developers believe we will be deprecating the IRC recent changes feed in favor of this, but I could not find a phab task for that yet at Wikimedia-IRC-RC-Server except T87780: Add notice about rcstream to IRC RC motd.

Details

Reference
fl519
ReferenceSource BranchDest BranchAuthorTitle
repos/cloud/toolforge/toolforge-deploy!72add_protocol_to_harbor_repository_urlmainraymond-ndibe[builds-api]: add protocol to harborRepository url
repos/sre/miscweb/wikiworkshop!1add-cimasterjeltoadd ci for wikiworkshop image build
repos/sre/miscweb/research-landing-page!1add-cimasterjeltoadd ci for research-landing-page image build
repos/releng/gitlab-trusted-runner!40add-research-pagesmainjeltoadd research miscweb sites to Trusted Runners
repos/cloud/toolforge/toolforge-deploy!69builds_api_add_secretsmaindcarobuilds-api: add harbor user and password
repos/cloud/toolforge/registry-admission!1move_to_ci_flowsmasterdcarodeploy: Moved to standard ci flows
repos/cloud/toolforge/builds-cli!1bug_fixmainraymond-ndibetoolforge-builds-cli: minor bug fixes and refactor
repos/cloud/toolforge/toolforge-cli!7remove_build_subcommand_from_the_climainraymond-ndibetoolforge-cli: remove build subcommand from cli
repos/releng/scap!148backports_refactormasterjhuneidiscap backport: major refactor
repos/abstract-wiki/aw-e2e!4kr/autoscale-after-testmainkindrobotTurn off autoscale after tests are finished
repos/abstract-wiki/aw-e2e!3kr/no-more-lies-autoscalemainkindrobotBump aw-ci-chart
repos/abstract-wiki/aw-ci-chart!18kr/http-autoscalemainkindrobotAdd option to automatically scale to 0 when there's no web traffic
repos/abstract-wiki/wikifunctions/function-evaluator!14kr/env-portmainkindrobotAllow port to be set by environment variable
repos/abstract-wiki/wikifunctions/function-evaluator!12sync-function-schematamainjforresterUpdate function-schemata sub-module to HEAD (7ad8a56)
repos/structured-data/image-suggestions!30T334293mainmfossatiInclude section index and page QID in the output dataset
repos/structured-data/image-suggestions!29T334296mainmlitnUse suffix allowlist instead of denylist
repos/structured-data/section-image-recs!6T334293mainmfossatiInclude section index in the output
repos/cloud/toolforge/maintain-harbor!7add_tool-prefixmasterraymond-ndibemaintain-harbor: add a `tool-` prefix to harbor namespaces
repos/data-engineering/airflow-dags!367migrate-druid-load-virtualpageviewmainmilimetricAdd druid loading jobs for virtualpageview_hourly
repos/abstract-wiki/wikifunctions/function-orchestrator!8sync-function-schematamainjforresterUpdate function-schemata sub-module to HEAD (21f0e63)
Show related patches Customize query in GitLab

Related Objects
Search...

Event Timeline

• flimport raised the priority of this task from to Medium.Sep 12 2014, 1:44 AM
• flimport added a project: Web-APIs-Hub.
• flimport set Reference to fl519.

brainwane wrote on 2014-08-05 22:09:37 (UTC)

So a few notes:

change the code in https://wikitech.wikimedia.org/wiki/RCStream#Python , because the labs stream works right now and stream.wikimedia.org doesn't really and gives a 502:

Merlijn: "aggressively retrying works, but it's still annoying. The labs one is more stable -- see https://bugzilla.wikimedia.org/show_bug.cgi?id=66989 "

 class WikiNamespace(socketIO_client.BaseNamespace):
     def on_change(self, change):
         print '%(user)s edited %(title)s' % change
  
      def on_connect(self):
          self.emit('subscribe', '*')

s = socketIO_client.SocketIO('stream.wmflabs.org', 80)
s.define(WikiNamespace, '/')
s.wait()

And it still does not quite work because:

<sumanah> ok, so, ori, I'm now in the situation where I've subscribed to '*', I made another edit on en.wikipedia.beta.wmflabs.org , and my socketIO client is currently in the wait() mode, but I haven't seen anything print
<ori> sumanah: there are a couple of known bugs that are on the backburner because of HHVM
<ori> sumanah: the service isn't officially 'launched' yet
<ori> sumanah: that is to say: it's not at all meant to be concealed or inaccessible, but it's not backed by the same guarantees as other production services. which is part of why the deprecation of the IRC feed hasn't been scheduled yet
<sumanah> ori: ah ok. So it sounds like I have very likely successfully done everything on my part, on the client side, but the stream might just not be emitting events properly?
<ori> sumanah: I don't have the time to look right now, sadly, so I can't confirm, but it's entirely plausible, yeah
<sumanah> right, certainly ori - this makes sense. So I will note that and move on right now to the other 2 APIs I'm covering this quarter, and come back to RCStream in September

• flimport added a comment.Sep 12 2014, 1:44 AM

ori wrote on 2014-08-09 00:22:19 (UTC)

This has been fixed now; see https://bugzilla.wikimedia.org/show_bug.cgi?id=66989#c4

• flimport added a subscriber: Qgil.Oct 2 2014, 9:48 PM
• flimport added a subscriber: ori.Oct 3 2014, 5:00 AM
Qgil mentioned this in T697: Converting "See Also" Bugzilla links to Phabricator tasks.Oct 18 2014, 11:29 PM
Sitic added a subscriber: Sitic.Oct 20 2014, 8:57 PM
Qgil lowered the priority of this task from Medium to Low.Oct 22 2014, 6:20 PM
• Spage added a project: ECT-February-2015.Feb 3 2015, 9:17 AM
• Spage added a subscriber: • Spage.

T88410: Showcase/inspire: Listen to Wikipedia is related, but seems to be using the earlier inflexible IRC RecentChanges stream.

• Spage raised the priority of this task from Low to Medium.Feb 3 2015, 9:27 AM
• Spage updated the task description. (Show Details)
• Spage set Security to None.
Qgil added a subscriber: Slaporte.Feb 3 2015, 9:29 AM
• Spage claimed this task.Feb 3 2015, 5:31 PM
Slaporte added a comment.Feb 3 2015, 5:34 PM

@Spage I started writing/collecting docs for the socket-io feed here: https://gist.github.com/slaporte/ab0c189b0552cea97627 including a small example widget: http://jsfiddle.net/7rgxxkok/11/

I hope that helps!

• Spage moved this task from Backlog to Ready To Go on the ECT-February-2015 board.Feb 3 2015, 5:35 PM
Qgil added a comment.Feb 4 2015, 8:45 AM

Is the goal of this task to improve the API references of RCStream or to write a tutorial to use this API? Or both?

PS: please bare with my (lack of) knowledge on the subject. I'm not even sure whether RCStream is an API or a tool...

• Spage added a comment.Feb 6 2015, 2:11 AM
In T334#1013897, @Qgil wrote:

Is the goal of this task to improve the API references of RCStream or to write a tutorial to use this API? Or both?

It's to provide some background for the Showcase/inspire item of T88410 or something related. I'm not sure where the API doc should go yet.

PS: please bare with my (lack of) knowledge on the subject. I'm not even sure whether
RCStream is an API or a tool...

I was Naked bare in the woods :) too... RCStream is a tool/program/service/API end point that broadcasts activity from MediaWiki wikis. So yes.

Progress:

@Slaporte, do you plan to switch http://listen.hatnote.com/ / Wikimon from the old RecentChanges IRC feed to RCStream?

Slaporte added a comment.Feb 6 2015, 2:20 AM
In T334#1020028, @Spage wrote:

@Slaporte, do you plan to switch http://listen.hatnote.com/ / Wikimon from the old RecentChanges IRC feed to RCStream?

I would like to! But it doesn't add any new features to Wikimon, so it's not high on my TODO list.

• Spage moved this task from Ready To Go to Doing on the ECT-February-2015 board.Feb 10 2015, 5:03 PM
• Spage added a project: ECT-March-2015.Mar 3 2015, 5:27 AM

Update: API:Recent changes stream is coming along.

• Spage moved this task from Backlog to Doing on the ECT-March-2015 board.Mar 3 2015, 5:31 AM
• Spage moved this task from Backlog to For review on the Web-APIs-Hub board.Mar 23 2015, 10:51 PM
• Spage removed • Spage as the assignee of this task.Apr 10 2015, 6:18 AM
• Spage updated the task description. (Show Details)
• Spage added projects: EventStreams, Documentation.
• Spage assigned this task to ori.Apr 10 2015, 6:20 AM

Ori, I believe https://www.mediawiki.org/wiki/API:Recent_changes_stream is ready for your review and/or Krinkle's. Edit away, add <!-- rewrite this junk --> HTML comments, etc. :)

Qgil added a project: ECT-April-2015.Apr 15 2015, 9:24 PM

This task was part of ECT-March-2015, and it is still open and assigned. Assuming that it belongs to ECT-April-2015 as well. Otherwise please edit accordingly.

Krinkle moved this task from Backlog to Backlog on the EventStreams board.Jul 23 2015, 7:31 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 23 2015, 7:31 PM
Ricordisamoa added a subscriber: Ricordisamoa.Feb 28 2016, 8:57 AM
ori closed this task as Resolved.Nov 18 2016, 7:28 PM
Content licensed under Creative Commons Attribution-ShareAlike 4.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL