⚓ T1272 Deploy ApiFeatureUsage extension on WMF wikis

Subject	Repo	Branch	Lines +/-
Enable ApiFeatureUsage everywhere	operations/mediawiki-config	master	+1 -2
Add ApiFeatureUsage extension to default.conf	mediawiki/tools/release	master	+1 -0
Add ApiFeatureUsage in production and enable on group0	operations/mediawiki-config	master	+21 -11
Add ApiFeatureUsage [wmf6]	mediawiki/core	wmf/1.26wmf6	+4 -0
Add ApiFeatureUsage [wmf5]	mediawiki/core	wmf/1.26wmf5	+4 -0

Status	Assigned	Task
Resolved	bd808	T69817 Monitor for anomalies/spikes in read failures of memcached
Resolved	bd808	T100735 Have Logstash report per-channel log message rate to Graphite
Resolved	bd808	T99735 Upgrade Logstash to 1.5.3
Resolved	bd808	T97545 reinstall logstash1001-1003
Resolved	Anomie	T1272 Deploy ApiFeatureUsage extension on WMF wikis
Resolved	• csteipp	T78808 Security review for ApiFeatureUsage extension
Resolved	bd808	T88732 Decouple logging infrastructure failures from MediaWiki logging
Resolved	bd808	T88870 Prototype Monolog and rsyslog configuration to ship log events from MediaWiki to Logstash
Resolved	bd808	T85535 Upgrade monolog to 1.12.0
Resolved	bd808	T89313 Fix MWLoggerMonologHandler::isHandling() to work with Monolog 1.12.0
Resolved	bd808	T96814 Update Logstash Puppet roles to allow separating Elasticsearch from Logstash & Kibana
Resolved	bd808	T96692 Rack and Setup (3) Logstash Servers
Resolved	RobH	T84958 eqiad: (3) servers for logstash service
Declined	bd808	T87078 Upgrade RAM for logstash100[123] to 64G
Resolved	RobH	T89402 purchase 3 additional logstash nodes
Declined	RobH	T87460 Allocate temporary Elasticsearch nodes from spares pool for Logstash
Resolved	faidon	T97481 jessie installs fail - mirror issue due to jessie release?
Resolved	bd808	T97645 Elasticsearch not starting on Jessie hosts
Resolved	bd808	T99541 Fix logstash apifeatureusage role in Beta Cluster

Anomie created this task.Nov 13 2014, 5:43 PM

Anomie claimed this task.

Anomie raised the priority of this task from to Needs Triage.

Anomie updated the task description. (Show Details)

Anomie added a project: MediaWiki-Core-Team.

Anomie moved this task to In Dev/Progress on the MediaWiki-Core-Team board.

Anomie changed Security from none to None.

Anomie subscribed.

Stuff needing review:

Once those are merged, we can look at deploying to Beta Labs for more testing.

For eventual deploy to production:

https://gerrit.wikimedia.org/r/#/c/173336/ (currently cherry-picked on Beta)
- Then Elasticsearch needs to be restarted to pick up a config change.

Anomie moved this task from In Dev/Progress to Needs Review/Feedback on the MediaWiki-Core-Team board.Nov 20 2014, 8:08 PM

Anomie moved this task from Needs Review/Feedback to In Dev/Progress on the MediaWiki-Core-Team board.Nov 25 2014, 6:09 PM

Anomie moved this task from In Dev/Progress to Needs Review/Feedback on the MediaWiki-Core-Team board.

Anomie renamed this task from Deprecated API usage report on WMF wikis to Deploy ApiFeatureUsage extension on WMF wikis.Dec 17 2014, 5:21 PM

Anomie triaged this task as Medium priority.

Anomie updated the task description. (Show Details)

Anomie edited projects, added Wikimedia-Extension-setup, ApiFeatureUsage; removed MediaWiki-Core-Team.

Anomie added a subtask: T78808: Security review for ApiFeatureUsage extension.Dec 17 2014, 5:23 PM

greg subscribed.Jan 12 2015, 10:55 PM

Liuxinyu970226 subscribed.Feb 7 2015, 3:53 AM

• csteipp closed subtask T78808: Security review for ApiFeatureUsage extension as Resolved.Feb 17 2015, 8:33 PM

Adding T88732 as a blocker: it seems logstash is down entirely until that gets fixed, meaning nothing gets added to the ApiFeatureUsage indexes.

bd808 closed subtask T88732: Decouple logging infrastructure failures from MediaWiki logging as Resolved.May 11 2015, 3:17 PM

bd808 mentioned this in T98750: Do not index type:api-feature-usage-sanitized events in Logstash's Elasticsearch.May 11 2015, 4:25 PM

Krenair removed a project: ApiFeatureUsage.May 15 2015, 3:46 PM

Krenair removed a project: MediaWiki-extensions-ApiFeatureUsage.

Why did you do that?

I was removing generic extension projects from a few WMF-deployment tickets. ApiFeatureUsage probably has pretty Wikimedia-specific use case though, putting it back

Sounds like this shouldn't be too far from being ready for production, should be good to go on beta now at least?

It has been on Beta for a while now, see http://en.wikipedia.beta.wmflabs.org/wiki/Special:ApiFeatureUsage.

Although I note there seems to be something wrong with the log events getting into logstash in Beta Labs. @bd808, any idea?

In T1272#1290877, @Anomie wrote:

Although I note there seems to be something wrong with the log events getting into logstash in Beta Labs. @bd808, any idea?

First I'm hearing of it not working, so we should look into it. Have you checked the production index to see if it is populating as expected?

bd808 closed subtask T99541: Fix logstash apifeatureusage role in Beta Cluster as Resolved.May 18 2015, 5:29 PM

@greg: Bryan just fixed T99541 (which only affected Beta Labs anyway), and told me that logstash seems stable. So what do we need to do now to resolve this bug?