Draftquality transformer
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• ACraze
	Jan 11 2022, 6:27 PM

Description

As discussed in T294419, add draftquality transformer to extract features via the MediaWiki API.

Details

Subject	Repo	Branch	Lines +/-
ml-services: update draftquality transformer image	operations/deployment-charts	master	+1 -1
draftquality: fix transformer features method call	machinelearning/liftwing/inference-services	main	+1 -1
ml-services: add draftquality transformer	operations/deployment-charts	master	+14 -0
inference: add draftquality-transformer pipeline	integration/config	master	+15 -0
draftquality: configure transformer pipelines	machinelearning/liftwing/inference-services	main	+21 -0
draftquality: add transformer blubberfile	machinelearning/liftwing/inference-services	main	+235 -1
draftquality: add transformer module	machinelearning/liftwing/inference-services	main	+125 -16

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	None	T272917 Lift Wing proof of concept
Resolved	calbon	T294419 Factor out feature retrieve functionality to a transformer
Resolved	• ACraze	T298989 Draftquality transformer

Event Timeline

• ACraze created this task.Jan 11 2022, 6:27 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 11 2022, 6:27 PM

• ACraze added a parent task: T294419: Factor out feature retrieve functionality to a transformer.Jan 11 2022, 6:29 PM

Change 753118 had a related patch set uploaded (by Accraze; author: Accraze):

[machinelearning/liftwing/inference-services@main] draftquality: add transformer module

https://gerrit.wikimedia.org/r/753118

gerritbot added a project: Patch-For-Review.Jan 11 2022, 7:07 PM

calbon moved this task from Project: Lift Wing to Backlog on the Machine-Learning-Team (Active Tasks) board.Jan 11 2022, 7:36 PM

calbon moved this task from Backlog to Parked on the Machine-Learning-Team (Active Tasks) board.Jan 11 2022, 7:38 PM

• ACraze claimed this task.Jan 12 2022, 5:20 PM

Change 753572 had a related patch set uploaded (by Accraze; author: Accraze):

[machinelearning/liftwing/inference-services@main] draftquality: add transformer blubberfile

https://gerrit.wikimedia.org/r/753572

Change 753118 merged by jenkins-bot:

[machinelearning/liftwing/inference-services@main] draftquality: add transformer module

https://gerrit.wikimedia.org/r/753118

• ACraze mentioned this in rMLIS23ccf337598b: draftquality: add transformer module.Jan 14 2022, 5:43 AM

Change 755025 had a related patch set uploaded (by Accraze; author: Accraze):

[machinelearning/liftwing/inference-services@main] draftquality: configure transformer pipelines

https://gerrit.wikimedia.org/r/755025

• ACraze changed the task status from Open to In Progress.Jan 18 2022, 9:36 PM

• ACraze moved this task from Parked to In Progress on the Machine-Learning-Team (Active Tasks) board.

Change 753572 merged by Accraze:

[machinelearning/liftwing/inference-services@main] draftquality: add transformer blubberfile

https://gerrit.wikimedia.org/r/753572

• ACraze mentioned this in rMLISf6d58c8c8e5e: draftquality: add transformer blubberfile.Jan 19 2022, 3:51 PM

Change 755025 merged by jenkins-bot:

[machinelearning/liftwing/inference-services@main] draftquality: configure transformer pipelines

https://gerrit.wikimedia.org/r/755025

• ACraze mentioned this in rMLIS3fb7b1c1168d: draftquality: configure transformer pipelines.Jan 20 2022, 7:26 AM

Maintenance_bot removed a project: Patch-For-Review.Jan 20 2022, 8:10 AM

Change 755721 had a related patch set uploaded (by Accraze; author: Accraze):

[integration/config@master] inference: add draftquality-transformer pipeline

https://gerrit.wikimedia.org/r/755721

gerritbot added a project: Patch-For-Review.Jan 20 2022, 3:50 PM

Change 755721 merged by jenkins-bot:

[integration/config@master] inference: add draftquality-transformer pipeline

https://gerrit.wikimedia.org/r/755721

Maintenance_bot removed a project: Patch-For-Review.Jan 21 2022, 2:10 PM

Change 756064 had a related patch set uploaded (by Accraze; author: Accraze):

[operations/deployment-charts@master] ml-services: add draftquality transformer

https://gerrit.wikimedia.org/r/756064

gerritbot added a project: Patch-For-Review.Jan 21 2022, 10:06 PM

• ACraze moved this task from In Progress to Blocked on the Machine-Learning-Team (Active Tasks) board.Jan 24 2022, 7:15 PM

Deployment for the new transformer is currently blocked on T298976

Change 756064 merged by Elukey:

[operations/deployment-charts@master] ml-services: add draftquality transformer

https://gerrit.wikimedia.org/r/756064

The cert-manager blocker is gone (see: T298976). I was able to deploy the new transformer successfully to both eqiad and codfw

accraze@ml-serve-ctrl1001:~$ time curl "https://inference.svc.eqiad.wmnet:30443/v1/models/enwiki-draftquality:predict" -X POST -d @input.json -i -H "Host: enwiki-draftquality.revscoring-draftquality.wikimedia.org" --http1.1
HTTP/1.1 200 OK
content-length: 174
content-type: application/json; charset=UTF-8
date: Wed, 26 Jan 2022 19:44:35 GMT
server: istio-envoy
x-envoy-upstream-service-time: 147

{"predictions": {"prediction": "OK", "probability": {"OK": 0.5353439647846655, "attack": 0.007890554256618306, "spam": 0.3336745277118135, "vandalism": 0.12309095324690275}}}
real	0m0.192s
user	0m0.016s
sys	0m0.007s

Marking this as RESOLVED

• ACraze closed this task as Resolved.Jan 26 2022, 7:57 PM

• ACraze moved this task from Blocked to Completed on the Machine-Learning-Team (Active Tasks) board.

Maintenance_bot removed a project: Patch-For-Review.Jan 26 2022, 8:11 PM

Change 758417 had a related patch set uploaded (by Kevin Bazira; author: Kevin Bazira):

[machinelearning/liftwing/inference-services@main] draftquality: fix transformer features method call

https://gerrit.wikimedia.org/r/758417

gerritbot added a project: Patch-For-Review.Jan 31 2022, 7:36 AM

Change 758417 merged by jenkins-bot:

[machinelearning/liftwing/inference-services@main] draftquality: fix transformer features method call

https://gerrit.wikimedia.org/r/758417

kevinbazira mentioned this in rMLIS6c4c46222318: draftquality: fix transformer features method call.Jan 31 2022, 4:24 PM