Page MenuHomePhabricator
Create Task
Maniphest T265722

New Service Request: Sockpuppet Detection
Closed, ResolvedPublic
Actions

Description

Description: This is a request to launch the Sockpuppet Detection Service of T259471: Sockpuppet detection API [low effort].
Timeline: Live on or before end of Q2 FY 2020-2021
Diagrams:
Technologies:
Point person: Hugh Nowlan

Acceptance criteria

  • Write a Helm chart
  • Secrets management is done
  • Benchmark the service
  • Deploy
  • Switch traffic to the new deployment

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT259471 Sockpuppet detection API [low effort]
 ResolvedNoneT265722 New Service Request: Sockpuppet Detection
 ResolvedhnowlanT268835 Add logging to Similarusers
 ResolvedhnowlanT268837 Create Helm chart for Similarusers
 OpenNoneT268836 Documentation for Similarusers
 ResolvedhnowlanT268838 Dockerise Similarusers
 ResolvedhnowlanT268839 Move Similarusers repo out of Github and into Gerrit
 ResolvedgmodenaT268844 Replace in-memory model storage with SQL-based storage
 ResolvedhnowlanT268874 Increase resilience to external api call failures
 OpenNoneT268875 Sockpuppet API: Ensure data consistency across service instances
 ResolvedgmodenaT269014 Introduce automated testing to Sockpuppet detection
 OpenNoneT269261 Language and project configuration for Sockpuppet
 ResolvedgmodenaT269466 We should document the data ingestion process
 ResolvedgmodenaT269468 We should provide a data ingestion script
 OpenNoneT269778 Introduce API versioning to Sockpuppet
 ResolvedgmodenaT269837 The service should be aware of batch database refreshes
 ResolvedgmodenaT270406 Sockpuppet Detection data ingestion script should display progress information
ResolvedgmodenaT270613 [SPIKE] can we orchestrate the Similarusers pipeline with airflow?
 ResolvedgmodenaT272869 Add probes and logging to gain performance insights
ResolvedgmodenaT272870 [SPIKE] can we identify alternative sources for near real-time edit data?
 ResolvedgmodenaT275561 We should document /similarusers response payload
 ResolvedgmodenaT275566 Provide the capability to generate static endpoint documentation for sockpuppet detection
 ResolvedgmodenaT277453 Don't echo the db connection string at command line prompt
DeclinedfkaelinT277548 Improve robustness of data processing pipeline
 ResolvedgmodenaT279640 Ingest user similarity data for March 2021
 ResolvedgmodenaT282992 Ingest user similarity data for April 2021
 ResolvedgmodenaT284424 Ingest user similarity data for May 2021
 ResolvedcodebugT285494 We should use a unique spelling for neigbhor/neighbour
 ResolvedgmodenaT286036 Ingest user similarity data for June 2021
 OpenNoneT287274 [SPIKE][PLACEHOLDER] we need to estimate the effort required to migrate Similarusers' backend to Cassandra

Event Timeline

WDoranWMF created this task.Oct 16 2020, 1:20 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 16 2020, 1:20 PM
WDoranWMF updated the task description. (Show Details)Oct 16 2020, 7:52 PM
WDoranWMF added a parent task: T259471: Sockpuppet detection API [low effort].Oct 20 2020, 2:19 PM
WDoranWMF updated the task description. (Show Details)Oct 22 2020, 1:06 PM
WDoranWMF updated the task description. (Show Details)Oct 22 2020, 1:38 PM
hnowlan added a subtask: T268836: Documentation for Similarusers.Nov 26 2020, 3:46 PM
hnowlan mentioned this in T263963: Evaluate requirements to productionise Sockpuppet Detection API.Nov 26 2020, 5:13 PM
hnowlan moved this task from Backlog to Ready on the Platform Team Workboards (Green) board.Nov 26 2020, 5:24 PM
hnowlan moved this task from Ready to Doing on the Platform Team Workboards (Green) board.
gmodena subscribed.Nov 27 2020, 8:51 AM
gmodena added a subtask: T268875: Sockpuppet API: Ensure data consistency across service instances.Nov 27 2020, 9:17 AM
hnowlan closed subtask T268835: Add logging to Similarusers as Resolved.Nov 27 2020, 6:07 PM
hnowlan closed subtask T268839: Move Similarusers repo out of Github and into Gerrit as Resolved.Dec 1 2020, 4:10 PM
Isaac mentioned this in T171635: Prototype new models to facilitate sockpuppet detection.Dec 4 2020, 7:52 PM
hnowlan closed subtask T268838: Dockerise Similarusers as Resolved.Dec 8 2020, 1:10 PM
gmodena mentioned this in T270196: Access to prod mysql from stat1004.Dec 15 2020, 4:44 PM
• eprodromou closed subtask T268844: Replace in-memory model storage with SQL-based storage as Resolved.Dec 16 2020, 5:19 PM
hnowlan closed subtask T268874: Increase resilience to external api call failures as Resolved.Jan 22 2021, 12:06 PM
gmodena closed subtask T269468: We should provide a data ingestion script as Resolved.Jan 25 2021, 3:07 PM
hnowlan closed subtask T269014: Introduce automated testing to Sockpuppet detection as Resolved.Jan 27 2021, 4:46 PM
Samwalton9-WMF subscribed.Jan 29 2021, 12:21 PM

Just curious - what's the status of this?

WDoranWMF added a comment.Jan 29 2021, 2:15 PM

@Samwalton9 The service is now up and available for access internally.

gmodena closed subtask T270406: Sockpuppet Detection data ingestion script should display progress information as Resolved.Feb 23 2021, 9:39 PM
gmodena closed subtask T269837: The service should be aware of batch database refreshes as Resolved.
gmodena closed subtask T270613: [SPIKE] can we orchestrate the Similarusers pipeline with airflow? as Resolved.
hnowlan closed subtask T272869: Add probes and logging to gain performance insights as Resolved.Feb 24 2021, 5:40 PM
Samwalton9-WMF unsubscribed.Feb 25 2021, 2:25 PM
hnowlan removed hnowlan as the assignee of this task.May 6 2021, 3:08 PM
hnowlan closed subtask T268837: Create Helm chart for Similarusers as Resolved.
hnowlan subscribed.
gmodena closed subtask T279640: Ingest user similarity data for March 2021 as Resolved.May 17 2021, 7:18 AM
gmodena closed subtask T282992: Ingest user similarity data for April 2021 as Resolved.Jun 7 2021, 11:12 AM
gmodena closed subtask T284424: Ingest user similarity data for May 2021 as Resolved.Jul 2 2021, 12:36 PM
Aklapper added a project: Platform Engineering.Oct 18 2021, 7:42 AM

Adding Platform Engineering as Platform Team Workboards (Green) was archived and as open tasks should have an active project tag

• sdkim mentioned this in T295324: AuthZN Sockpuppet Model via Liftwing API.Nov 8 2021, 8:40 PM
hnowlan closed this task as Resolved.Nov 9 2021, 9:56 AM
hnowlan updated the task description. (Show Details)
gmodena closed subtask T286036: Ingest user similarity data for June 2021 as Resolved.Nov 16 2021, 9:45 AM
gmodena closed subtask T277453: Don't echo the db connection string at command line prompt as Resolved.
gmodena closed subtask T275561: We should document /similarusers response payload as Resolved.Nov 16 2021, 9:48 AM
gmodena closed subtask T272870: [SPIKE] can we identify alternative sources for near real-time edit data? as Resolved.
gmodena closed subtask T269466: We should document the data ingestion process as Resolved.
gmodena closed subtask T285494: We should use a unique spelling for neigbhor/neighbour as Resolved.Nov 16 2021, 9:56 AM
fkaelin closed subtask T277548: Improve robustness of data processing pipeline as Declined.Jul 12 2023, 5:47 PM
Aklapper closed subtask T275566: Provide the capability to generate static endpoint documentation for sockpuppet detection as Resolved.Oct 9 2023, 3:20 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL