Change Details

**Project Information ** * Name of tool/project: MediaModeration extension * Project home page: https://www.mediawiki.org/wiki/Extension:MediaModeration * Name of team requesting review: #core_platform_team #trust-and-safety * Primary contact: Petr Pchelko (Pchelolo) * Target date for deployment: * Link to code repository / patchset: https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/MediaModeration/+/master **Description of the tool/project: ** MediaModeration extension will post jobs on the job queue upon media upload to the wiki. The job would asynchronously post a thumbnail of the media to the [[ http://www.microsoft.com/photodna | PhotoDNA cloud service ]] which would match the media to the known database of child abuse media. Upon detection of the problematic content, an email would be sent automatically to the #trust-and-safety team to take appropriate action. After the initial testing period, its planned to take down the media from wiki automatically, initially by deletion with suppression. For more info see T245595 as well. **Description of how the tool will be used at WMF** * All uploaded media would eventually go through hash matching, all already uploaded media would be asynchronously processed via a maintenance script posting jobs on the job queue * The emails would be sent with minimal information to the trust and safety team with manual steps taken to remove the media from the sites and report it * PhotoDNA cloud API access keys will be stored in the secret portion of mediawiki-config **Dependencies** No vendor dependencies, however the extension depends on an external [[ http://www.microsoft.com/photodna | PhotoDNA ]] cloud service maintained by Microsoft. **Has this project been reviewed before?** Yes, code review was done by the #core_platform_team **Working test environment** Not easy to set it up, since the primary purpose of the extension is to contact an external cloud provider, thus for full integration testing you'd need a secret API key. WMF does have access to generating the API key, please contact @Pchelolo if you decide to do a complete test and require a key. **Post-deployment** #core_platform_team #trust-and-safety

**Project Information ** * Name of tool/project: MediaModeration extension * Project home page: https://www.mediawiki.org/wiki/Extension:MediaModeration * Name of team requesting review: #core_platform_team #trust-and-safety * Primary contact: Petr Pchelko (Pchelolo) * Target date for deployment: April 30 2020 * Link to code repository / patchset: https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/MediaModeration/+/master **Description of the tool/project: ** MediaModeration extension will post jobs on the job queue upon media upload to the wiki. The job would asynchronously post a thumbnail of the media to the [[ http://www.microsoft.com/photodna | PhotoDNA cloud service ]] which would match the media to the known database of child abuse media. Upon detection of the problematic content, an email would be sent automatically to the #trust-and-safety team to take appropriate action. After the initial testing period, its planned to take down the media from wiki automatically, initially by deletion with suppression. For more info see T245595 as well. **Description of how the tool will be used at WMF** * All uploaded media would eventually go through hash matching, all already uploaded media would be asynchronously processed via a maintenance script posting jobs on the job queue * The emails would be sent with minimal information to the trust and safety team with manual steps taken to remove the media from the sites and report it * PhotoDNA cloud API access keys will be stored in the secret portion of mediawiki-config **Dependencies** No vendor dependencies, however the extension depends on an external [[ http://www.microsoft.com/photodna | PhotoDNA ]] cloud service maintained by Microsoft. **Has this project been reviewed before?** Yes, code review was done by the #core_platform_team **Working test environment** Not easy to set it up, since the primary purpose of the extension is to contact an external cloud provider, thus for full integration testing you'd need a secret API key. WMF does have access to generating the API key, please contact @Pchelolo if you decide to do a complete test and require a key. **Post-deployment** #core_platform_team #trust-and-safety

**Project Information ** * Name of tool/project: MediaModeration extension * Project home page: https://www.mediawiki.org/wiki/Extension:MediaModeration * Name of team requesting review: #core_platform_team #trust-and-safety * Primary contact: Petr Pchelko (Pchelolo) * Target date for deployment: April 30 2020 * Link to code repository / patchset: https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/MediaModeration/+/master **Description of the tool/project: ** MediaModeration extension will post jobs on the job queue upon media upload to the wiki. The job would asynchronously post a thumbnail of the media to the [[ http://www.microsoft.com/photodna | PhotoDNA cloud service ]] which would match the media to the known database of child abuse media. Upon detection of the problematic content, an email would be sent automatically to the #trust-and-safety team to take appropriate action. After the initial testing period, its planned to take down the media from wiki automatically, initially by deletion with suppression. For more info see T245595 as well. **Description of how the tool will be used at WMF** * All uploaded media would eventually go through hash matching, all already uploaded media would be asynchronously processed via a maintenance script posting jobs on the job queue * The emails would be sent with minimal information to the trust and safety team with manual steps taken to remove the media from the sites and report it * PhotoDNA cloud API access keys will be stored in the secret portion of mediawiki-config **Dependencies** No vendor dependencies, however the extension depends on an external [[ http://www.microsoft.com/photodna | PhotoDNA ]] cloud service maintained by Microsoft. **Has this project been reviewed before?** Yes, code review was done by the #core_platform_team **Working test environment** Not easy to set it up, since the primary purpose of the extension is to contact an external cloud provider, thus for full integration testing you'd need a secret API key. WMF does have access to generating the API key, please contact @Pchelolo if you decide to do a complete test and require a key. **Post-deployment** #core_platform_team #trust-and-safety