Page MenuHomePhabricator

Set up and automate scanning tool evaluation pipeline
Open, In Progress, Needs TriagePublic

Description

To evaluate the tools/findings, we need should compare it with our current environment:

  • Create scripts to pull repositories from Wikimedia for Gerrit, GitLab and GitHub, limited to just extensions for now
  • Automate scanning repositories for semgrep and osv-scanner. To be extended to Phan and LibUp
  • Ingest the data into DefectDojo via REST API
  • Create SQL queries and datasets for Apache Superset and create dashboards

Event Timeline

Jly changed the task status from Open to In Progress.

limited to just extensions for now

I'd suggest further limiting this to just Wikimedia production-deployed extensions, for now.

To be extended to Phan and LibUp

It might be easiest to just compare these to phan/security-check and libup runs in gerrit CI for various repos, either on real change sets or synthetic ones. Setting this up locally, especially for libup, would likely be a heavy lift.

Ingest the data into DefectDojo via REST API

Not sure how easy DefectDojo can automate a lot of this, but I'd imagine that with base semgrep and osv-scanner runs, there would be a heavy amount of false positives with these tools. Without more tuned/custom semgrep rules and vulnerability analysis, I'm not certain how meaningful this analysis might be.

Aklapper removed subscribers: acooper, Jly.

Removing inactive assignee account. (Please do so as part of your team's offboarding process.)