@jsn.sherman suggests using number of files rather than existing error messages.

We could maybe use Ellen's output

Or this message: Creating moderation request for file

I think there are two fairly straightforward ways to get these numbers:

• essex suggested that we sed/grep the logfile, which would be a really easy way to get started with no code change
• if we want to have these values on an ongoing basis, we might be able to just accumulate the two counts in memory during a run and report them at the end, printing to console, and/or logging to file. so that we have the success rate for each run. This might be more useful if we want to have ongoing visibility and potentially raise some alerts for future automated runs

I was thinking the first approach. Creating the statistic on an ongoing basis is out of scope for this task, as we need to get these numbers sooner to know how to proceed.

I grepped the logs today and got 574 successes out of 971476 files sent.

Success message: "should be 3000"

Files sent message: "Creating moderation request for file"