Between 16:17 - 16:57 on march 6 we had uploads broken due to a config error. While this is a pretty good response time, it would be ideal if automatic alarm bells ring when uploads break, instead of having to wait for users to complain (It took about half an hour until user complaints were sufficiently escalated).
Could we perhaps have an icingia (or whatever its called) check http://commons.wikimedia.org/w/api.php?list=logevents&letype=upload&action=query&lelimit=1&lestart=<timestamp 5 minutes ago> every 5 minutes, and raise alarms if there is a 5 minute period where there are 0 uploads [or some other threshold]? Commons seems to average a new upload about once every 5 seconds, so a 5 minute period should get rid of any false positives.