If an update is skipped (eg. the check for the latest file runs before the latest file exists and then the script doesn't run again until the next day) then the number of rows that need to be updated increases dramatically (10+M). We should check to see if this is a problem and guard against it if so although I think having recovery steps prepared regardless seems useful.