At the moment, it's very hard to code a bot that can filter out blacklisted URLs whilst leaving other URLs.
A simple thing to help with this would be to have the API pass back all problematic URLs on the page, thus reducing the number of attempts to two (try -> filter -> try again) rather than a loop of changing one domain every time,a s at present.
Thanks.
Version: 1.20.x
Severity: enhancement