Progress made on this is that page histories are now being scanned in addition to watchlists and recent changes. In order to do this I had to make the entire script asynchronous since I added an asynchronous function call within what was previously a synchronous function. However in the process it seems to be less reliable in identifying additions of URLs to pages, either including URLs that were already on the page or missing ones that were added. However, I consider this progress, and I think the diffing algorithm is something we want to look at anyway.