We have a handful of tests that check basic tool functionality, but these could definitely be improved still. We should do some review of the code to check what is and isn't being tested at the moment, and add tests which broaden our coverage.
Hmm. We have the #wikipedia-library channel on Freenode IRC, which could work? Otherwise, I'm not sure - I don't really have the time to invest in coordinating a chat channel for this tool right now.