Per this fun little debugging session, it might be a good idea to warn the user interactively when they try to use IPA characters which are unsupported by the currently enabled TTS engine.
Google, for example, doesn't support the / stress character — if you pass unsupported IPA in the SSML to Google, it ignores the entire IPA element and reads the word instead (which, I suppose, isn't too bad of a failure state)