Inland applicants are able to leave, but if they do not get allowed back in when they try to re-enter Canada, their application is essentially forfeited, as they cannot attend the in-Canada interview. For that reason, it's recommended that inland applicants not leave while the application is in process, especially if they're only on a visitors visa or TRV.
If the application was done outland, you can travel out of Canada with your husband no problem, but you just have to be aware that you may not be let back in. The difference is, even if you're not allowed back in, your application will still process.