You are absolutely right. You can travel for short period of time. I had the same question so I directly called CIC. Officer told me you can definitely visit to another country. Even I called them 3 times and got same answer. She also told me the rule applies to the applicant and sponsor living...