No effect until short trips...as per cic website. Long trip...nobody knows how it will impact so at your own risk...
Sponsors who maintain a principal residence in Canada are not considered to be in violation of residency requirements if they:
take short holidays or business trips outside...