Are you sure about this?? I read on CIC website that time spent out of Canada WITH THE SPONSOR counts towards PR time. because you are still together.
Quoted:
Pursuant to A28(2), a permanent resident complies with the residency obligation provisions
with respect to a five-year period if, for...