, it depends on case to case basis.
Let me share my experience , my wife live with me after filing the case for 5.5 months , and till now they dont question about it. and hope in sha allah they will not.
For retaining PR status , u have to live total 730 days in canada in total in five year span...