the only time your visit can go against you is when sponsor's visit is longer than a reasonable visit AND
the sponsor leaves work and stops paying tax
because it shows that applicant and sponsor (a new family) is planning on living in pakistan rather than canada
i have seen one case where husband moved to pakistan and stayed in pakistan for 3 years and even applied for his wife's immigration from pakistan.
on the other hand there has also been a case where wife ( now in canada) received a phone call for telephonic interview.
and the question were
why did you husband not visit you
and why dont you guys talk alot on the phone.
but that is just my observation