Well you can see where this is going, the basic question is whether you are principally residing.
You're letting out bits more of info that, well, not exactly commuting every day. Well every other day plus weekends there where you didn't really it seems ever stop residing per se. You can see how they might well see things differently.
Will ircc make an issue of it? Don't know. Probably not. But maybe.
Want to avoid even the possibility of an issue? Reside unambiguously first and foremost in Canada. Have your spouse spend more time in Canada.
Principally residing is not enough. You can have a primary residence in Canada while spending months out of Canada. The requirement is that you must remain in Canada if a PR to sponsor a spouse not have a primary residence