It is probably fair to assume, as others apparently have, that by "Canadian" you mean your wife is a Canadian citizen (actually Canadian PRs are also "Canadians" in Canadian law), in which case it is LIKELY you will NOT have a problem getting credit toward the PR Residency Obligation for the time you lived together abroad.
That said, as some have cautioned, there is a RISK IRCC will NOT give credit for the time living together abroad based on distinguishing
who-accompanied-whom. Apparently
@21Goose is not familiar with official interpretations of the law. My sense is this risk is fairly low but that in part depends in part on your continuing to live and work in Canada (not that is a requirement, but in terms of how it appears).
Additionally, the caution expressed by
@Bs65, regarding the need for a PR Travel Document or traveling via the U.S. (so as to cross the border using private transportation), warrants some emphasis.
There is NO doubt
who-accompanied-whom can make a deciding difference when a PR claims credit toward the PR Residency Obligation based on time abroad accompanying the PR's Canadian citizen spouse.
CAUTION: The operational manuals are merely "a reference tool to guide" IRCC decision-makers and are "not binding." In particular, the language you quote from ENF 23 has EXPLICITLY NOT been followed in NUMEROUS actual cases, as OFFICIALLY reported in published IAD (Immigration Appeal Division) decisions. (quoted language is specifically in regard to operational manual ENF 23, see Dadash-zadeh v Canada (Citizenship and Immigration), 2018 CanLII 46499 (CA IRB);
http://canlii.ca/t/hsldq )
In particular, multiple IAD panels have explicitly RULED against PRs, concluding the determination the PR breached the Residency Obligation to be VALID in LAW in cases where credit for time living abroad with a Canadian citizen spouse WAS DENIED explicitly because it was determined the PR was NOT accompanying the citizen spouse but, rather, the citizen was accompanying the PR.
Again, there are numerous such official decisions. See, just for example:
Ibrahim v Canada (Citizenship and Immigration), 2018 CanLII 60499 (CA IRB),
http://canlii.ca/t/hst3d
Javadian-Sarraf v Canada (Citizenship and Immigration), 2018 CanLII 68435 (CA IRB),
http://canlii.ca/t/ht5t6
Ezeibe v Canada (Citizenship and Immigration), 2017 CanLII 29598 (CA IRB),
http://canlii.ca/t/h3ssj
Khaira v Canada (Citizenship and Immigration), 2014 CanLII 95529 (CA IRB),
http://canlii.ca/t/gksqq
Diouf, 2011 CanLII 59952 see
http://canlii.ca/t/fn81r
Khan v Canada, 2015 CanLII 99397 see
http://canlii.ca/t/grz8t
There are contrary decisions, such as Mustafa v Canada, 2018 CanLII 47219 see
http://canlii.ca/t/hs76z in which ENF 23 is cited as supporting the approach in which who-accompanied-whom is NOT relevant. This decision is cited by other IAD panels agreeing with its approach, and by a number of the above referenced decisions in which its approach is explicitly rejected.
I already linked the Dadash-zadeh v Canada (Citizenship and Immigration), 2018 CanLII 46499 (CA IRB), decision,
http://canlii.ca/t/hsldq but since it is a rather recent IAD decision, in addition to explicitly declining to follow ENF 23, the conclusions are worth quoting:
In my view, the relevant IAD decisions relied on by the Minister’s representative turn on the meaning to be attributed to the phrase “outside Canada accompanying a Canadian citizen who is their spouse or common law partner” as found in subparagraph 28(2)(a)(ii) of the Act, more particularly to the term “accompanying”.
In this appeal, the proof does not reasonably support the conclusion that the appellant moved from Canada to Iran to be where his spouse had gone, nor that he accompanied her from Canada to Iran as a companion or to escort her there.
I conclude that based on the available evidence and considering the plain meaning of the word “accompanying”, it is more likely than not that at all material times during the five-year period under review in this appeal, it was Ms. Hejazi who was outside Canada accompanying the appellant to Iran, rather than the reverse.
Based on the evidence and governing legal principles, I conclude that while residing in Iran during the relevant five-year period under review in this appeal, the appellant was not ‘accompanying’ his Canadian wife within the meaning of subparagraph 28(2)(a)(ii) of the Act. The 1,602 days he spent in Iran during that five-year period in the company of his wife cannot be allocated to him for the purposes of assessing his compliance with the residency obligation under section 28 of the Act. As a result, the appeal fails in law.
I have gone into far more depth about this subject in a topic explicitly about the issue, titled "Who-accompanied-whom can matter for PRs living with citizen spouse abroad: UPDATE" . . . see