I read OP’s query differently:
Yes, you will have an issue at Canadian immigration if travelling by air without PR card or PRTD. Technically, you could reach CBSA and present just COPR, but the airline will not let you board a plane to Canada without PR card, PRTD, or U.S. passport.