In my case, the CBSA officer didn’t seem overly concerned with the hotel reservation, but they did want to confirm my accommodations and plans. If you have a solid invitation letter, I don’t think it would be an issue.
To your point, it’s true that they don’t usually call hotels to verify...