The main danger I see is that you have about 5 days to change your license else you get a substantial fine IIRC. Will IRCC care I don’t know but why not change your address on license first, takes a few minutes to do then a week or two to get the new one. Plus is free (at least I’ve never paid and had 3 addresses over the life of my first one).
I don’t know what province you’re in, however I just moved, and changed my address in Ontario. I went to Service Ontario, they gave a temp address liscense there , and I received a new license in the mail about a week later