I had the same issue and I changed my address and did let CIC know before transferring my file to Hamilton.
However, because of unknown reason they sent my file to Hamilton instead of one of the offices in Toronto.
Once, the agent told me I can send an email to Hamilton and ask them to transfer...