I am having the same issue here; after some research, I come to know that they will deduct some money (1.5 lakhs) if I wish to withdraw.
And also, If I got a visa rejection, they will only deduct 250 CAD.
The college will inform the visa officer, so IRCC will not work on your file. But not sure...