Hi
Canada has no foreign exchange controls, so I agree you can have bank accounts anywhere (except in countries with sanction related restrictions) which I do not anticipate will prove an issue.
The rules of taxations are driven by several factors, including tax treaties between countries, as well as where you are living, temporary or permanent.
You need not worry about banking in other countries at all. As mentioned earlier, if you have income in any foreign country however, you may have to declare it (and pay tax) on that income, here in Canada. (so if you earned interest on the money in the foreign bank account you may have to declare that interest as income and pay taxes here)
I would suggest that after you arrive, and when you submit your first tax return, you discuss the foreign income point with a licensed accountant.
Good luck!..