You aren't eligible to contribute the first year, no. You may be able to contribute to a retirement account in your home country but I'd check the tax treaty. I know that a US citizen can contribute to an IRA in the US and deduct it for Canadian tax purposes (ah, but Americans have to fill out extra paperwork for Canadian RRSPs - at least it's only one page. The TFSA requires 10 page informational returns, each.)
At least you aren't going to get penalized.
You can contribute now, since you'll have a number listed on your 2012 notice.