Depends.. CIC will have a file for you so regardless of if they stamp your passport or not, they have a record of rejection.
They will share this with US, so you can forget about lying about it if you apply to US. Other countries, i'm not sure.
to the OP, PG diploma is definitely a step down...