Only if you want to work. If you don't plan to work, you can apply to change your status to visitor if you want to stay. If you don't plan to stay, you can go back to home country and wait for your PR visa.
If you leave, just make sure you let CIC know what your current address is at all times unless you have someone at your old address checking your mail for you.