According to Immigration guide your family members are spouse and dependent children whether they accompany you to Canada or not. So I guess in your case your total family members would be 5. I recommend you to call cic agent before you send in an application.