That would be a risky move since passport could be misplaced or get delayed in being returned back to you. You'd have to wait to hear back from IRCC to be sure. As far as I know, people in the US have been sending their passports to Ottawa for further processing and not to a VAC centre.