It's extremelly rare. Most times that I've heard of them speaking to anyone other than the sponsor or the applicant was when they call you and somebody else in your family answers the phone. So, it's unlikely to happen (there are some privacy issues there, so I don't think they CAN just contact anyone), but assume it can.