You can do it, yes. Since it is a Visitor visa, you will have restrictions. Cannot stay more than 6 months at a stretch. Cannot work...etc. although, it is not a dire necessity to take the whole family. It is better to move change address along with the family.
As it is a visitor visa, it won't...