I don't think there is a general rule for this. But I think it is better to mention it (even if very briefly) to be safe.
An extreme case could be, if your kids are newborn, and you don't mention this, and the parents continue to work full time with minimal parental leave taken, IRCC might suspect grandparents were here to work as caretakers (even unpaid, it is still work).