If you have sole custody of your daughter, then it shouldn't be a problem. Don't forget to put your husband on your application as a family member, irrespective of whether you're sponsoring him at this time.
If you don't have sole custody, you'll probably need the permission of the daughter's father or custodian.
