Immigration is bothered about your age, citizenship and work experience (not work eligibility), and relationship of you and your spouse.
I don't think your resident card is involved in proving any of these, so in my opinion you do not have to worry about your resident card.