Just a visit to home country is not sufficient to do any harm to a citizen who was a former refugee. Yes it may lead to investigation but unlikely and even if it does, one does not have anything to worry about as long as they did not have any misrepresentation in claim, PR, or citizenship...