Its not marriage fraud because you were never married. When you applied what information did you tell the immigration officer, were you going to live together? were you going to get married right away?
Even if they might not do anything, you should just report him incase they do. He obviously...