Did you use a lawyer or immigration consultant? You will want to use a very good lawyer if you plan to appeal (stay away from immigration consultants). If you did in fact use a lawyer for your application, you may want to switch to a different one for your appeal.
This situation is far too complicated for any of us to be able to help you.
It's going to be challenging to overcome this situation. It basically means that he either lied in his refugee application about his sexual orientation - or that his relationship with you isn't genuine. Again, too complex for this forum. You need to find an excellent lawyer to assist you.