Why does he do this to me?

Talk to him about it. Keeping these feelings to yourself isn't helping you at all. In order to change the situation, you need to communicate with him. He may agree to be with you, or he may not, but if you don't make an effort to talk to him about it, you're going to remain miserable.