You two need to talk it out. He needs to know that you feel more attracted to him when you feel sexy, and let him know the things he can do to help you feel more attractive and confident.
Do you masturbate at all? It can help improve your libido if you regularly take things into your own hands.
There's many things you can do to build your own self image, like embracing how you look naked and dancing along with some sexy music. Get into a sexy mindset and the rest will follow.
It needs to be said though that when you do all this, if he's not doing enough to help support your positive new attitude and continuing to tell you you're "awkward and not necessarily sexy," then you need to get rid of him