I think the best thing for you would be to not see him for a while. He's taking advantage of the fact that you want it to work. He's made it more than clear that he doesn't want a relationship. Unfortunately, you'll just have to accept it and move on. But spending time with him will only make it harder for you. Being physical will always give you the hope that he will change his mind, it's not fair to you.
Cancel on your plans next week and keep yourself busy so you don't cave. Make an appointment to get a massage or get your nails done instead. Do something to make yourself feel good. If things change in a few weeks, then maybe revisit the idea, but for now you're being taken advantage of.