Should i talk to him or carry on ignoring him?

That's a really tricky one..You don't want him to think he can just use you for sex..When you talked did he tell you how he felt i.e does he have real feelings for you? If you can't be honest with each other then it'll never work and this will eat away at you. You haven't done anything wrong though. If you really have feelings for him its only natural that you'd want to be with him or close to him..Get him to talk maybe..Meet in a coffee shop and be really honest..If he walks away you've not lost the guy of your dreams..more perhaps a nightmare..Good luck