Is it wrong to still go out w my ex?

Me n my ex have a 4 yr old. I left him when my daughter was about one yr old. I now have a yr old w another guy. But we are not together anymore. Recently my daughter (the 4 yr. old) was diagnosed w epilepsy. That has made me and my ex be closer. He tells me wants to go back w me. But i know for a fact i dont love him anymore. No sexual attraction either. Ive gone out to dinner w him a couple of times. He keeps insisting for us to go back together. But deep inside of me i know i wouldnt be truly happy. When i do accept to go out to dinner w him i tell him to keep in mind i dont want to go back w him. Every single weekend he wants to take me out somewhere. Should i just stop going out w him so he could see i dont want to go back w him?? Please help.