Capppy needs advice on Cancer Man...

I (Sun: Capricorn Moon &Rising : Scorpio) been dating this all around great Cancer guy since June/2017. When we first started dating we immediately fell for one another, we knew that we've never experiences a love like what we were experiencing. I soon found out that growing up he'd seen a lot of negative things, he was badly damaged in his first marriage, his family demands a lot from him, and he doesn't like his job. Trying to be understanding, I noticed that small things (well I thought they were small) like him not remembering when we were supposed to go out and me telling him that I was disappointed sent him into a world spin. He says that he associates disappointment to his first marriage. I tried to explain to him that I'm not her. It took him a week at a time to "recharge" which made me feel terrible. We both have kids two a piece around the same ages, I've started to build a bond with his family. Me and his mother sew every weekend. I've always been there when his "recharging" phase was over. About 2 months ago he expressed to me that he was extremely afraid of getting intimate with me again because the connection is so strong and he is afraid to fall out with me again because it hurts too bad and takes him too long to recover. What I don't think he understands is that he is causing the fall outs. My only gripes in the relationship was me not seeing him consistently. (Even though we text all day). To give him the benefit of the doubt his entire family told me that he doesn't remember anything. Which is why I've been lenient and understanding when he has forgotten things in the past. This last blow up was because he made plans with a buddy and I assumed he would make me his first stop when he had free time. When I mentioned it, he told me how stressed out he was and how he just wants to move. When I got off the phone (Feeling like crap) I sent him a text letting him know that I feel like the only thing I could do to help was leave his life. (I didn't want to, but he made me feel like a burden or not important). He didn't respond, I texted him again letting him know that I didn't want to walk away I just don't know how I could help. He ignored me again, in a panic I reached out on a few social media sites to get his attention. (He Didn't LIKE THAT) MAJOR error on my part. He finally responded "I love you, I truly do. Please just give me some time and I'll call you and we can figure something out". That day never came and I ended up reaching out for clarification a few days later. He responded and told me that we need to "Put the entire relationship on ice" and that me reaching constantly that day turned him off completely. I told him "ok- I understand". He replied that this is stressful and he doesn't need stress right now. A week or so later I reached out and asked him if this is something that he would want to revisit in the future "If handled correctly". He replied. I don't know what the future holds, but right now I just need to be by myself. I've been in my brain about this for a while now and know that it's time for me to mentally move on. No need in beating dead horse. I truly believe we are soul mates and with soul mates it doesn't always mean things will be a bed of roses. I don't know if he is seeing someone else, (I hope not). I told him that I would check on him in a few weeks and not to erase me out of his memory. I don't know why I want to show him that he can have the healthy, loving, caring, and successful relationship he longs for it will just take work, from the both of us together and work within ourselves. What are you thoughts?