How can I fix my relationship?

My boyfriend and I have been together for 2 years and everything has been wonderful. A few months ago, we were having a rough patch and took a break for a couple weeks. during this break someone that i used to be really good friends with saw me in a parking lot and called me over to his car, in the middle of our conversation he kissed me. I didn’t kiss back, I don’t think i did anything to provoke it, it just happened. I told my bf because I didn’t want to keep secrets between us. He almost broke up with me, but we ended up staying together, but since then I have felt like he doesn’t trust me as much as he used to, he doesn’t treat me the same. We were moving along from that until the other day when he was surfing in Mexico. Three of us went to the movies, A friend of mine and a mutual friend of me and my boyfriend, During the movie his friend grabbed my hand it was felt like an attempt to hold it. Of course i didn’t let this go through, but I left my boyfriend a voicemail telling him about it seeing as i couldn’t get ahold of him down in Mexico. This was only a couple days ago but he hasn’t talked to me since, i still regularly try to call him once a day and i text him in the morning like always. But I’ve noticed he doesnt say “I love you” anymore when he talks to me and he just seems to be ignoring me. Did i do the wrong thing by not wanting to keep things from him? I feel like he is blaming me for the two things that happened, he says he feels like the past is repeating its self. And I just feel like he doesn’t want or love me as much as he used to, he gives off the vibe that he’s mad at me, but i dont think that I did anything for him to be mad at. I thought I was doing all the right things, how do I fix this?